-- Logs begin at Wed 2022-06-29 11:39:52 UTC, end at Wed 2022-06-29 12:36:33 UTC. -- Jun 29 12:06:50.864495 dv-cinder-797608-38-smb systemd[1]: Starting Devstack devstack@keystone.service... Jun 29 12:06:50.876260 dv-cinder-797608-38-smb devstack@keystone.service[80124]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 29 12:06:50.879380 dv-cinder-797608-38-smb devstack@keystone.service[80124]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 29 12:06:50 2022] *** Jun 29 12:06:50.879380 dv-cinder-797608-38-smb devstack@keystone.service[80124]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 29 12:06:50.879380 dv-cinder-797608-38-smb devstack@keystone.service[80124]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 29 12:06:50.879380 dv-cinder-797608-38-smb devstack@keystone.service[80124]: nodename: dv-cinder-797608-38-smb Jun 29 12:06:50.879380 dv-cinder-797608-38-smb devstack@keystone.service[80124]: machine: x86_64 Jun 29 12:06:50.879380 dv-cinder-797608-38-smb devstack@keystone.service[80124]: clock source: unix Jun 29 12:06:50.879380 dv-cinder-797608-38-smb devstack@keystone.service[80124]: pcre jit disabled Jun 29 12:06:50.879380 dv-cinder-797608-38-smb devstack@keystone.service[80124]: detected number of CPU cores: 4 Jun 29 12:06:50.879380 dv-cinder-797608-38-smb devstack@keystone.service[80124]: current working directory: / Jun 29 12:06:50.879380 dv-cinder-797608-38-smb devstack@keystone.service[80124]: detected binary path: /usr/bin/uwsgi-core Jun 29 12:06:50.879380 dv-cinder-797608-38-smb devstack@keystone.service[80124]: your processes number limit is 47680 Jun 29 12:06:50.879380 dv-cinder-797608-38-smb devstack@keystone.service[80124]: your memory page size is 4096 bytes Jun 29 12:06:50.879380 dv-cinder-797608-38-smb devstack@keystone.service[80124]: detected max file descriptor number: 2048 Jun 29 12:06:50.879380 dv-cinder-797608-38-smb devstack@keystone.service[80124]: lock engine: pthread robust mutexes Jun 29 12:06:50.880178 dv-cinder-797608-38-smb devstack@keystone.service[80124]: thunder lock: enabled Jun 29 12:06:50.880178 dv-cinder-797608-38-smb devstack@keystone.service[80124]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 29 12:06:50.880178 dv-cinder-797608-38-smb devstack@keystone.service[80124]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 29 12:06:50.942966 dv-cinder-797608-38-smb devstack@keystone.service[80124]: Python main interpreter initialized at 0x556ddc6a89c0 Jun 29 12:06:50.942966 dv-cinder-797608-38-smb devstack@keystone.service[80124]: python threads support enabled Jun 29 12:06:50.942966 dv-cinder-797608-38-smb devstack@keystone.service[80124]: your server socket listen backlog is limited to 100 connections Jun 29 12:06:50.942966 dv-cinder-797608-38-smb devstack@keystone.service[80124]: your mercy for graceful operations on workers is 90 seconds Jun 29 12:06:50.943366 dv-cinder-797608-38-smb devstack@keystone.service[80124]: mapped 403077 bytes (393 KB) for 2 cores Jun 29 12:06:50.943441 dv-cinder-797608-38-smb devstack@keystone.service[80124]: *** Operational MODE: preforking *** Jun 29 12:06:50.943695 dv-cinder-797608-38-smb devstack@keystone.service[80124]: *** uWSGI is running in multiple interpreter mode *** Jun 29 12:06:50.943695 dv-cinder-797608-38-smb devstack@keystone.service[80124]: spawned uWSGI master process (pid: 80124) Jun 29 12:06:50.943922 dv-cinder-797608-38-smb systemd[1]: Started Devstack devstack@keystone.service. Jun 29 12:06:50.949734 dv-cinder-797608-38-smb devstack@keystone.service[80124]: spawned uWSGI worker 1 (pid: 80134, cores: 1) Jun 29 12:06:50.949734 dv-cinder-797608-38-smb devstack@keystone.service[80124]: spawned uWSGI worker 2 (pid: 80135, cores: 1) Jun 29 12:06:50.949734 dv-cinder-797608-38-smb devstack@keystone.service[80124]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 29 12:06:56.400732 dv-cinder-797608-38-smb devstack@keystone.service[80135]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 12:06:56.400732 dv-cinder-797608-38-smb devstack@keystone.service[80135]: from cryptography.utils import int_from_bytes Jun 29 12:06:56.401580 dv-cinder-797608-38-smb devstack@keystone.service[80135]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 12:06:56.401580 dv-cinder-797608-38-smb devstack@keystone.service[80135]: from cryptography.utils import int_from_bytes Jun 29 12:06:56.424840 dv-cinder-797608-38-smb devstack@keystone.service[80134]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 12:06:56.424840 dv-cinder-797608-38-smb devstack@keystone.service[80134]: from cryptography.utils import int_from_bytes Jun 29 12:06:56.425543 dv-cinder-797608-38-smb devstack@keystone.service[80134]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 12:06:56.425543 dv-cinder-797608-38-smb devstack@keystone.service[80134]: from cryptography.utils import int_from_bytes Jun 29 12:06:56.450769 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 29 12:06:56.450989 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 29 12:06:56.451125 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] command line args: [] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 29 12:06:56.451418 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 29 12:06:56.451582 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ================================================================================ {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 29 12:06:56.451821 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] admin_token = **** {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.452070 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] config_dir = [] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.452256 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.452446 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] config_source = [] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.452626 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] debug = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.452829 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.453190 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.453372 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.453626 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.453905 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.454226 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] list_limit = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.454324 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] log_config_append = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.454479 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.454657 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] log_dir = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.454916 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] log_file = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.455068 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.455320 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.455567 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.455826 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.455995 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.456212 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.456446 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.456693 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.456928 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.457174 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.457384 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.457660 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.457899 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.458131 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.458450 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.458942 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.459184 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] publish_errors = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.459369 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.459539 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.459739 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.459971 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.460192 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.460451 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] standard_threads = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.460658 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.460915 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.461078 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.461227 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] use_journal = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.461424 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] use_json = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.461597 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] use_stderr = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.461777 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] use_syslog = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.462007 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.462231 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.462470 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.462734 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.462987 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.463278 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.463465 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.463732 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.463942 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.464192 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.464441 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.464694 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.464925 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.465186 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.465423 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.465672 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.465957 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.466131 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.466392 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.466653 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.466900 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.467137 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.467394 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.467802 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.468036 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.468406 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.468801 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.469206 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.469459 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.469745 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.470101 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.470365 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.470604 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.470840 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.471084 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.471350 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.471595 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.471879 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.472309 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.472492 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.472676 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.473104 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.473341 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.473464 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 29 12:06:56.473585 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.473736 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 29 12:06:56.473851 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] command line args: [] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 29 12:06:56.473959 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.474079 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.474190 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 29 12:06:56.474298 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ================================================================================ {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 29 12:06:56.474416 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.474526 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] admin_token = **** {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.474635 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.474743 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] config_dir = [] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.474852 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.474961 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.475078 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.475188 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] config_source = [] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.475296 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.475413 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] debug = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.475530 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.475648 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.475648 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.475891 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.476007 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.476117 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.476225 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.476341 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.476460 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.476576 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.476692 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] list_limit = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.476800 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.476908 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] log_config_append = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.477025 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.477135 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.477135 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] log_dir = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.477339 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.477455 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] log_file = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.477574 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.477684 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.477812 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.477921 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.478029 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.478137 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.478330 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.478443 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.478555 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.478677 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.478677 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.478902 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.479020 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.479131 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.479244 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.479355 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.479464 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.479574 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.479691 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.479807 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.479923 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.479923 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.480128 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.480243 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.480361 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.480471 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.480580 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.480690 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.480799 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.480799 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.481012 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.481125 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.481235 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] publish_errors = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.481342 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.481459 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.481575 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.481686 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.481817 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.481926 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.482041 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.482162 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.482272 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.482381 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.482495 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] standard_threads = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.482605 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.482714 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.482898 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.483010 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.483124 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.483240 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.483350 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.483464 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] use_journal = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.483582 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.483692 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] use_json = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.483692 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] use_stderr = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.483896 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.484011 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] use_syslog = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.484120 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.484236 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:06:56.484346 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.484454 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.484562 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.484671 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.484779 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.484896 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.485016 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.485126 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.485234 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.485342 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.485456 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.485574 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.485684 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.485858 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.485968 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.486076 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.486184 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.486309 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.486420 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.486515 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.486606 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.486735 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.486842 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.486938 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.487030 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.487122 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.487266 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.487379 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.487558 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.487659 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.487808 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.487914 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.488016 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.488231 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.488489 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.488604 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.488701 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.488809 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] auth.external = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.488905 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.489001 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.489067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.489230 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.489317 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.489493 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.489575 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.489772 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.489856 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] auth.password = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.490011 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] auth.token = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.490092 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.490247 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.490327 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.490473 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.490592 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.490703 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.490836 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.490940 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.491043 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.491146 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.491274 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.491386 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.491538 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.491648 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.491752 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.491858 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.491988 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] credential.caching = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.492102 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.492207 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.492309 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.492439 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.492540 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.492689 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.492810 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.492915 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.493017 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.493167 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.493248 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.493402 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.493492 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.493657 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.493797 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.493900 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.494005 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.494148 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.494239 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.494383 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.494464 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.494690 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.494772 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.494935 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.495024 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.495200 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.495288 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.495443 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.495524 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.495674 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.495836 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.495920 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.496032 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] federation.caching = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.496110 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.496180 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.496381 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.496463 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.496625 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.496706 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.496853 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.496933 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.497095 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.497175 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.497331 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.497411 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.497570 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.497648 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.497831 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.497927 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.498057 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.498142 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.498308 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.498388 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.498548 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.498662 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.498773 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.caching = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.498848 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.498994 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.499079 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.499243 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.499319 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.499484 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.499590 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.499715 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.499789 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.499954 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.500032 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.500185 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.500252 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.500426 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.500508 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.500678 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.500755 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.500927 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.501002 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.501160 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.501284 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.501379 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.501458 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.501610 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.501765 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.501879 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.502044 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.502129 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.502214 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.502365 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.502448 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.502604 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.502683 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.502848 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.502925 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.503116 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.503238 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.503840 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.503929 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.504002 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.504086 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.504159 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.504229 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.504307 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.504380 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.504380 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.504513 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.504591 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.504666 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.504784 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.504863 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.505025 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.505101 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.505284 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.505379 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.505499 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.505581 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.505754 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.505847 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.505994 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.506073 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.506228 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.506308 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.506460 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.506544 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.506692 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.506778 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.506929 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.507008 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.507160 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.507238 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.507389 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.507465 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.507629 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.507708 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.507868 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.507947 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.508103 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.508179 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.508340 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.508417 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.508580 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.508658 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.508828 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.508906 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.509055 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] auth.external = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.509127 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.509279 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.509357 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.509511 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.509586 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.509782 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.509864 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.510033 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.510110 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] auth.password = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.510263 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] auth.token = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.510351 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.510499 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.510575 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.510735 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.510812 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.510968 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.511062 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.511201 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.511284 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.511449 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.511528 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.511679 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.511763 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.511925 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.512001 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.512164 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] credential.caching = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.512249 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.512406 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.512490 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.512641 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.512719 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.512870 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.512946 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.513105 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.513191 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.513341 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.513419 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.513575 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.513659 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.513827 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.513917 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.514072 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.514151 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.514318 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.514395 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.514563 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.514649 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.514808 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.514885 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.515053 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.515137 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.515281 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.515368 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.515529 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.515602 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.515785 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.515871 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.516002 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.516089 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] federation.caching = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.516239 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.516319 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.516475 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.516562 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.516722 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.516807 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.516964 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.517040 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.517205 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.517323 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.517441 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.517534 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.517793 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.517932 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.518048 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.518161 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.518282 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.518392 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.518465 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.518525 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.518616 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.518685 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.518892 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.519051 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] identity.caching = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.519120 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.519307 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.519378 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.519559 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.519733 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.519814 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.519877 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] resource.caching = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.520092 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.520272 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.520392 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.520513 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.520644 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.520761 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.520892 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.521016 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.521136 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.521258 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.521385 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.521504 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.521625 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.521729 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.521854 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.521973 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.522141 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.522223 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.522382 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.522504 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] role.caching = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.522640 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.522771 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] role.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.522889 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.522974 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.523130 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.523215 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.523373 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.523503 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.523503 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.523726 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.523726 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.523903 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.523983 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.524131 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.524217 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.524345 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.524425 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.524548 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.524666 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.524757 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.524922 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.525047 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.525128 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.525128 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.525308 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.525431 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.525580 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.525665 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.525838 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.525919 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.526089 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.526181 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.526371 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.526566 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.526761 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.526960 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.527144 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.527144 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.527511 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.527701 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.527908 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.528094 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.528283 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.528489 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.528489 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.528851 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.528997 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.528997 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.529287 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.529494 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.529836 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.530034 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.530034 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.530410 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.530601 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.530601 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.530974 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.531164 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.531164 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.531521 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.531717 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.531717 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.532087 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.532282 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.532282 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.user = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.532646 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.532847 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.533050 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.533240 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.533240 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.533598 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.533832 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.533832 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.534201 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.534427 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.534427 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.534786 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.534901 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.534901 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.535568 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.535765 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.535765 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.536129 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.536432 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.536432 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.536852 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] token.caching = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.537042 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.537042 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.537334 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.537527 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.537751 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.537945 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.537945 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.538311 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.538520 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.538712 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.538926 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.538926 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.539287 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.539479 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.539479 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.539768 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.539886 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.539886 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.540232 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.540421 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.540421 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.540780 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.540927 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.540927 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.541326 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.541489 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.541489 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.541919 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.542132 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.542327 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.544759 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.544759 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.545154 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.545350 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.545350 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.545759 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.545973 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] resource.caching = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.545973 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.546340 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.547352 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.547352 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.547757 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.547953 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.548151 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.548344 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.548344 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.548713 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.548946 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.549139 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] database.connection = **** {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.549370 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.549520 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.549634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.549765 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.549886 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] role.caching = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.550070 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.550184 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] role.driver = sql {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.550184 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.552449 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.552584 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.552726 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.552845 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.552964 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.553083 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.553200 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.553315 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.553315 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.553538 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.553650 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.553650 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.553913 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.553984 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.553984 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.554125 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.554186 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.554186 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.554291 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.554349 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.554416 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.554485 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.554547 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.554607 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.554743 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.554853 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.555616 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.555755 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.555889 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.556016 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.556016 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.556247 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.556385 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.556385 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.556609 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.556731 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.556846 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 29 12:06:56.556967 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.556967 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.556967 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.556967 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.556967 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.556967 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.556967 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.556967 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.556967 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.558003 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.558003 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.558003 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] token.caching = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.558003 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.558003 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.558003 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.558003 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.558003 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.558003 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.558968 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.558968 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.558968 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.558968 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.558968 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.558968 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.558968 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.558968 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.558968 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.559952 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.559952 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.559952 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] database.connection = **** {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.559952 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.559952 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.559952 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.559952 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.559952 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.559952 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.561059 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.561059 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.561059 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.561059 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.561059 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.561059 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.561059 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.561059 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.561059 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.562091 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.562091 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.562091 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:06:56.562091 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 29 12:06:56.580999 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:56.581242 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:56.581493 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:56.586539 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:56.586781 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:56.586990 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:56.590543 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:56.595658 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:56.619472 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:56.619681 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:56.622324 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:56.622559 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:56.767411 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:56.769749 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:56.818118 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:56.818362 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:56.820065 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:56.820405 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:56.885739 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:56.886012 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:56.886179 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:56.886399 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:56.886552 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:56.886666 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:56.886773 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:56.886878 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:56.886983 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:56.887113 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:56.887286 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:56.887507 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:56.912819 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:56.913028 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:56.913258 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:56.913479 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:56.913715 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:56.913945 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:56.914158 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:56.914867 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:56.915101 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:56.915327 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:56.915548 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:56.915751 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:56.915963 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:56.916179 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:56.925638 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:56.927047 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:56.938687 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:56.938992 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:56.939157 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:56.939236 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:56.939340 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:56.939404 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:56.939469 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:56.939551 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:56.939623 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:56.939694 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:56.939856 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:56.939980 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:56.940057 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:56.940267 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 12:06:56.958125 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:56.958320 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 29 12:06:56.958656 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:56.958779 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:56.958886 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 29 12:06:56.958965 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 29 12:06:56.959305 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:56.959428 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:56.959505 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 29 12:06:56.959581 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:56.959759 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:56.959883 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:56.959992 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:56.960080 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:56.960274 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:56.960522 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:56.971032 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:56.971313 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:56.971435 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:56.971557 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:56.971648 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:56.971864 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:56.971987 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:56.972241 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:56.980358 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80134) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:56.980600 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:56.983702 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80134) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:56.983910 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:56.984008 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:56.984198 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:56.984321 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:56.984464 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:56.984556 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:56.984763 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:56.984887 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:56.985007 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:56.985109 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:56.985291 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:56.985413 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:56.985561 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:56.985683 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:56.985851 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:56.985990 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:56.986077 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:56.986140 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:56.986373 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:56.986495 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:56.986587 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.013106 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.013309 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.014783 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:57.014910 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80134) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:57.015064 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.015149 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.020464 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:57.020589 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80134) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:57.020667 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.020728 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.020951 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.021075 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.028445 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:57.028588 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80134) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:57.028734 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.028870 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.033270 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:57.033405 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80134) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:57.033555 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.033677 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.033842 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.033933 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.034132 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.034264 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.034441 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.034563 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.034750 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.034872 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.035021 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.035193 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.035471 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.035573 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.054298 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.054504 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.054602 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.054701 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.059222 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80134) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:57.059351 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:57.062942 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.063069 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.063203 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.063293 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.068500 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80134) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:57.068635 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:57.072153 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80134) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:57.072279 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:57.076209 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.076317 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.076507 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.076595 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.076788 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.076928 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.077089 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.077200 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.077372 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.077474 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.077681 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.077790 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.096713 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:57.097340 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80134) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:57.097454 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.097454 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.097607 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.097670 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.097782 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.098010 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.105859 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.106005 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.107609 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.107796 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.107934 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.108052 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.111112 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:57.111280 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80134) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:57.111415 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.111539 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.111661 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.111803 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.111924 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.112046 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.112168 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.112289 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.125572 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80134) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:57.125735 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:57.125854 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.125945 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.126145 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.126280 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.126451 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.126575 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.126752 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.126876 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.127029 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.127153 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.127301 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.127394 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.146699 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:57.146852 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80134) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:57.149996 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:57.150121 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80134) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:57.153310 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.153436 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.154931 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.155056 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.156704 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:57.156840 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80134) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:57.156955 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.157044 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.157263 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.157386 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.164728 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.164851 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.166375 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80134) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:57.166518 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:57.169669 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.169813 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.169977 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.170101 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.170261 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.170403 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.170507 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.170700 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.179899 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80134) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:57.180168 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.180305 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:57.180464 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.180588 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.180878 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.188353 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80134) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:57.188630 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.188752 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 12:06:57.188906 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.189030 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.189174 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.189298 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.189413 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.189503 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.189729 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.189850 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.190005 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.190148 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.190228 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.190302 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.190609 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.191107 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.191484 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.191563 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.191679 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.191806 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.191897 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.191974 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.192047 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.192119 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.192190 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.192262 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.192343 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 12:06:57.230450 dv-cinder-797608-38-smb devstack@keystone.service[80134]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x556ddc6a89c0 pid: 80134 (default app) Jun 29 12:06:57.232154 dv-cinder-797608-38-smb devstack@keystone.service[80135]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x556ddc6a89c0 pid: 80135 (default app) Jun 29 12:06:57.234050 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ec328-e607-42e2-b56c-75edc1d4c873 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:06:57.234346 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ec328-e607-42e2-b56c-75edc1d4c873 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:06:57.234632 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ec328-e607-42e2-b56c-75edc1d4c873 None None] PATH_INFO: `/v3` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:06:57.239156 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 791 bytes} [Wed Jun 29 12:06:57 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:04.998714 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701d452-59ee-4a03-aa79-6b3acde562f1 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:04.999358 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701d452-59ee-4a03-aa79-6b3acde562f1 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:04.999358 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701d452-59ee-4a03-aa79-6b3acde562f1 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:05.003755 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1/2] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:07:04 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:07:05.010115 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea8c37-63e9-4ba6-955a-dd32bfb64c3f None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:05.010689 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea8c37-63e9-4ba6-955a-dd32bfb64c3f None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:05.010689 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea8c37-63e9-4ba6-955a-dd32bfb64c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:05.081178 dv-cinder-797608-38-smb devstack@keystone.service[80134]: INFO dbcounter [None req-ecea8c37-63e9-4ba6-955a-dd32bfb64c3f None None] Registered counter for database keystone Jun 29 12:07:05.102861 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG oslo_db.sqlalchemy.engines [None req-ecea8c37-63e9-4ba6-955a-dd32bfb64c3f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80134) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 12:07:05.109715 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writer thread running {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 12:07:05.291150 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG passlib.handlers.bcrypt [None req-ecea8c37-63e9-4ba6-955a-dd32bfb64c3f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80134) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 29 12:07:05.291458 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG passlib.handlers.bcrypt [None req-ecea8c37-63e9-4ba6-955a-dd32bfb64c3f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80134) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 29 12:07:05.347838 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-ecea8c37-63e9-4ba6-955a-dd32bfb64c3f None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:05.349481 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ecea8c37-63e9-4ba6-955a-dd32bfb64c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:05.481106 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 2/3] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 472 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 29 12:07:05.657721 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701d452-59ee-4a03-aa79-6b3acde562f1 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:05.730987 dv-cinder-797608-38-smb devstack@keystone.service[80135]: INFO dbcounter [None req-4701d452-59ee-4a03-aa79-6b3acde562f1 None None] Registered counter for database keystone Jun 29 12:07:05.751457 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG oslo_db.sqlalchemy.engines [None req-4701d452-59ee-4a03-aa79-6b3acde562f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80135) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 12:07:05.759110 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writer thread running {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 12:07:05.882223 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701d452-59ee-4a03-aa79-6b3acde562f1 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:05.887172 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a827a7-f553-4116-87e4-5b0c05cbcb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:05.887858 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a827a7-f553-4116-87e4-5b0c05cbcb56 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:05.888141 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a827a7-f553-4116-87e4-5b0c05cbcb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:05.888421 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a827a7-f553-4116-87e4-5b0c05cbcb56 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:05.899318 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a827a7-f553-4116-87e4-5b0c05cbcb56 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:05.951686 dv-cinder-797608-38-smb devstack@keystone.service[80135]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a3a827a7-f553-4116-87e4-5b0c05cbcb56 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 29 12:07:05.951901 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a827a7-f553-4116-87e4-5b0c05cbcb56 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:05.963247 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 2/4] 10.222.0.27 () {58 vars in 1324 bytes} [Wed Jun 29 12:07:05 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 12:07:05.969636 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea8c37-63e9-4ba6-955a-dd32bfb64c3f None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:05.985744 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea8c37-63e9-4ba6-955a-dd32bfb64c3f None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:05.990890 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a4d316-15bf-4499-a0c3-7563cd146cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:05.992073 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4d316-15bf-4499-a0c3-7563cd146cec admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:05.992355 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4d316-15bf-4499-a0c3-7563cd146cec admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:05.992629 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4d316-15bf-4499-a0c3-7563cd146cec admin admin] PATH_INFO: `/v3/projects/06b39178fa6444fba25717312ec5afa2` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:05.997016 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a4d316-15bf-4499-a0c3-7563cd146cec admin admin] RBAC: Authorizing `identity:get_project(project_id=06b39178fa6444fba25717312ec5afa2)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:06.047596 dv-cinder-797608-38-smb devstack@keystone.service[80134]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c6a4d316-15bf-4499-a0c3-7563cd146cec admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 29 12:07:06.048224 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a4d316-15bf-4499-a0c3-7563cd146cec admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:06.052890 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 3/5] 10.222.0.27 () {56 vars in 1207 bytes} [Wed Jun 29 12:07:05 2022] GET /identity/v3/projects/06b39178fa6444fba25717312ec5afa2 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:08.086667 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883435a-135c-486a-9752-d8de942542fe None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:08.087441 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883435a-135c-486a-9752-d8de942542fe None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:08.087585 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883435a-135c-486a-9752-d8de942542fe None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:08.094601 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 3/6] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:07:08 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:08.102986 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c64ff-8370-46d0-b099-af23d73a5563 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:08.103432 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c64ff-8370-46d0-b099-af23d73a5563 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:08.103521 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c64ff-8370-46d0-b099-af23d73a5563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:08.124340 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-6d8c64ff-8370-46d0-b099-af23d73a5563 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:08.125921 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-6d8c64ff-8370-46d0-b099-af23d73a5563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:08.134762 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 4/7] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 29 12:07:08.158241 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3883435a-135c-486a-9752-d8de942542fe None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:08.179302 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3883435a-135c-486a-9752-d8de942542fe None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:08.185232 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f67e6-319d-4372-ba80-352afa38c03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:08.185907 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f67e6-319d-4372-ba80-352afa38c03b admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:08.186186 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f67e6-319d-4372-ba80-352afa38c03b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:08.186459 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f67e6-319d-4372-ba80-352afa38c03b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:08.194987 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66f67e6-319d-4372-ba80-352afa38c03b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:08.196789 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66f67e6-319d-4372-ba80-352afa38c03b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:08.206287 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 4/8] 10.222.0.27 () {58 vars in 1324 bytes} [Wed Jun 29 12:07:08 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 12:07:08.215008 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c64ff-8370-46d0-b099-af23d73a5563 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:08.231996 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c64ff-8370-46d0-b099-af23d73a5563 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:08.239445 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c59326-4748-4088-b9f9-83b1d853dcab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:08.240321 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c59326-4748-4088-b9f9-83b1d853dcab admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:08.240608 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c59326-4748-4088-b9f9-83b1d853dcab admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:08.240880 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c59326-4748-4088-b9f9-83b1d853dcab admin admin] PATH_INFO: `/v3/users/06533d70196747b697431af8a9794673` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:08.242467 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c59326-4748-4088-b9f9-83b1d853dcab admin admin] RBAC: Authorizing `identity:get_user(user_id=06533d70196747b697431af8a9794673)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:08.244309 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c59326-4748-4088-b9f9-83b1d853dcab admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:08.245938 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 5/9] 10.222.0.27 () {56 vars in 1198 bytes} [Wed Jun 29 12:07:08 2022] GET /identity/v3/users/06533d70196747b697431af8a9794673 => generated 247 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:10.337290 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7620a3a-2179-438b-83e5-51a2913d3d6e None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:10.337865 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7620a3a-2179-438b-83e5-51a2913d3d6e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:10.337865 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7620a3a-2179-438b-83e5-51a2913d3d6e None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:10.339259 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 5/10] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:07:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:10.344546 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d439e2-199e-43a3-bc00-556adffea3e9 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:10.344987 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d439e2-199e-43a3-bc00-556adffea3e9 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:10.345077 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d439e2-199e-43a3-bc00-556adffea3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:10.362910 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-60d439e2-199e-43a3-bc00-556adffea3e9 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:10.364299 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-60d439e2-199e-43a3-bc00-556adffea3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:10.383574 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ea930-0d5c-41fb-95e6-fbcbc00378f5 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:10.383840 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ea930-0d5c-41fb-95e6-fbcbc00378f5 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:10.384235 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ea930-0d5c-41fb-95e6-fbcbc00378f5 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:10.385526 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 6/11] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:07:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:07:10.390565 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee53861-883e-474d-b09d-4db6666d7fd0 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:10.390856 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee53861-883e-474d-b09d-4db6666d7fd0 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:10.391133 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee53861-883e-474d-b09d-4db6666d7fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:10.431803 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG passlib.handlers.bcrypt [None req-4ee53861-883e-474d-b09d-4db6666d7fd0 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80135) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 29 12:07:10.432210 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG passlib.handlers.bcrypt [None req-4ee53861-883e-474d-b09d-4db6666d7fd0 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80135) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 29 12:07:10.449943 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 6/12] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:10.473276 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d439e2-199e-43a3-bc00-556adffea3e9 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:10.477804 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-4ee53861-883e-474d-b09d-4db6666d7fd0 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:10.481535 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4ee53861-883e-474d-b09d-4db6666d7fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:10.500729 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:10.585274 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d439e2-199e-43a3-bc00-556adffea3e9 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:10.596226 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 7/13] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 12:07:10.618580 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a6845-a4f4-4c97-b5e6-db75f4a8ab25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:10.618790 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee53861-883e-474d-b09d-4db6666d7fd0 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:10.619384 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a6845-a4f4-4c97-b5e6-db75f4a8ab25 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:10.619667 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a6845-a4f4-4c97-b5e6-db75f4a8ab25 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:10.619943 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a6845-a4f4-4c97-b5e6-db75f4a8ab25 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:10.631339 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7a6845-a4f4-4c97-b5e6-db75f4a8ab25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:10.642516 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-6d7a6845-a4f4-4c97-b5e6-db75f4a8ab25 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:07:10.642516 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:10.642516 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:10.642516 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:10.642516 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:10.642516 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:10.642516 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:10.642516 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:10.642516 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:10.642516 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:10.642516 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:10.642516 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:10.642516 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:10.642516 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:10.642516 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:10.642516 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:10.643450 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:10.643450 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:10.643450 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:10.643450 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:10.643450 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:10.643450 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:10.643450 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:10.643450 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:10.643450 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:10.643450 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:10.643450 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:10.643450 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:10.643450 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:10.643450 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:10.643450 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:10.643450 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:10.644487 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:10.644487 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:10.644487 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:10.644487 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:10.644487 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:10.644487 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:10.644487 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:10.644487 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:10.644487 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:10.644487 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:10.644487 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:07:10.644487 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:07:10.644487 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 7/14] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jun 29 12:07:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:07:10.649962 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a6845-a4f4-4c97-b5e6-db75f4a8ab25 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:10.725704 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee53861-883e-474d-b09d-4db6666d7fd0 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:10.728013 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:10.739778 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:10.761126 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a6845-a4f4-4c97-b5e6-db75f4a8ab25 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:10.765399 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa37bf7-0355-4aac-aab5-635dbc714d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:10.766336 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa37bf7-0355-4aac-aab5-635dbc714d56 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:10.766619 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa37bf7-0355-4aac-aab5-635dbc714d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:10.766891 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa37bf7-0355-4aac-aab5-635dbc714d56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:10.794923 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc8eed5-148a-4fe4-9294-0e0a0ee804e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:10.795589 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc8eed5-148a-4fe4-9294-0e0a0ee804e7 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:10.795867 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc8eed5-148a-4fe4-9294-0e0a0ee804e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:10.796138 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc8eed5-148a-4fe4-9294-0e0a0ee804e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:10.796895 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc8eed5-148a-4fe4-9294-0e0a0ee804e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:10.797179 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc8eed5-148a-4fe4-9294-0e0a0ee804e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:10.798651 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc8eed5-148a-4fe4-9294-0e0a0ee804e7 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:10.810429 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 8/15] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:07:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:07:10.816117 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc8eed5-148a-4fe4-9294-0e0a0ee804e7 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:10.841099 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa37bf7-0355-4aac-aab5-635dbc714d56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:10.844249 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa37bf7-0355-4aac-aab5-635dbc714d56 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:10.925026 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc8eed5-148a-4fe4-9294-0e0a0ee804e7 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:10.951282 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 8/16] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:07:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:07:10.957015 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa37bf7-0355-4aac-aab5-635dbc714d56 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:10.959620 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34773614-c899-4881-b807-6c654dcb99b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:10.960249 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:10.960501 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34773614-c899-4881-b807-6c654dcb99b0 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:10.961333 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34773614-c899-4881-b807-6c654dcb99b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:10.961507 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34773614-c899-4881-b807-6c654dcb99b0 None admin] PATH_INFO: `/v3/users/06533d70196747b697431af8a9794673` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:10.963085 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34773614-c899-4881-b807-6c654dcb99b0 None admin] RBAC: Authorizing `identity:get_user(user_id=06533d70196747b697431af8a9794673)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:10.964714 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34773614-c899-4881-b807-6c654dcb99b0 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:10.966393 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 9/17] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jun 29 12:07:10 2022] GET /identity/v3/users/06533d70196747b697431af8a9794673 => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:07:10.971667 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34773614-c899-4881-b807-6c654dcb99b0 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:10.986687 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:11.061933 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa37bf7-0355-4aac-aab5-635dbc714d56 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:11.073967 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34773614-c899-4881-b807-6c654dcb99b0 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:11.097309 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1824476-113d-4da8-a4b1-9edb89da2194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:11.098478 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1824476-113d-4da8-a4b1-9edb89da2194 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:11.098609 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1824476-113d-4da8-a4b1-9edb89da2194 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:11.098849 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1824476-113d-4da8-a4b1-9edb89da2194 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:11.108779 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df9f69-ccb3-4683-9f7c-6ea07c0f278e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:11.109585 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df9f69-ccb3-4683-9f7c-6ea07c0f278e None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:11.109896 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df9f69-ccb3-4683-9f7c-6ea07c0f278e None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:11.110169 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df9f69-ccb3-4683-9f7c-6ea07c0f278e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:11.111451 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09df9f69-ccb3-4683-9f7c-6ea07c0f278e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:11.112931 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09df9f69-ccb3-4683-9f7c-6ea07c0f278e None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:11.115391 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 10/18] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:11.118232 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1824476-113d-4da8-a4b1-9edb89da2194 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:11.119701 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1824476-113d-4da8-a4b1-9edb89da2194 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:11.121209 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df9f69-ccb3-4683-9f7c-6ea07c0f278e None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:11.140565 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-b1824476-113d-4da8-a4b1-9edb89da2194 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:11.140565 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:11.140565 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:11.140565 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:11.140565 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:11.140565 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:11.140565 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:11.140565 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:11.140565 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:11.140565 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:11.140565 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:11.140565 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:11.140565 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:07:11.140565 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:07:11.140565 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:07:11.141412 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:07:11.141412 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:11.141412 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:11.141412 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:11.141412 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:11.141412 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:11.141412 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:11.141412 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:11.141412 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:11.141412 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:11.141412 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:11.141412 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:11.141412 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:11.141412 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:11.141412 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:11.141412 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:11.141412 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:11.142319 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:07:11.142319 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:07:11.142319 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:11.142319 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:07:11.142319 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 9/19] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:07:11.147900 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1824476-113d-4da8-a4b1-9edb89da2194 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:11.210704 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:11.213292 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:11.240116 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df9f69-ccb3-4683-9f7c-6ea07c0f278e None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:11.266085 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1824476-113d-4da8-a4b1-9edb89da2194 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:11.276441 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eaf5e9-0006-4ace-a4aa-bea8847bae4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:11.277078 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eaf5e9-0006-4ace-a4aa-bea8847bae4b None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:11.277363 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eaf5e9-0006-4ace-a4aa-bea8847bae4b None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:11.277637 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eaf5e9-0006-4ace-a4aa-bea8847bae4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:11.278521 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eaf5e9-0006-4ace-a4aa-bea8847bae4b None admin] RBAC: Adding query filter params (role.id=e0e69ac8a8bf4cc4baa6aa18f2fc9919, scope.domain.id=default, user.id=06533d70196747b697431af8a9794673) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:11.278837 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eaf5e9-0006-4ace-a4aa-bea8847bae4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:11.280300 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eaf5e9-0006-4ace-a4aa-bea8847bae4b None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:11.287422 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 11/20] 10.222.0.27 () {56 vars in 1322 bytes} [Wed Jun 29 12:07:11 2022] GET /identity/v3/role_assignments?user.id=06533d70196747b697431af8a9794673&scope.domain.id=default&role.id=e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 233 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:11.300585 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d48aa07-935a-4ca0-a940-fe7e809a394a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:11.301386 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48aa07-935a-4ca0-a940-fe7e809a394a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:11.301665 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48aa07-935a-4ca0-a940-fe7e809a394a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:11.301989 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48aa07-935a-4ca0-a940-fe7e809a394a None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:11.302746 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d48aa07-935a-4ca0-a940-fe7e809a394a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:11.303053 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d48aa07-935a-4ca0-a940-fe7e809a394a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:11.304509 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d48aa07-935a-4ca0-a940-fe7e809a394a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:11.325466 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 10/21] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:07:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:13.545915 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c34548a-cfcd-4f2b-ba6e-ac0673031a8c None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:13.546955 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c34548a-cfcd-4f2b-ba6e-ac0673031a8c None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:13.547530 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c34548a-cfcd-4f2b-ba6e-ac0673031a8c None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:13.549127 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 12/22] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:07:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:13.555267 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47042da-d12f-45de-b0d9-7872be0fad74 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:13.555683 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47042da-d12f-45de-b0d9-7872be0fad74 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:13.555964 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47042da-d12f-45de-b0d9-7872be0fad74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:13.583140 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e47042da-d12f-45de-b0d9-7872be0fad74 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:13.584362 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e47042da-d12f-45de-b0d9-7872be0fad74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:13.622014 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1fcd5-a4a9-4cde-914a-2d098e02f70f None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:13.622632 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1fcd5-a4a9-4cde-914a-2d098e02f70f None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:13.623103 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1fcd5-a4a9-4cde-914a-2d098e02f70f None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:13.624727 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 13/23] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:07:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:07:13.630633 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1ec30-147e-46e8-8c87-15d74997d305 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:13.631294 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1ec30-147e-46e8-8c87-15d74997d305 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:13.631853 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1ec30-147e-46e8-8c87-15d74997d305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:13.658885 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-3af1ec30-147e-46e8-8c87-15d74997d305 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:13.660643 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-3af1ec30-147e-46e8-8c87-15d74997d305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:13.687091 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 11/24] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:13.723106 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47042da-d12f-45de-b0d9-7872be0fad74 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:13.795255 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 14/25] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:13.822059 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:13.832028 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af1ec30-147e-46e8-8c87-15d74997d305 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:13.930048 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47042da-d12f-45de-b0d9-7872be0fad74 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:14.012063 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f309157-f35a-477d-8d0b-c9288109831c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:14.013195 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f309157-f35a-477d-8d0b-c9288109831c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:14.013622 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f309157-f35a-477d-8d0b-c9288109831c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:14.014048 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f309157-f35a-477d-8d0b-c9288109831c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:14.023760 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:14.055352 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f309157-f35a-477d-8d0b-c9288109831c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:14.068996 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-1f309157-f35a-477d-8d0b-c9288109831c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:07:14.068996 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:14.068996 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:14.068996 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:14.068996 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:14.068996 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:14.068996 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:14.068996 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:14.068996 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:14.068996 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:14.068996 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:14.068996 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:14.068996 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:14.068996 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:14.068996 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:14.068996 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:14.070095 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:14.070095 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:14.070095 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:14.070095 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:14.070095 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:14.070095 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:14.070095 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:14.070095 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:14.070095 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:14.070095 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:14.070095 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:14.070095 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:14.070095 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:14.070095 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:14.070095 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:14.070095 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:14.071034 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:14.071034 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:14.071034 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:14.071034 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:14.071034 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:14.071034 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:14.071034 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:14.071034 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:14.071034 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:14.071034 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:14.071034 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:07:14.071034 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:07:14.073199 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 12/26] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jun 29 12:07:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:07:14.079452 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f309157-f35a-477d-8d0b-c9288109831c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:14.107952 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af1ec30-147e-46e8-8c87-15d74997d305 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:14.194532 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf2715f-af31-4917-9cfb-027d6c447a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:14.195229 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2715f-af31-4917-9cfb-027d6c447a84 None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:14.195509 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2715f-af31-4917-9cfb-027d6c447a84 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:14.195769 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2715f-af31-4917-9cfb-027d6c447a84 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:14.196558 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf2715f-af31-4917-9cfb-027d6c447a84 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:14.198045 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf2715f-af31-4917-9cfb-027d6c447a84 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:14.240802 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f309157-f35a-477d-8d0b-c9288109831c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:14.250393 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:14.310066 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8465e2-1af6-4326-9726-f287f5534825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:14.311106 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8465e2-1af6-4326-9726-f287f5534825 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:14.311589 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8465e2-1af6-4326-9726-f287f5534825 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:14.312077 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8465e2-1af6-4326-9726-f287f5534825 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:14.313060 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8465e2-1af6-4326-9726-f287f5534825 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:14.313561 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8465e2-1af6-4326-9726-f287f5534825 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:14.315188 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8465e2-1af6-4326-9726-f287f5534825 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:14.346169 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 13/27] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:07:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:07:14.354188 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2523a4-21c1-437a-883f-b9eeb98d175b None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:14.354679 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2523a4-21c1-437a-883f-b9eeb98d175b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:14.355098 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2523a4-21c1-437a-883f-b9eeb98d175b None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:14.356613 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 14/28] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:07:14 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:14.357462 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2523a4-21c1-437a-883f-b9eeb98d175b None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:14.409839 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 15/29] 10.222.0.27 () {60 vars in 1131 bytes} [Wed Jun 29 12:07:13 2022] POST /identity/v3/roles => generated 219 bytes in 574 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:07:14.411998 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf38a89-2bc4-4241-837a-616fc697b36c None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:14.412396 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf38a89-2bc4-4241-837a-616fc697b36c None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:14.412782 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf38a89-2bc4-4241-837a-616fc697b36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:14.449707 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-9cf38a89-2bc4-4241-837a-616fc697b36c None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:14.451864 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-9cf38a89-2bc4-4241-837a-616fc697b36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:14.485081 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2523a4-21c1-437a-883f-b9eeb98d175b None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:14.527240 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95987979-6778-4650-bac1-d1657b270736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:14.528471 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95987979-6778-4650-bac1-d1657b270736 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:14.528887 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95987979-6778-4650-bac1-d1657b270736 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:14.529353 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95987979-6778-4650-bac1-d1657b270736 None admin] PATH_INFO: `/v3/users/06533d70196747b697431af8a9794673` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:14.531121 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95987979-6778-4650-bac1-d1657b270736 None admin] RBAC: Authorizing `identity:get_user(user_id=06533d70196747b697431af8a9794673)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:14.532912 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95987979-6778-4650-bac1-d1657b270736 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:14.535059 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 15/30] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jun 29 12:07:14 2022] GET /identity/v3/users/06533d70196747b697431af8a9794673 => generated 247 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:14.537875 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b150662-f214-48d7-b698-308a014aa5c1 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:14.538350 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b150662-f214-48d7-b698-308a014aa5c1 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:14.538783 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b150662-f214-48d7-b698-308a014aa5c1 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:14.540603 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 16/31] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:07:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:14.541504 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b150662-f214-48d7-b698-308a014aa5c1 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:14.587535 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:14.618634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 16/32] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:14.620142 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e6a7b-e0b5-4092-8c33-50e1144618b6 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:14.620508 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e6a7b-e0b5-4092-8c33-50e1144618b6 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:14.620857 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e6a7b-e0b5-4092-8c33-50e1144618b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:14.658916 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-dd9e6a7b-e0b5-4092-8c33-50e1144618b6 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:14.660423 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-dd9e6a7b-e0b5-4092-8c33-50e1144618b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:14.672683 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b150662-f214-48d7-b698-308a014aa5c1 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:14.716985 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335ae3d-2745-491a-9cdc-1cb0bb8f05d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:14.718415 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335ae3d-2745-491a-9cdc-1cb0bb8f05d0 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:14.719008 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335ae3d-2745-491a-9cdc-1cb0bb8f05d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:14.719447 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335ae3d-2745-491a-9cdc-1cb0bb8f05d0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:14.721336 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8335ae3d-2745-491a-9cdc-1cb0bb8f05d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:14.723244 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8335ae3d-2745-491a-9cdc-1cb0bb8f05d0 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:14.726714 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 17/33] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:14.727821 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335ae3d-2745-491a-9cdc-1cb0bb8f05d0 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:14.758186 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:14.768369 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 17/34] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:14.770084 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e6a7b-e0b5-4092-8c33-50e1144618b6 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:14.860215 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335ae3d-2745-491a-9cdc-1cb0bb8f05d0 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:14.865258 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:14.895504 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e6a7b-e0b5-4092-8c33-50e1144618b6 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:14.907763 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5ebef-77ea-49bd-98d7-bdd054cad2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:14.909238 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5ebef-77ea-49bd-98d7-bdd054cad2fb None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:14.909988 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5ebef-77ea-49bd-98d7-bdd054cad2fb None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:14.910352 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5ebef-77ea-49bd-98d7-bdd054cad2fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:14.924386 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f5ebef-77ea-49bd-98d7-bdd054cad2fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:14.926044 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f5ebef-77ea-49bd-98d7-bdd054cad2fb None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:14.938035 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457a40b-e6f3-4aa1-8c34-bcac38032ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:14.939452 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457a40b-e6f3-4aa1-8c34-bcac38032ad9 None admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:14.939909 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457a40b-e6f3-4aa1-8c34-bcac38032ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:14.940352 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457a40b-e6f3-4aa1-8c34-bcac38032ad9 None admin] PATH_INFO: `/v3/domains/default/users/06533d70196747b697431af8a9794673/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:14.943453 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9457a40b-e6f3-4aa1-8c34-bcac38032ad9 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=06533d70196747b697431af8a9794673, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:14.945351 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9457a40b-e6f3-4aa1-8c34-bcac38032ad9 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:14.947607 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-27f5ebef-77ea-49bd-98d7-bdd054cad2fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:14.947607 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:14.947607 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:14.947607 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:14.947607 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:14.947607 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:14.947607 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:14.947607 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:14.947607 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:14.947607 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:14.947607 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:14.947607 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:14.947607 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:07:14.947607 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:07:14.947607 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:07:14.948387 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:07:14.948387 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:14.948387 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:14.948387 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:14.948387 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:14.948387 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:14.948387 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:14.948387 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:14.948387 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:14.948387 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:14.948387 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:14.948387 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:14.948387 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:14.948387 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:14.948387 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:14.948387 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:14.948387 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:14.949181 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:07:14.949181 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:07:14.949181 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:07:14.949181 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:07:14.949181 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 18/35] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:14.950732 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5ebef-77ea-49bd-98d7-bdd054cad2fb None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:14.972529 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 18/36] 10.222.0.27 () {58 vars in 1361 bytes} [Wed Jun 29 12:07:14 2022] PUT /identity/v3/domains/default/users/06533d70196747b697431af8a9794673/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:07:14.973812 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457a40b-e6f3-4aa1-8c34-bcac38032ad9 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:15.046082 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:15.105309 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457a40b-e6f3-4aa1-8c34-bcac38032ad9 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:15.146187 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2fcc5-b459-4c76-bcc2-e315e1cab1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:15.147418 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2fcc5-b459-4c76-bcc2-e315e1cab1df None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:15.147884 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2fcc5-b459-4c76-bcc2-e315e1cab1df None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:15.148321 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2fcc5-b459-4c76-bcc2-e315e1cab1df None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:15.149568 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e2fcc5-b459-4c76-bcc2-e315e1cab1df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:15.150143 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e2fcc5-b459-4c76-bcc2-e315e1cab1df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:15.152957 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e2fcc5-b459-4c76-bcc2-e315e1cab1df None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:15.176700 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 19/37] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:07:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:15.183449 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2fcc5-b459-4c76-bcc2-e315e1cab1df None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:15.238806 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5ebef-77ea-49bd-98d7-bdd054cad2fb None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:15.279310 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd660be-b5f4-42eb-b46b-750f1f4bb3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:15.280123 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd660be-b5f4-42eb-b46b-750f1f4bb3ee None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:15.280478 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd660be-b5f4-42eb-b46b-750f1f4bb3ee None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:15.280818 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd660be-b5f4-42eb-b46b-750f1f4bb3ee None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:15.281704 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd660be-b5f4-42eb-b46b-750f1f4bb3ee None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:15.283229 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd660be-b5f4-42eb-b46b-750f1f4bb3ee None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:15.411982 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 19/38] 10.222.0.27 () {60 vars in 1131 bytes} [Wed Jun 29 12:07:14 2022] POST /identity/v3/roles => generated 225 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:07:15.413795 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2e69d-0c9b-4647-abba-aaa92ed6a508 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:15.414186 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2e69d-0c9b-4647-abba-aaa92ed6a508 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:15.414534 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2e69d-0c9b-4647-abba-aaa92ed6a508 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:15.416087 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 20/39] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:07:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:15.421737 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7261acf-5fdb-4898-b6a4-34748bfaf7fe None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:15.422021 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7261acf-5fdb-4898-b6a4-34748bfaf7fe None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:15.422304 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7261acf-5fdb-4898-b6a4-34748bfaf7fe None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:15.424387 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 21/40] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:07:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:15.424978 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2fcc5-b459-4c76-bcc2-e315e1cab1df None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:15.425641 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06ef34-2613-43de-9a03-e22e42a3ffe8 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:15.426056 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06ef34-2613-43de-9a03-e22e42a3ffe8 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:15.426606 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06ef34-2613-43de-9a03-e22e42a3ffe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:15.445392 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-3a06ef34-2613-43de-9a03-e22e42a3ffe8 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:15.447053 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3a06ef34-2613-43de-9a03-e22e42a3ffe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:15.447874 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:15.460407 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:15.475499 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d1b4fd-8d2d-4d4a-a84a-d80172b095e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:15.476488 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1b4fd-8d2d-4d4a-a84a-d80172b095e0 None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:15.476784 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1b4fd-8d2d-4d4a-a84a-d80172b095e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:15.477063 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1b4fd-8d2d-4d4a-a84a-d80172b095e0 None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:15.478271 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d1b4fd-8d2d-4d4a-a84a-d80172b095e0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:15.479931 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d1b4fd-8d2d-4d4a-a84a-d80172b095e0 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:15.516534 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 20/41] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Jun 29 12:07:15 2022] POST /identity/v3/projects => generated 301 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:07:15.523612 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31547a8-9361-4c3b-a6bf-b273f386aacc None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:15.523999 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31547a8-9361-4c3b-a6bf-b273f386aacc None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:15.524292 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31547a8-9361-4c3b-a6bf-b273f386aacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:15.531617 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 22/42] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:15.556243 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a06ef34-2613-43de-9a03-e22e42a3ffe8 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:15.556581 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-a31547a8-9361-4c3b-a6bf-b273f386aacc None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:15.557930 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a31547a8-9361-4c3b-a6bf-b273f386aacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:15.641526 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 21/43] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:15.667352 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31547a8-9361-4c3b-a6bf-b273f386aacc None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:15.674373 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a06ef34-2613-43de-9a03-e22e42a3ffe8 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:15.802850 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:15.820790 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31547a8-9361-4c3b-a6bf-b273f386aacc None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:15.844430 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd0df4-a98a-4ff8-98b8-2eb2b58dab92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:15.845125 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd0df4-a98a-4ff8-98b8-2eb2b58dab92 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:15.845414 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd0df4-a98a-4ff8-98b8-2eb2b58dab92 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:15.845914 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd0df4-a98a-4ff8-98b8-2eb2b58dab92 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:15.846565 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdd0df4-a98a-4ff8-98b8-2eb2b58dab92 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:15.848318 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdd0df4-a98a-4ff8-98b8-2eb2b58dab92 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:15.864349 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 23/44] 10.222.0.27 () {60 vars in 1131 bytes} [Wed Jun 29 12:07:15 2022] POST /identity/v3/roles => generated 223 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:07:15.867349 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa571776-d2e5-46df-acef-3b453a471486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:15.868480 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa571776-d2e5-46df-acef-3b453a471486 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:15.868963 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa571776-d2e5-46df-acef-3b453a471486 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:15.869428 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa571776-d2e5-46df-acef-3b453a471486 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:15.871246 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa571776-d2e5-46df-acef-3b453a471486 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:15.873056 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa571776-d2e5-46df-acef-3b453a471486 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:15.875229 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 22/45] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:07:15.881827 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd0df4-a98a-4ff8-98b8-2eb2b58dab92 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:15.892192 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:15.996139 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd0df4-a98a-4ff8-98b8-2eb2b58dab92 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:16.038983 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f0d2f-4f7e-40e4-9425-9ea4c25ee984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:16.039648 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f0d2f-4f7e-40e4-9425-9ea4c25ee984 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:16.039930 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f0d2f-4f7e-40e4-9425-9ea4c25ee984 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:16.040208 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f0d2f-4f7e-40e4-9425-9ea4c25ee984 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:16.040955 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3f0d2f-4f7e-40e4-9425-9ea4c25ee984 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:16.042434 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3f0d2f-4f7e-40e4-9425-9ea4c25ee984 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:16.075401 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 24/46] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Jun 29 12:07:15 2022] POST /identity/v3/projects => generated 312 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:07:17.153973 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23465b-1a4b-47c7-ae55-bba248c26c38 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:17.154541 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23465b-1a4b-47c7-ae55-bba248c26c38 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:17.154541 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23465b-1a4b-47c7-ae55-bba248c26c38 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:17.155915 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 23/47] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:07:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:17.161585 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16ecff-66fa-4098-a0e4-840f5919e631 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:17.162080 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16ecff-66fa-4098-a0e4-840f5919e631 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:17.162321 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16ecff-66fa-4098-a0e4-840f5919e631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:17.181852 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-fd16ecff-66fa-4098-a0e4-840f5919e631 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:17.183086 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-fd16ecff-66fa-4098-a0e4-840f5919e631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:17.241684 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:17.257064 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 25/48] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:17.280922 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a23465b-1a4b-47c7-ae55-bba248c26c38 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:17.387564 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a23465b-1a4b-47c7-ae55-bba248c26c38 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:17.422774 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c75f95-c216-4a16-86db-c24544677137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:17.423575 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c75f95-c216-4a16-86db-c24544677137 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:17.423861 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c75f95-c216-4a16-86db-c24544677137 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:17.424138 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c75f95-c216-4a16-86db-c24544677137 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:17.434760 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c75f95-c216-4a16-86db-c24544677137 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:17.442392 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-38c75f95-c216-4a16-86db-c24544677137 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:07:17.442392 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:17.442392 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:17.442392 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:17.442392 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:17.442392 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:17.442392 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:17.442392 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:17.442392 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:17.442392 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:17.442392 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:17.442392 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:17.442392 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:17.442392 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:17.442392 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:17.442392 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:17.443250 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:17.443250 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:17.443250 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:17.443250 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:17.443250 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:17.443250 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:17.443250 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:17.443250 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:17.443250 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:17.443250 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:17.443250 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:17.443250 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:17.443250 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:17.443250 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:17.443250 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:17.443250 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:17.443998 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:17.443998 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:17.443998 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:17.443998 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:17.443998 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:17.443998 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:17.443998 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:17.443998 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:17.443998 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:17.443998 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:17.443998 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:07:17.443998 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:07:17.443998 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 24/49] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jun 29 12:07:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:17.450173 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd16ecff-66fa-4098-a0e4-840f5919e631 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:17.551668 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd16ecff-66fa-4098-a0e4-840f5919e631 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:17.587463 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f19745-69d4-48c7-9c1b-2e61f18f56fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:17.588134 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f19745-69d4-48c7-9c1b-2e61f18f56fe None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:17.588420 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f19745-69d4-48c7-9c1b-2e61f18f56fe None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:17.588694 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f19745-69d4-48c7-9c1b-2e61f18f56fe None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:17.589459 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f19745-69d4-48c7-9c1b-2e61f18f56fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:17.589801 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f19745-69d4-48c7-9c1b-2e61f18f56fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:17.591201 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f19745-69d4-48c7-9c1b-2e61f18f56fe None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:17.600200 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 26/50] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:07:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:17.606175 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c75f95-c216-4a16-86db-c24544677137 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:17.632741 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:17.717307 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c75f95-c216-4a16-86db-c24544677137 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:17.754106 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7347ad8-f2cd-4477-a791-37075261116c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:17.755551 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7347ad8-f2cd-4477-a791-37075261116c None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:17.755869 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7347ad8-f2cd-4477-a791-37075261116c None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:17.756122 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7347ad8-f2cd-4477-a791-37075261116c None admin] PATH_INFO: `/v3/users/06533d70196747b697431af8a9794673` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:17.757388 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7347ad8-f2cd-4477-a791-37075261116c None admin] RBAC: Authorizing `identity:get_user(user_id=06533d70196747b697431af8a9794673)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:17.758972 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7347ad8-f2cd-4477-a791-37075261116c None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:17.760611 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 25/51] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jun 29 12:07:17 2022] GET /identity/v3/users/06533d70196747b697431af8a9794673 => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:17.766280 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f19745-69d4-48c7-9c1b-2e61f18f56fe None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:17.822317 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:17.876585 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f19745-69d4-48c7-9c1b-2e61f18f56fe None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:17.913476 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8a8cdc-71c1-4998-9487-418ad6313586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:17.914288 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a8cdc-71c1-4998-9487-418ad6313586 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:17.914572 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a8cdc-71c1-4998-9487-418ad6313586 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:17.914840 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a8cdc-71c1-4998-9487-418ad6313586 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:17.916060 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8a8cdc-71c1-4998-9487-418ad6313586 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:17.917510 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8a8cdc-71c1-4998-9487-418ad6313586 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:17.919166 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 27/52] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:17.925172 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7347ad8-f2cd-4477-a791-37075261116c None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:18.022607 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:18.031848 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7347ad8-f2cd-4477-a791-37075261116c None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:18.069224 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a5adb-cd28-41fd-96e4-31d6405dcc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:18.069922 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a5adb-cd28-41fd-96e4-31d6405dcc35 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:18.070204 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a5adb-cd28-41fd-96e4-31d6405dcc35 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:18.070474 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a5adb-cd28-41fd-96e4-31d6405dcc35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:18.071313 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545a5adb-cd28-41fd-96e4-31d6405dcc35 None admin] RBAC: Adding query filter params (role.id=e0e69ac8a8bf4cc4baa6aa18f2fc9919, scope.domain.id=default, user.id=06533d70196747b697431af8a9794673) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:18.071625 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545a5adb-cd28-41fd-96e4-31d6405dcc35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:18.073071 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545a5adb-cd28-41fd-96e4-31d6405dcc35 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:18.079400 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 26/53] 10.222.0.27 () {56 vars in 1322 bytes} [Wed Jun 29 12:07:17 2022] GET /identity/v3/role_assignments?user.id=06533d70196747b697431af8a9794673&scope.domain.id=default&role.id=e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 530 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:07:18.095441 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b913d2c-d525-452f-8234-f502b69ad9d2 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:18.095686 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b913d2c-d525-452f-8234-f502b69ad9d2 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:18.095982 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b913d2c-d525-452f-8234-f502b69ad9d2 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:18.097397 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 28/54] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:07:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:18.103630 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc7100-dc9f-43d2-9474-b5ffc7e46f04 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:18.103923 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc7100-dc9f-43d2-9474-b5ffc7e46f04 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:18.104208 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc7100-dc9f-43d2-9474-b5ffc7e46f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:18.122811 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-c0bc7100-dc9f-43d2-9474-b5ffc7e46f04 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:18.124067 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-c0bc7100-dc9f-43d2-9474-b5ffc7e46f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:18.199412 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 27/55] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:18.223574 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b913d2c-d525-452f-8234-f502b69ad9d2 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:18.343832 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b913d2c-d525-452f-8234-f502b69ad9d2 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:18.361762 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:18.380470 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb232ae-b783-4cd0-a891-cd65aebe69a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:18.381371 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb232ae-b783-4cd0-a891-cd65aebe69a8 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:18.381653 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb232ae-b783-4cd0-a891-cd65aebe69a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:18.381962 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb232ae-b783-4cd0-a891-cd65aebe69a8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:18.383201 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb232ae-b783-4cd0-a891-cd65aebe69a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:18.384666 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb232ae-b783-4cd0-a891-cd65aebe69a8 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:18.386331 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 29/56] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:18.392183 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc7100-dc9f-43d2-9474-b5ffc7e46f04 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:18.480177 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:18.496623 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc7100-dc9f-43d2-9474-b5ffc7e46f04 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:18.530620 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e860aac-4c62-462a-9d06-ba4e1e150bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:18.531278 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e860aac-4c62-462a-9d06-ba4e1e150bb4 None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:18.531565 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e860aac-4c62-462a-9d06-ba4e1e150bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:18.531839 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e860aac-4c62-462a-9d06-ba4e1e150bb4 None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:18.532558 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e860aac-4c62-462a-9d06-ba4e1e150bb4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:18.534062 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e860aac-4c62-462a-9d06-ba4e1e150bb4 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:18.562257 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 28/57] 10.222.0.27 () {60 vars in 1140 bytes} [Wed Jun 29 12:07:18 2022] POST /identity/v3/projects => generated 298 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:07:20.650077 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff9909-78f6-49e0-b008-4fb7774dd5c7 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:20.650624 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff9909-78f6-49e0-b008-4fb7774dd5c7 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:20.650624 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff9909-78f6-49e0-b008-4fb7774dd5c7 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:20.651998 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 30/58] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:07:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:20.658284 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d4d87-f947-4042-89d4-8a3bc4299a6a None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:20.659044 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d4d87-f947-4042-89d4-8a3bc4299a6a None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:20.659245 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d4d87-f947-4042-89d4-8a3bc4299a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:20.678907 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-337d4d87-f947-4042-89d4-8a3bc4299a6a None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:20.680143 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-337d4d87-f947-4042-89d4-8a3bc4299a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:20.753525 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 29/59] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:20.778783 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff9909-78f6-49e0-b008-4fb7774dd5c7 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:20.909573 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff9909-78f6-49e0-b008-4fb7774dd5c7 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:20.948035 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b69816-6df6-44db-9112-d9855226d8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:20.948849 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b69816-6df6-44db-9112-d9855226d8cf None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:20.949128 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b69816-6df6-44db-9112-d9855226d8cf None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:20.949398 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b69816-6df6-44db-9112-d9855226d8cf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:20.951099 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b69816-6df6-44db-9112-d9855226d8cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:20.952562 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b69816-6df6-44db-9112-d9855226d8cf None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:20.954230 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 31/60] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:20.961917 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d4d87-f947-4042-89d4-8a3bc4299a6a None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:21.051166 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:21.097650 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d4d87-f947-4042-89d4-8a3bc4299a6a None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:21.137234 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c315c9f-3962-4bdf-8138-5d2b81d9b257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:21.137984 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c315c9f-3962-4bdf-8138-5d2b81d9b257 None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:21.138262 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c315c9f-3962-4bdf-8138-5d2b81d9b257 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:21.138540 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c315c9f-3962-4bdf-8138-5d2b81d9b257 None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:21.139284 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c315c9f-3962-4bdf-8138-5d2b81d9b257 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:21.140796 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c315c9f-3962-4bdf-8138-5d2b81d9b257 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:21.172502 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 30/61] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Jun 29 12:07:20 2022] POST /identity/v3/users => generated 275 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:07:24.617020 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2796006-75b9-4610-a764-9f3d67110e3d None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:24.617586 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2796006-75b9-4610-a764-9f3d67110e3d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:24.617586 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2796006-75b9-4610-a764-9f3d67110e3d None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:24.619001 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 32/62] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:07:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:24.625726 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787fceb-5537-40e4-8755-79189d9bfb5c None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:24.625726 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787fceb-5537-40e4-8755-79189d9bfb5c None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:24.625726 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787fceb-5537-40e4-8755-79189d9bfb5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:24.651326 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48ee42-2c35-4a11-b0d6-cac211df8738 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:24.651952 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48ee42-2c35-4a11-b0d6-cac211df8738 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:24.652429 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48ee42-2c35-4a11-b0d6-cac211df8738 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:24.652528 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-f787fceb-5537-40e4-8755-79189d9bfb5c None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:24.653790 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-f787fceb-5537-40e4-8755-79189d9bfb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:24.654382 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 33/63] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:07:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:07:24.655753 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244be0a9-e908-4296-a41f-3e8ebbf62b63 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:24.656235 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244be0a9-e908-4296-a41f-3e8ebbf62b63 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:24.656705 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244be0a9-e908-4296-a41f-3e8ebbf62b63 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:24.658196 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 34/64] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:07:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:24.663494 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1dc9e-02da-4f56-a4ac-990172cd5263 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:24.664035 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1dc9e-02da-4f56-a4ac-990172cd5263 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:24.664515 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1dc9e-02da-4f56-a4ac-990172cd5263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:24.681795 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-a1f1dc9e-02da-4f56-a4ac-990172cd5263 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:24.683170 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a1f1dc9e-02da-4f56-a4ac-990172cd5263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:24.733989 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 31/65] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:24.735907 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e2cab-5de4-4478-b4d0-2536379c7e5a None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:24.736629 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e2cab-5de4-4478-b4d0-2536379c7e5a None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:24.737172 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e2cab-5de4-4478-b4d0-2536379c7e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:24.742747 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:24.762441 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-f82e2cab-5de4-4478-b4d0-2536379c7e5a None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:24.763644 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-f82e2cab-5de4-4478-b4d0-2536379c7e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:24.770486 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 35/66] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 12:07:24.777714 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1dc9e-02da-4f56-a4ac-990172cd5263 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:24.845723 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:24.886534 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 32/67] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:24.888112 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82e2cab-5de4-4478-b4d0-2536379c7e5a None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:24.917357 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1dc9e-02da-4f56-a4ac-990172cd5263 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:24.964184 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2639a5c6-6f76-430c-a690-8c63fe3ca436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:24.965263 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639a5c6-6f76-430c-a690-8c63fe3ca436 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:24.965551 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639a5c6-6f76-430c-a690-8c63fe3ca436 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:24.966091 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639a5c6-6f76-430c-a690-8c63fe3ca436 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:24.980512 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2639a5c6-6f76-430c-a690-8c63fe3ca436 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:24.991217 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-2639a5c6-6f76-430c-a690-8c63fe3ca436 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 12:07:24.991217 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:24.991217 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:24.991217 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:24.991217 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:24.991217 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:24.991217 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:24.991217 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:24.991217 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:24.991217 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:24.991217 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:24.991217 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:24.991217 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:24.991217 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:24.991217 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:24.991217 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:24.992307 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:24.992307 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:24.992307 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:24.992307 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:24.992307 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:24.992307 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:24.992307 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:24.992307 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:24.992307 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:24.992307 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:24.992307 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:24.992307 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:24.992307 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:24.992307 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:24.992307 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:24.992307 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:24.993270 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:24.993270 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:24.993270 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:24.993270 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:24.993270 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:24.993270 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:24.993270 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:24.993270 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:24.993270 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:24.993270 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:24.993270 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 12:07:24.993270 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:07:24.997796 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 36/68] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jun 29 12:07:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:24.999236 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2639a5c6-6f76-430c-a690-8c63fe3ca436 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:25.015915 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82e2cab-5de4-4478-b4d0-2536379c7e5a None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:25.055724 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62455a47-4b83-4f40-816c-1bb19bbecbe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:25.056539 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62455a47-4b83-4f40-816c-1bb19bbecbe5 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:25.056823 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62455a47-4b83-4f40-816c-1bb19bbecbe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:25.057097 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62455a47-4b83-4f40-816c-1bb19bbecbe5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:25.059014 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:25.069055 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62455a47-4b83-4f40-816c-1bb19bbecbe5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:25.077139 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-62455a47-4b83-4f40-816c-1bb19bbecbe5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:07:25.077139 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:25.077139 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:25.077139 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:25.077139 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:25.077139 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:25.077139 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:25.077139 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:25.077139 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:25.077139 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:25.077139 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:25.077139 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:25.077139 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:25.077139 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:25.077139 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:25.077139 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:25.078029 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:25.078029 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:25.078029 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:25.078029 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:25.078029 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:25.078029 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:25.078029 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:25.078029 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:25.078029 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:25.078029 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:25.078029 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:25.078029 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:25.078029 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:25.078029 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:25.078029 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:25.078029 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:25.078828 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:25.078828 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:25.078828 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:25.078828 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:25.078828 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:25.078828 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:25.078828 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:25.078828 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:25.078828 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:25.078828 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:25.078828 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:07:25.078828 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:07:25.078828 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 33/69] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:07:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:25.080120 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62455a47-4b83-4f40-816c-1bb19bbecbe5 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:25.122669 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2639a5c6-6f76-430c-a690-8c63fe3ca436 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:25.128458 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:25.159451 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e8b851-001b-40f8-b506-26834bf80f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:25.160174 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8b851-001b-40f8-b506-26834bf80f4e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:25.160455 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8b851-001b-40f8-b506-26834bf80f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:25.160730 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8b851-001b-40f8-b506-26834bf80f4e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:25.171809 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e8b851-001b-40f8-b506-26834bf80f4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:25.180168 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-60e8b851-001b-40f8-b506-26834bf80f4e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:07:25.180168 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:25.180168 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:25.180168 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:25.180168 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:25.180168 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:25.180168 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:25.180168 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:25.180168 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:25.180168 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:25.180168 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:25.180168 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:25.180168 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:25.180168 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:25.180168 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:25.180168 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:25.181137 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:25.181137 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:25.181137 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:25.181137 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:25.181137 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:25.181137 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:25.181137 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:25.181137 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:25.181137 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:25.181137 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:25.181137 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:25.181137 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:25.181137 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:25.181137 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:25.181137 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:25.181137 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:25.186591 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:25.186591 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:25.186591 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:25.186591 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:25.186591 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:25.186591 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:25.186591 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:25.186591 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:25.186591 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:25.186591 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:25.186591 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:07:25.186591 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:07:25.186591 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 37/70] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jun 29 12:07:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:25.186591 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a22be-81ea-4499-ad71-d78a17100e85 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:25.187259 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a22be-81ea-4499-ad71-d78a17100e85 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:25.187259 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a22be-81ea-4499-ad71-d78a17100e85 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:25.187259 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 38/71] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:07:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:25.187259 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a22be-81ea-4499-ad71-d78a17100e85 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:25.188824 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62455a47-4b83-4f40-816c-1bb19bbecbe5 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:25.225825 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b835ef-f7dd-4d76-acda-553476c50e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:25.226520 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b835ef-f7dd-4d76-acda-553476c50e45 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:25.226808 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b835ef-f7dd-4d76-acda-553476c50e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:25.227088 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b835ef-f7dd-4d76-acda-553476c50e45 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:25.227870 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b835ef-f7dd-4d76-acda-553476c50e45 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:25.228181 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b835ef-f7dd-4d76-acda-553476c50e45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:25.229621 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b835ef-f7dd-4d76-acda-553476c50e45 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:25.238956 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 34/72] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jun 29 12:07:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:25.240521 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123b907-7a66-40ed-9d86-71e79051c1bc None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:25.240799 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123b907-7a66-40ed-9d86-71e79051c1bc None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:25.241078 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123b907-7a66-40ed-9d86-71e79051c1bc None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:25.242340 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 35/73] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:07:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:25.243042 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2123b907-7a66-40ed-9d86-71e79051c1bc None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:25.300733 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a22be-81ea-4499-ad71-d78a17100e85 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:25.303215 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:25.335375 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790d7f9f-72dd-442b-8e5c-55a1a23e2a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:25.336047 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d7f9f-72dd-442b-8e5c-55a1a23e2a93 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:25.336329 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d7f9f-72dd-442b-8e5c-55a1a23e2a93 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:25.336600 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d7f9f-72dd-442b-8e5c-55a1a23e2a93 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:25.337347 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790d7f9f-72dd-442b-8e5c-55a1a23e2a93 None admin] RBAC: Adding query filter params (name=member) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:25.337652 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790d7f9f-72dd-442b-8e5c-55a1a23e2a93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:25.339205 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790d7f9f-72dd-442b-8e5c-55a1a23e2a93 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:25.347288 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 39/74] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jun 29 12:07:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:25.348477 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f40cf-1de2-4cc6-a0be-58baea0fecb8 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:25.349416 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f40cf-1de2-4cc6-a0be-58baea0fecb8 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:25.349720 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f40cf-1de2-4cc6-a0be-58baea0fecb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:25.351104 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2123b907-7a66-40ed-9d86-71e79051c1bc None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:25.358931 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:25.365849 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-3d1f40cf-1de2-4cc6-a0be-58baea0fecb8 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:25.367066 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3d1f40cf-1de2-4cc6-a0be-58baea0fecb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:25.387595 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52a8826-9713-4944-967a-33cd591bbc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:25.388278 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a8826-9713-4944-967a-33cd591bbc26 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:25.388563 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a8826-9713-4944-967a-33cd591bbc26 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:25.388841 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a8826-9713-4944-967a-33cd591bbc26 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:25.389597 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52a8826-9713-4944-967a-33cd591bbc26 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:25.389936 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52a8826-9713-4944-967a-33cd591bbc26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:25.391341 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52a8826-9713-4944-967a-33cd591bbc26 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:25.399808 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 36/75] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:07:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:25.404413 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52a8826-9713-4944-967a-33cd591bbc26 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:25.440409 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 40/76] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:25.441846 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8bc5a-dbb4-4579-aa53-b2bab0748321 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:25.442137 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8bc5a-dbb4-4579-aa53-b2bab0748321 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:25.442510 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8bc5a-dbb4-4579-aa53-b2bab0748321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:25.458724 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-a9b8bc5a-dbb4-4579-aa53-b2bab0748321 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:25.459965 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a9b8bc5a-dbb4-4579-aa53-b2bab0748321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:25.513965 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52a8826-9713-4944-967a-33cd591bbc26 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:25.530567 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 41/77] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:25.537872 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8bc5a-dbb4-4579-aa53-b2bab0748321 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:25.547717 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f31ea2b-6e1c-43ae-b9e7-2eff2362c6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:25.548597 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31ea2b-6e1c-43ae-b9e7-2eff2362c6f8 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:25.548875 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31ea2b-6e1c-43ae-b9e7-2eff2362c6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:25.549143 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31ea2b-6e1c-43ae-b9e7-2eff2362c6f8 None admin] PATH_INFO: `/v3/users/444fe6680fcc4d189dc9e38aeebd3b11` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:25.564285 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f31ea2b-6e1c-43ae-b9e7-2eff2362c6f8 None admin] RBAC: Authorizing `identity:get_user(user_id=444fe6680fcc4d189dc9e38aeebd3b11)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:25.566057 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f31ea2b-6e1c-43ae-b9e7-2eff2362c6f8 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:25.567867 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 37/78] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jun 29 12:07:25 2022] GET /identity/v3/users/444fe6680fcc4d189dc9e38aeebd3b11 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:25.568724 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f31ea2b-6e1c-43ae-b9e7-2eff2362c6f8 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:25.569059 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:25.597293 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:25.652956 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8bc5a-dbb4-4579-aa53-b2bab0748321 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:25.684103 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f31ea2b-6e1c-43ae-b9e7-2eff2362c6f8 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:25.690614 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f893d-15a1-4575-a175-d648fe546712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:25.691714 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f893d-15a1-4575-a175-d648fe546712 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:25.691714 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f893d-15a1-4575-a175-d648fe546712 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:25.691968 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f893d-15a1-4575-a175-d648fe546712 None admin] PATH_INFO: `/v3/users/444fe6680fcc4d189dc9e38aeebd3b11` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:25.693312 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96f893d-15a1-4575-a175-d648fe546712 None admin] RBAC: Authorizing `identity:get_user(user_id=444fe6680fcc4d189dc9e38aeebd3b11)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:25.694855 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96f893d-15a1-4575-a175-d648fe546712 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:25.696542 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 42/79] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jun 29 12:07:25 2022] GET /identity/v3/users/444fe6680fcc4d189dc9e38aeebd3b11 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:25.697331 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f893d-15a1-4575-a175-d648fe546712 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:25.721222 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4676dc8-7089-41a8-89b9-c3f7ed1d2e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:25.722140 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4676dc8-7089-41a8-89b9-c3f7ed1d2e99 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:25.722425 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4676dc8-7089-41a8-89b9-c3f7ed1d2e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:25.722702 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4676dc8-7089-41a8-89b9-c3f7ed1d2e99 None admin] PATH_INFO: `/v3/users/06533d70196747b697431af8a9794673` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:25.724055 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4676dc8-7089-41a8-89b9-c3f7ed1d2e99 None admin] RBAC: Authorizing `identity:get_user(user_id=06533d70196747b697431af8a9794673)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:25.725716 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4676dc8-7089-41a8-89b9-c3f7ed1d2e99 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:25.727398 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 38/80] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jun 29 12:07:25 2022] GET /identity/v3/users/06533d70196747b697431af8a9794673 => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:25.728163 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4676dc8-7089-41a8-89b9-c3f7ed1d2e99 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:25.794160 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:25.802310 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f893d-15a1-4575-a175-d648fe546712 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:25.822183 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:25.829715 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4676dc8-7089-41a8-89b9-c3f7ed1d2e99 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:25.838171 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d41fb5f-6d74-48a3-8527-71b862702051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:25.838977 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41fb5f-6d74-48a3-8527-71b862702051 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:25.839268 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41fb5f-6d74-48a3-8527-71b862702051 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:25.839546 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41fb5f-6d74-48a3-8527-71b862702051 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:25.850038 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d41fb5f-6d74-48a3-8527-71b862702051 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:25.857771 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-5d41fb5f-6d74-48a3-8527-71b862702051 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:07:25.857771 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:25.857771 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:25.857771 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:25.857771 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:25.857771 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:25.857771 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:25.857771 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:25.857771 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:25.857771 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:25.857771 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:25.857771 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:25.857771 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:25.857771 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:25.857771 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:25.857771 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:25.858636 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:25.858636 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:25.858636 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:25.858636 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:25.858636 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:25.858636 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:25.858636 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:25.858636 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:25.858636 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:25.858636 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:25.858636 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:25.858636 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:25.858636 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:25.858636 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:25.858636 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:25.858636 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:25.859484 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:25.859484 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:25.859484 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:25.859484 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:25.859484 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:25.859484 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:25.859484 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:25.859484 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:25.859484 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:25.859484 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:25.859484 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:07:25.859484 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:07:25.859484 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 43/81] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:07:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:25.860114 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d41fb5f-6d74-48a3-8527-71b862702051 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:25.866473 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773a22fa-8ddd-4534-8d85-fc3ecac38098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:25.867280 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a22fa-8ddd-4534-8d85-fc3ecac38098 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:25.867594 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a22fa-8ddd-4534-8d85-fc3ecac38098 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:25.867840 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a22fa-8ddd-4534-8d85-fc3ecac38098 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:25.869082 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773a22fa-8ddd-4534-8d85-fc3ecac38098 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:25.870982 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773a22fa-8ddd-4534-8d85-fc3ecac38098 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:25.873293 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 39/82] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:25.877952 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773a22fa-8ddd-4534-8d85-fc3ecac38098 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:25.961346 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d41fb5f-6d74-48a3-8527-71b862702051 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:25.980558 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773a22fa-8ddd-4534-8d85-fc3ecac38098 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:25.995010 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e54f7-4906-4722-b768-f5f530597c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:25.995657 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e54f7-4906-4722-b768-f5f530597c4a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:25.995942 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e54f7-4906-4722-b768-f5f530597c4a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:25.996202 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e54f7-4906-4722-b768-f5f530597c4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:26.015487 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaab550-25e2-4404-b830-c03ca3cf679d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:26.016152 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaab550-25e2-4404-b830-c03ca3cf679d None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:26.016444 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaab550-25e2-4404-b830-c03ca3cf679d None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:26.016726 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaab550-25e2-4404-b830-c03ca3cf679d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:26.021469 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:26.051145 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:26.065531 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1e54f7-4906-4722-b768-f5f530597c4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:26.067067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1e54f7-4906-4722-b768-f5f530597c4a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:26.090267 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaab550-25e2-4404-b830-c03ca3cf679d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:26.091760 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaab550-25e2-4404-b830-c03ca3cf679d None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:26.165815 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 44/83] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:07:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:07:26.166769 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e54f7-4906-4722-b768-f5f530597c4a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:26.192029 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 40/84] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:07:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:07:26.192883 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaab550-25e2-4404-b830-c03ca3cf679d None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:26.223164 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:26.259051 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:26.268991 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e54f7-4906-4722-b768-f5f530597c4a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:26.299152 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaab550-25e2-4404-b830-c03ca3cf679d None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:26.303269 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf702716-646d-4cf4-9b2d-0f8e3d0ecd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:26.303922 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf702716-646d-4cf4-9b2d-0f8e3d0ecd5e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:26.304206 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf702716-646d-4cf4-9b2d-0f8e3d0ecd5e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:26.304480 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf702716-646d-4cf4-9b2d-0f8e3d0ecd5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:26.333613 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db228d-8987-4402-bb62-1c90a9cf9938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:26.334394 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db228d-8987-4402-bb62-1c90a9cf9938 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:26.334685 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db228d-8987-4402-bb62-1c90a9cf9938 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:26.334974 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db228d-8987-4402-bb62-1c90a9cf9938 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:26.335733 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56db228d-8987-4402-bb62-1c90a9cf9938 None admin] RBAC: Adding query filter params (name=member) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:26.336045 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56db228d-8987-4402-bb62-1c90a9cf9938 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:26.337455 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56db228d-8987-4402-bb62-1c90a9cf9938 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:26.345707 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 41/85] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jun 29 12:07:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:26.346506 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db228d-8987-4402-bb62-1c90a9cf9938 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:26.377284 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf702716-646d-4cf4-9b2d-0f8e3d0ecd5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:26.378905 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf702716-646d-4cf4-9b2d-0f8e3d0ecd5e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:26.433813 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:26.446679 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db228d-8987-4402-bb62-1c90a9cf9938 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:26.470523 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:26.480671 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 45/86] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:07:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:07:26.482610 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf702716-646d-4cf4-9b2d-0f8e3d0ecd5e None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:26.482850 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b0505-cf03-4859-aa0e-e9e80cccab53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:26.483537 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b0505-cf03-4859-aa0e-e9e80cccab53 None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:26.483821 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b0505-cf03-4859-aa0e-e9e80cccab53 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:26.484094 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b0505-cf03-4859-aa0e-e9e80cccab53 None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:26.484806 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186b0505-cf03-4859-aa0e-e9e80cccab53 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:26.486312 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186b0505-cf03-4859-aa0e-e9e80cccab53 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:26.507713 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 42/87] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Jun 29 12:07:26 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:07:26.508526 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b0505-cf03-4859-aa0e-e9e80cccab53 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:26.594896 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf702716-646d-4cf4-9b2d-0f8e3d0ecd5e None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:26.621369 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b0505-cf03-4859-aa0e-e9e80cccab53 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:26.636428 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700b17af-d11d-4c61-be21-a247bd9b4d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:26.637680 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b17af-d11d-4c61-be21-a247bd9b4d3a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:26.638047 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b17af-d11d-4c61-be21-a247bd9b4d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:26.638352 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b17af-d11d-4c61-be21-a247bd9b4d3a None admin] PATH_INFO: `/v3/projects/dcc3d4b81e0d470bab2492f8eb193665` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:26.639693 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700b17af-d11d-4c61-be21-a247bd9b4d3a None admin] RBAC: Authorizing `identity:get_project(project_id=dcc3d4b81e0d470bab2492f8eb193665)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:26.641168 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700b17af-d11d-4c61-be21-a247bd9b4d3a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:26.647901 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 46/88] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jun 29 12:07:26 2022] GET /identity/v3/projects/dcc3d4b81e0d470bab2492f8eb193665 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:26.647901 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700b17af-d11d-4c61-be21-a247bd9b4d3a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:26.666794 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7c1fb-e5b1-4054-b50e-76b7580e5841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:26.667683 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7c1fb-e5b1-4054-b50e-76b7580e5841 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:26.667966 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7c1fb-e5b1-4054-b50e-76b7580e5841 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:26.668241 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7c1fb-e5b1-4054-b50e-76b7580e5841 None admin] PATH_INFO: `/v3/projects/dcc3d4b81e0d470bab2492f8eb193665` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:26.669497 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de7c1fb-e5b1-4054-b50e-76b7580e5841 None admin] RBAC: Authorizing `identity:get_project(project_id=dcc3d4b81e0d470bab2492f8eb193665)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:26.672374 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de7c1fb-e5b1-4054-b50e-76b7580e5841 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:26.673059 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 43/89] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jun 29 12:07:26 2022] GET /identity/v3/projects/dcc3d4b81e0d470bab2492f8eb193665 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:26.673160 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:26.673601 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7c1fb-e5b1-4054-b50e-76b7580e5841 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:26.732270 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:26.767569 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700b17af-d11d-4c61-be21-a247bd9b4d3a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:26.796973 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7c1fb-e5b1-4054-b50e-76b7580e5841 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:26.822888 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b881b-7ab4-4fdc-8226-bf64d4e024a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:26.823837 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b881b-7ab4-4fdc-8226-bf64d4e024a8 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:26.824119 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b881b-7ab4-4fdc-8226-bf64d4e024a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:26.824393 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b881b-7ab4-4fdc-8226-bf64d4e024a8 None admin] PATH_INFO: `/v3/users/444fe6680fcc4d189dc9e38aeebd3b11` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:26.826124 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758b881b-7ab4-4fdc-8226-bf64d4e024a8 None admin] RBAC: Authorizing `identity:get_user(user_id=444fe6680fcc4d189dc9e38aeebd3b11)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:26.827597 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758b881b-7ab4-4fdc-8226-bf64d4e024a8 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:26.829425 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 47/90] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jun 29 12:07:26 2022] GET /identity/v3/users/444fe6680fcc4d189dc9e38aeebd3b11 => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:26.830088 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b881b-7ab4-4fdc-8226-bf64d4e024a8 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:26.841516 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2872c35-bd37-4efc-87f2-623457329a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:26.842596 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2872c35-bd37-4efc-87f2-623457329a93 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:26.842888 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2872c35-bd37-4efc-87f2-623457329a93 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:26.843168 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2872c35-bd37-4efc-87f2-623457329a93 None admin] PATH_INFO: `/v3/projects/dcc3d4b81e0d470bab2492f8eb193665` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:26.844360 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2872c35-bd37-4efc-87f2-623457329a93 None admin] RBAC: Authorizing `identity:get_project(project_id=dcc3d4b81e0d470bab2492f8eb193665)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:26.846713 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2872c35-bd37-4efc-87f2-623457329a93 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:26.847840 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 44/91] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jun 29 12:07:26 2022] GET /identity/v3/projects/dcc3d4b81e0d470bab2492f8eb193665 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:26.849876 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2872c35-bd37-4efc-87f2-623457329a93 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:26.958461 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:26.968040 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b881b-7ab4-4fdc-8226-bf64d4e024a8 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:26.982385 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2872c35-bd37-4efc-87f2-623457329a93 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:27.004893 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:27.005078 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d33245-6369-4fb3-9830-a1333dcbb5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:27.005937 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d33245-6369-4fb3-9830-a1333dcbb5e4 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:27.006303 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d33245-6369-4fb3-9830-a1333dcbb5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:27.006512 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d33245-6369-4fb3-9830-a1333dcbb5e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:27.010031 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d33245-6369-4fb3-9830-a1333dcbb5e4 None admin] RBAC: Adding query filter params (role.id=ea54879a52d24a47bada5629b6d8b456, scope.project.id=dcc3d4b81e0d470bab2492f8eb193665, user.id=444fe6680fcc4d189dc9e38aeebd3b11) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:27.010031 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d33245-6369-4fb3-9830-a1333dcbb5e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:27.010031 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d33245-6369-4fb3-9830-a1333dcbb5e4 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:27.025131 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 48/92] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jun 29 12:07:26 2022] GET /identity/v3/role_assignments?user.id=444fe6680fcc4d189dc9e38aeebd3b11&scope.project.id=dcc3d4b81e0d470bab2492f8eb193665&role.id=ea54879a52d24a47bada5629b6d8b456 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:27.026212 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d33245-6369-4fb3-9830-a1333dcbb5e4 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:27.030996 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bec089-2a7c-4bc6-a0e0-e4a9c79fe358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:27.033296 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bec089-2a7c-4bc6-a0e0-e4a9c79fe358 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:27.033589 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bec089-2a7c-4bc6-a0e0-e4a9c79fe358 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:27.033910 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bec089-2a7c-4bc6-a0e0-e4a9c79fe358 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:27.034885 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bec089-2a7c-4bc6-a0e0-e4a9c79fe358 None admin] RBAC: Adding query filter params (role.id=c49accbc6f81447cb221ef720db04ced, scope.project.id=dcc3d4b81e0d470bab2492f8eb193665, user.id=444fe6680fcc4d189dc9e38aeebd3b11) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:27.035207 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bec089-2a7c-4bc6-a0e0-e4a9c79fe358 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:27.042735 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bec089-2a7c-4bc6-a0e0-e4a9c79fe358 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:27.057728 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 45/93] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jun 29 12:07:26 2022] GET /identity/v3/role_assignments?user.id=444fe6680fcc4d189dc9e38aeebd3b11&scope.project.id=dcc3d4b81e0d470bab2492f8eb193665&role.id=c49accbc6f81447cb221ef720db04ced => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:27.057728 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bec089-2a7c-4bc6-a0e0-e4a9c79fe358 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:27.195909 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bec089-2a7c-4bc6-a0e0-e4a9c79fe358 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:27.235093 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaffc3d-5b52-45d0-9a21-6091d814effa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:27.235712 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaffc3d-5b52-45d0-9a21-6091d814effa None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:27.235997 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaffc3d-5b52-45d0-9a21-6091d814effa None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:27.236274 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaffc3d-5b52-45d0-9a21-6091d814effa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:27.237122 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaffc3d-5b52-45d0-9a21-6091d814effa None admin] RBAC: Adding query filter params (role.id=e0e69ac8a8bf4cc4baa6aa18f2fc9919, scope.project.id=dcc3d4b81e0d470bab2492f8eb193665, user.id=06533d70196747b697431af8a9794673) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:27.237440 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaffc3d-5b52-45d0-9a21-6091d814effa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:27.238979 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaffc3d-5b52-45d0-9a21-6091d814effa None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:27.246428 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 46/94] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jun 29 12:07:27 2022] GET /identity/v3/role_assignments?user.id=06533d70196747b697431af8a9794673&scope.project.id=dcc3d4b81e0d470bab2492f8eb193665&role.id=e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:27.283188 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d33245-6369-4fb3-9830-a1333dcbb5e4 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:27.332151 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19610a9d-9677-4957-8e4e-12a86592c367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:27.334074 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19610a9d-9677-4957-8e4e-12a86592c367 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:27.334630 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19610a9d-9677-4957-8e4e-12a86592c367 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:27.335102 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19610a9d-9677-4957-8e4e-12a86592c367 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:27.370188 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:27.432458 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19610a9d-9677-4957-8e4e-12a86592c367 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:27.434201 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19610a9d-9677-4957-8e4e-12a86592c367 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:27.625167 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 49/95] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:07:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:07:27.634919 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaffc3d-5b52-45d0-9a21-6091d814effa None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:27.710119 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:27.782388 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaffc3d-5b52-45d0-9a21-6091d814effa None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:27.832175 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e457535-ace3-4736-b5cb-6d8096c7a8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:27.833209 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e457535-ace3-4736-b5cb-6d8096c7a8ef None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:27.833495 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e457535-ace3-4736-b5cb-6d8096c7a8ef None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:27.838153 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e457535-ace3-4736-b5cb-6d8096c7a8ef None admin] PATH_INFO: `/v3/projects/b45ca34b972a47058b9236bb66ea7a42` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:27.839428 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e457535-ace3-4736-b5cb-6d8096c7a8ef None admin] RBAC: Authorizing `identity:get_project(project_id=b45ca34b972a47058b9236bb66ea7a42)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:27.840900 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e457535-ace3-4736-b5cb-6d8096c7a8ef None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:27.842652 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 47/96] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jun 29 12:07:27 2022] GET /identity/v3/projects/b45ca34b972a47058b9236bb66ea7a42 => generated 312 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:27.848524 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19610a9d-9677-4957-8e4e-12a86592c367 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:27.924976 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:27.989647 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19610a9d-9677-4957-8e4e-12a86592c367 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:28.033634 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9da4f-fd74-4da1-b7b8-a8788d0ecc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:28.034328 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9da4f-fd74-4da1-b7b8-a8788d0ecc0a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:28.034608 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9da4f-fd74-4da1-b7b8-a8788d0ecc0a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:28.034883 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9da4f-fd74-4da1-b7b8-a8788d0ecc0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:28.035737 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a9da4f-fd74-4da1-b7b8-a8788d0ecc0a None admin] RBAC: Adding query filter params (role.id=c49accbc6f81447cb221ef720db04ced, scope.project.id=b45ca34b972a47058b9236bb66ea7a42, user.id=444fe6680fcc4d189dc9e38aeebd3b11) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:28.036095 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a9da4f-fd74-4da1-b7b8-a8788d0ecc0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:28.037802 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a9da4f-fd74-4da1-b7b8-a8788d0ecc0a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:28.050325 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 50/97] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jun 29 12:07:27 2022] GET /identity/v3/role_assignments?user.id=444fe6680fcc4d189dc9e38aeebd3b11&scope.project.id=b45ca34b972a47058b9236bb66ea7a42&role.id=c49accbc6f81447cb221ef720db04ced => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:29.548172 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de0f70-398f-47a4-8247-12d7944ca3cb None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:29.549194 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de0f70-398f-47a4-8247-12d7944ca3cb None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:29.549672 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de0f70-398f-47a4-8247-12d7944ca3cb None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:29.551292 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 48/98] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:07:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:29.557402 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f02e11-f516-4207-b387-9278069cd8e0 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:29.558310 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f02e11-f516-4207-b387-9278069cd8e0 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:29.558794 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f02e11-f516-4207-b387-9278069cd8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:29.580391 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f7f02e11-f516-4207-b387-9278069cd8e0 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:29.581906 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f7f02e11-f516-4207-b387-9278069cd8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:29.676208 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 51/99] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:29.713340 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de0f70-398f-47a4-8247-12d7944ca3cb None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:29.819263 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510ea9d-6244-4c7b-89cc-d299a7a1e8cc None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:29.819903 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510ea9d-6244-4c7b-89cc-d299a7a1e8cc None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:29.820372 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510ea9d-6244-4c7b-89cc-d299a7a1e8cc None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:29.822025 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 52/100] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:07:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:29.827714 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66c1b2-f0c9-4f26-8c16-76a3f727637c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:29.828236 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66c1b2-f0c9-4f26-8c16-76a3f727637c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:29.828698 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66c1b2-f0c9-4f26-8c16-76a3f727637c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:29.857591 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-9e66c1b2-f0c9-4f26-8c16-76a3f727637c None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:29.859082 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de0f70-398f-47a4-8247-12d7944ca3cb None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:29.862228 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9e66c1b2-f0c9-4f26-8c16-76a3f727637c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:29.884625 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:29.924614 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67e571a-b89f-4b94-b0fe-e9b1e4af55fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:29.925433 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e571a-b89f-4b94-b0fe-e9b1e4af55fe None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:29.925735 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e571a-b89f-4b94-b0fe-e9b1e4af55fe None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:29.926013 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e571a-b89f-4b94-b0fe-e9b1e4af55fe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:29.946646 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:29.950836 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67e571a-b89f-4b94-b0fe-e9b1e4af55fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:29.961470 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-f67e571a-b89f-4b94-b0fe-e9b1e4af55fe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 12:07:29.961470 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:29.961470 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:29.961470 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:29.961470 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:29.961470 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:29.961470 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:29.961470 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:29.961470 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:29.961470 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:29.961470 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:29.961470 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:29.961470 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:29.961470 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:29.961470 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:29.961470 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:29.962423 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:29.962423 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:29.962423 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:29.962423 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:29.962423 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:29.962423 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:29.962423 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:29.962423 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:29.962423 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:29.962423 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:29.962423 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:29.962423 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:29.962423 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:29.962423 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:29.962423 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:29.962423 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:29.963189 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:29.963189 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:29.963189 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:29.963189 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:29.963189 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:29.963189 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:29.963189 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:29.963189 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:29.963189 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:29.963189 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:29.963189 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 12:07:29.963189 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:07:29.963785 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 49/101] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:07:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:29.975036 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67e571a-b89f-4b94-b0fe-e9b1e4af55fe None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:29.998392 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 53/102] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 12:07:30.057246 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66c1b2-f0c9-4f26-8c16-76a3f727637c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:30.171826 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67e571a-b89f-4b94-b0fe-e9b1e4af55fe None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:30.231108 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66c1b2-f0c9-4f26-8c16-76a3f727637c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:30.236621 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf195a-c1c8-42d2-b4ad-36becf597ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:30.237315 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf195a-c1c8-42d2-b4ad-36becf597ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:30.237642 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf195a-c1c8-42d2-b4ad-36becf597ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:30.237941 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf195a-c1c8-42d2-b4ad-36becf597ec1 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:30.238705 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edf195a-c1c8-42d2-b4ad-36becf597ec1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:30.239012 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edf195a-c1c8-42d2-b4ad-36becf597ec1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:30.241072 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edf195a-c1c8-42d2-b4ad-36becf597ec1 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:30.258177 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 50/103] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jun 29 12:07:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:30.259530 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee7b07-662c-4797-b392-fd5ff0843f2a None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:30.259817 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee7b07-662c-4797-b392-fd5ff0843f2a None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:30.260094 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee7b07-662c-4797-b392-fd5ff0843f2a None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:30.264168 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 51/104] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:07:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:30.265783 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee7b07-662c-4797-b392-fd5ff0843f2a None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:30.291856 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705eb204-7cbd-484c-bd85-325fadcec3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:30.292907 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705eb204-7cbd-484c-bd85-325fadcec3ee None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:30.293325 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705eb204-7cbd-484c-bd85-325fadcec3ee None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:30.294205 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705eb204-7cbd-484c-bd85-325fadcec3ee None admin] PATH_INFO: `/v3/domains/default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:30.295763 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705eb204-7cbd-484c-bd85-325fadcec3ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:30.298144 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705eb204-7cbd-484c-bd85-325fadcec3ee None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:30.300407 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 54/105] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:30.302011 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a669d2-8f30-4402-8b20-eb9613f705be None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:30.303157 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a669d2-8f30-4402-8b20-eb9613f705be None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:30.303576 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a669d2-8f30-4402-8b20-eb9613f705be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:30.314081 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:30.324968 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c9a669d2-8f30-4402-8b20-eb9613f705be None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:30.327406 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c9a669d2-8f30-4402-8b20-eb9613f705be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:30.388882 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee7b07-662c-4797-b392-fd5ff0843f2a None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:30.393449 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:30.428277 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27177da6-62ef-40ab-a921-6e41363ab264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:30.428480 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 55/106] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:30.429664 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27177da6-62ef-40ab-a921-6e41363ab264 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:30.429908 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d02903-0188-4ae6-bf64-b2060e3ee3aa None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:30.430200 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d02903-0188-4ae6-bf64-b2060e3ee3aa None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:30.430478 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d02903-0188-4ae6-bf64-b2060e3ee3aa None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:30.430747 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27177da6-62ef-40ab-a921-6e41363ab264 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:30.431201 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27177da6-62ef-40ab-a921-6e41363ab264 None admin] PATH_INFO: `/v3/users/d15f02999f7c45cebd53d64fa8f390d2` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:30.431812 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 56/107] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:07:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:30.432489 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d02903-0188-4ae6-bf64-b2060e3ee3aa None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:30.450624 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27177da6-62ef-40ab-a921-6e41363ab264 None admin] RBAC: Authorizing `identity:get_user(user_id=d15f02999f7c45cebd53d64fa8f390d2)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:30.452591 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27177da6-62ef-40ab-a921-6e41363ab264 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:30.454650 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 52/108] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jun 29 12:07:30 2022] GET /identity/v3/users/d15f02999f7c45cebd53d64fa8f390d2 => generated 289 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:30.456287 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30b525-a137-4b6e-a1f2-dc4177b8c324 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:30.456761 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30b525-a137-4b6e-a1f2-dc4177b8c324 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:30.457224 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30b525-a137-4b6e-a1f2-dc4177b8c324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:30.480687 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-1e30b525-a137-4b6e-a1f2-dc4177b8c324 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:30.482346 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-1e30b525-a137-4b6e-a1f2-dc4177b8c324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:30.556599 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 53/109] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:30.558414 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e30b525-a137-4b6e-a1f2-dc4177b8c324 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:30.592512 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:30.599192 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d02903-0188-4ae6-bf64-b2060e3ee3aa None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:30.636164 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb82e868-5a2c-4438-97e7-5ecf159accc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:30.637221 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82e868-5a2c-4438-97e7-5ecf159accc0 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:30.637710 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82e868-5a2c-4438-97e7-5ecf159accc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:30.638197 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82e868-5a2c-4438-97e7-5ecf159accc0 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:30.639097 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb82e868-5a2c-4438-97e7-5ecf159accc0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:30.640874 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb82e868-5a2c-4438-97e7-5ecf159accc0 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:30.667185 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 57/110] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Jun 29 12:07:30 2022] POST /identity/v3/projects => generated 302 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:07:30.670836 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb82e868-5a2c-4438-97e7-5ecf159accc0 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:30.689939 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e30b525-a137-4b6e-a1f2-dc4177b8c324 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:30.713176 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:30.732102 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af1bb15-75e3-4983-9b03-bb6d7dbb0f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:30.732564 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1bb15-75e3-4983-9b03-bb6d7dbb0f9f None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:30.732849 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1bb15-75e3-4983-9b03-bb6d7dbb0f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:30.733123 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1bb15-75e3-4983-9b03-bb6d7dbb0f9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:30.801315 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb82e868-5a2c-4438-97e7-5ecf159accc0 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:30.808978 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af1bb15-75e3-4983-9b03-bb6d7dbb0f9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:30.810540 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af1bb15-75e3-4983-9b03-bb6d7dbb0f9f None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:30.837916 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:30.842312 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4aa11e-30a3-4fc8-9bd9-0dd5516a541a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:30.843777 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4aa11e-30a3-4fc8-9bd9-0dd5516a541a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:30.843777 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4aa11e-30a3-4fc8-9bd9-0dd5516a541a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:30.843777 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4aa11e-30a3-4fc8-9bd9-0dd5516a541a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:30.855137 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4aa11e-30a3-4fc8-9bd9-0dd5516a541a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:30.863728 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-ad4aa11e-30a3-4fc8-9bd9-0dd5516a541a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 12:07:30.863728 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:30.863728 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:30.863728 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:30.863728 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:30.863728 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:30.863728 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:30.863728 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:30.863728 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:30.863728 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:30.863728 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:30.863728 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:30.863728 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:30.863728 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:30.863728 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:30.863728 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:30.864695 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:30.864695 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:30.864695 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:30.864695 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:30.864695 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:30.864695 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:30.864695 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:30.864695 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:30.864695 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:30.864695 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:30.864695 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:30.864695 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:30.864695 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:30.864695 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:30.864695 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:30.864695 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:30.865790 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:30.865790 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:30.865790 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:30.865790 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:30.865790 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:30.865790 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:30.865790 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:30.865790 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:30.865790 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:30.865790 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:30.865790 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 12:07:30.865790 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:07:30.865790 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 58/111] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jun 29 12:07:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:30.866447 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4aa11e-30a3-4fc8-9bd9-0dd5516a541a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:30.928940 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 54/112] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:07:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:07:30.930335 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876d0a8-a178-45d6-8c05-d7b82aeb1be2 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:30.930628 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876d0a8-a178-45d6-8c05-d7b82aeb1be2 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:30.930905 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876d0a8-a178-45d6-8c05-d7b82aeb1be2 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:30.932364 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 55/113] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:07:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:30.933268 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8fc2a-1811-43f2-bfb9-1a908feb8ecb None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:30.933554 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8fc2a-1811-43f2-bfb9-1a908feb8ecb None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:30.933868 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8fc2a-1811-43f2-bfb9-1a908feb8ecb None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:30.935261 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 56/114] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:07:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:30.937729 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc8fc2a-1811-43f2-bfb9-1a908feb8ecb None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:30.967206 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:30.980513 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4aa11e-30a3-4fc8-9bd9-0dd5516a541a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:31.016897 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675048b9-aef3-43dc-8e46-17bc40ca21c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:31.017733 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675048b9-aef3-43dc-8e46-17bc40ca21c2 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:31.018027 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675048b9-aef3-43dc-8e46-17bc40ca21c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:31.018303 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675048b9-aef3-43dc-8e46-17bc40ca21c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:31.031776 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675048b9-aef3-43dc-8e46-17bc40ca21c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:31.040538 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-675048b9-aef3-43dc-8e46-17bc40ca21c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:07:31.040538 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:31.040538 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:31.040538 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:31.040538 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:31.040538 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:31.040538 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:31.040538 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:31.040538 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:31.040538 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:31.040538 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:31.040538 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:31.040538 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:31.040538 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:31.040538 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:31.040538 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:31.041405 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:31.041405 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:31.041405 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:31.041405 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:31.041405 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:31.041405 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:31.041405 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:31.041405 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:31.041405 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:31.041405 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:31.041405 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:31.041405 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:31.041405 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:31.041405 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:31.041405 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:31.041405 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:31.042209 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:31.042209 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:31.042209 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:31.042209 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:31.042209 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:31.042209 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:31.042209 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:31.042209 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:31.042209 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:31.042209 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:31.042209 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:07:31.042209 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:07:31.042209 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 59/115] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jun 29 12:07:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:31.042862 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675048b9-aef3-43dc-8e46-17bc40ca21c2 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:31.057405 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc8fc2a-1811-43f2-bfb9-1a908feb8ecb None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:31.081517 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:31.095315 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea232358-c00d-4215-81d4-b9a8f470e4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:31.096097 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea232358-c00d-4215-81d4-b9a8f470e4e7 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:31.096442 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea232358-c00d-4215-81d4-b9a8f470e4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:31.096787 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea232358-c00d-4215-81d4-b9a8f470e4e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:31.097622 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea232358-c00d-4215-81d4-b9a8f470e4e7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:31.098028 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea232358-c00d-4215-81d4-b9a8f470e4e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:31.099489 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea232358-c00d-4215-81d4-b9a8f470e4e7 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:31.109735 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 57/116] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jun 29 12:07:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:31.109880 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d99dde-13e8-45f0-8fa6-aa7b5322c500 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:31.110229 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d99dde-13e8-45f0-8fa6-aa7b5322c500 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:31.110402 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d99dde-13e8-45f0-8fa6-aa7b5322c500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:31.128779 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-f9d99dde-13e8-45f0-8fa6-aa7b5322c500 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:31.130116 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-f9d99dde-13e8-45f0-8fa6-aa7b5322c500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:31.156653 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675048b9-aef3-43dc-8e46-17bc40ca21c2 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:31.197065 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d115e995-c3b9-4bdb-b09e-6374e8535e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:31.198004 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115e995-c3b9-4bdb-b09e-6374e8535e5d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:31.198289 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115e995-c3b9-4bdb-b09e-6374e8535e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:31.198568 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115e995-c3b9-4bdb-b09e-6374e8535e5d None admin] PATH_INFO: `/v3/projects/dcc3d4b81e0d470bab2492f8eb193665` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:31.199829 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d115e995-c3b9-4bdb-b09e-6374e8535e5d None admin] RBAC: Authorizing `identity:get_project(project_id=dcc3d4b81e0d470bab2492f8eb193665)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:31.201668 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d115e995-c3b9-4bdb-b09e-6374e8535e5d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:31.208477 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 60/117] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jun 29 12:07:31 2022] GET /identity/v3/projects/dcc3d4b81e0d470bab2492f8eb193665 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:31.208477 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2340e7-1391-45a2-8f7f-e262ddc8eb27 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:31.208477 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2340e7-1391-45a2-8f7f-e262ddc8eb27 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:31.208477 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2340e7-1391-45a2-8f7f-e262ddc8eb27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:31.208915 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 58/118] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:31.208915 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d99dde-13e8-45f0-8fa6-aa7b5322c500 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:31.225289 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-9f2340e7-1391-45a2-8f7f-e262ddc8eb27 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:31.226462 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9f2340e7-1391-45a2-8f7f-e262ddc8eb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:31.238422 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:31.305721 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 61/119] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:31.305721 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2340e7-1391-45a2-8f7f-e262ddc8eb27 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:31.329280 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d99dde-13e8-45f0-8fa6-aa7b5322c500 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:31.345325 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:31.366466 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20db1bb-8662-48f0-b044-7a8517d4445a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:31.367143 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20db1bb-8662-48f0-b044-7a8517d4445a None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:31.367426 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20db1bb-8662-48f0-b044-7a8517d4445a None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:31.367696 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20db1bb-8662-48f0-b044-7a8517d4445a None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:31.368445 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20db1bb-8662-48f0-b044-7a8517d4445a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:31.368750 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20db1bb-8662-48f0-b044-7a8517d4445a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:31.370189 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20db1bb-8662-48f0-b044-7a8517d4445a None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:31.378851 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 59/120] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:07:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:31.379661 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20db1bb-8662-48f0-b044-7a8517d4445a None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:31.411914 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2340e7-1391-45a2-8f7f-e262ddc8eb27 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:31.449045 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5898077a-cae4-483c-9fb1-9fe26dddac2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:31.450117 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898077a-cae4-483c-9fb1-9fe26dddac2b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:31.450772 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898077a-cae4-483c-9fb1-9fe26dddac2b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:31.451045 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898077a-cae4-483c-9fb1-9fe26dddac2b None admin] PATH_INFO: `/v3/users/444fe6680fcc4d189dc9e38aeebd3b11` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:31.452311 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5898077a-cae4-483c-9fb1-9fe26dddac2b None admin] RBAC: Authorizing `identity:get_user(user_id=444fe6680fcc4d189dc9e38aeebd3b11)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:31.453892 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5898077a-cae4-483c-9fb1-9fe26dddac2b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:31.455773 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 62/121] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jun 29 12:07:31 2022] GET /identity/v3/users/444fe6680fcc4d189dc9e38aeebd3b11 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:31.460912 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5898077a-cae4-483c-9fb1-9fe26dddac2b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:31.476876 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:31.490557 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20db1bb-8662-48f0-b044-7a8517d4445a None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:31.526185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e150584-149d-47f7-8521-8ec23e0f7dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:31.527131 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e150584-149d-47f7-8521-8ec23e0f7dba None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:31.527600 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e150584-149d-47f7-8521-8ec23e0f7dba None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:31.527878 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e150584-149d-47f7-8521-8ec23e0f7dba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:31.528732 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e150584-149d-47f7-8521-8ec23e0f7dba None admin] RBAC: Adding query filter params (role.id=e2336723b86b456e95b87bce11e66e1c, scope.project.id=dcc3d4b81e0d470bab2492f8eb193665, user.id=d15f02999f7c45cebd53d64fa8f390d2) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:31.529049 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e150584-149d-47f7-8521-8ec23e0f7dba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:31.530538 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e150584-149d-47f7-8521-8ec23e0f7dba None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:31.535939 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 60/122] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jun 29 12:07:31 2022] GET /identity/v3/role_assignments?user.id=d15f02999f7c45cebd53d64fa8f390d2&scope.project.id=dcc3d4b81e0d470bab2492f8eb193665&role.id=e2336723b86b456e95b87bce11e66e1c => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:31.536787 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e150584-149d-47f7-8521-8ec23e0f7dba None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:31.582312 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5898077a-cae4-483c-9fb1-9fe26dddac2b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:31.595583 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:31.633725 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd720b6-e132-4558-befe-2cff534721d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:31.635312 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd720b6-e132-4558-befe-2cff534721d4 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:31.635778 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd720b6-e132-4558-befe-2cff534721d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:31.636258 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd720b6-e132-4558-befe-2cff534721d4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:31.655041 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd720b6-e132-4558-befe-2cff534721d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:31.666786 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-fbd720b6-e132-4558-befe-2cff534721d4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:07:31.666786 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:31.666786 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:31.666786 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:31.666786 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:31.666786 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:31.666786 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:31.666786 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:31.666786 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:31.666786 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:31.666786 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:31.666786 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:31.666786 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:31.666786 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:31.666786 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:31.666786 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:31.667797 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:31.667797 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:31.667797 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:31.667797 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:31.667797 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:31.667797 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:31.667797 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:31.667797 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:31.667797 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:31.667797 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:31.667797 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:31.667797 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:31.667797 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:31.667797 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:31.667797 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:31.667797 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:31.668561 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:31.668561 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:31.668561 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:31.668561 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:31.668561 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:31.668561 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:31.668561 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:31.668561 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:31.668561 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:31.668561 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:31.668561 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:07:31.668561 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:07:31.669133 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e150584-149d-47f7-8521-8ec23e0f7dba None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:31.672548 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 63/123] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:07:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:31.673713 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd720b6-e132-4558-befe-2cff534721d4 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:31.711240 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431a015-1feb-40fd-bd3a-a5f065494eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:31.712069 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431a015-1feb-40fd-bd3a-a5f065494eca None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:31.712357 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431a015-1feb-40fd-bd3a-a5f065494eca None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:31.712638 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431a015-1feb-40fd-bd3a-a5f065494eca None admin] PATH_INFO: `/v3/roles/member` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:31.726439 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7431a015-1feb-40fd-bd3a-a5f065494eca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:31.734925 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-7431a015-1feb-40fd-bd3a-a5f065494eca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:07:31.734925 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:31.734925 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:31.734925 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:31.734925 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:31.734925 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:31.734925 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:31.734925 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:31.734925 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:31.734925 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:31.734925 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:31.734925 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:31.734925 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:31.734925 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:31.734925 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:31.734925 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:31.735793 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:31.735793 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:31.735793 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:31.735793 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:31.735793 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:31.735793 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:31.735793 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:31.735793 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:31.735793 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:31.735793 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:31.735793 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:31.735793 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:31.735793 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:31.735793 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:31.735793 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:31.735793 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:31.736571 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:31.736571 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:31.736571 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:31.736571 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:31.736571 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:31.736571 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:31.736571 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:31.736571 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:31.736571 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:31.736571 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:31.736571 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:07:31.736571 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:07:31.736571 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 61/124] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:07:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:31.737229 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431a015-1feb-40fd-bd3a-a5f065494eca None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:31.769731 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:31.798624 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd720b6-e132-4558-befe-2cff534721d4 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:31.840309 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e8611-364a-4c7b-bc62-74e23feaaa9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:31.841590 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e8611-364a-4c7b-bc62-74e23feaaa9f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:31.842136 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e8611-364a-4c7b-bc62-74e23feaaa9f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:31.842593 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e8611-364a-4c7b-bc62-74e23feaaa9f None admin] PATH_INFO: `/v3/users/06533d70196747b697431af8a9794673` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:31.843943 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4e8611-364a-4c7b-bc62-74e23feaaa9f None admin] RBAC: Authorizing `identity:get_user(user_id=06533d70196747b697431af8a9794673)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:31.845226 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:31.846493 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4e8611-364a-4c7b-bc62-74e23feaaa9f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:31.848185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431a015-1feb-40fd-bd3a-a5f065494eca None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:31.848658 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 64/125] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jun 29 12:07:31 2022] GET /identity/v3/users/06533d70196747b697431af8a9794673 => generated 247 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:31.850133 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e8611-364a-4c7b-bc62-74e23feaaa9f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:31.887247 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d816d-c0e2-4d32-bcb3-292ed72efe9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:31.888111 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d816d-c0e2-4d32-bcb3-292ed72efe9e None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:31.888397 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d816d-c0e2-4d32-bcb3-292ed72efe9e None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:31.888672 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d816d-c0e2-4d32-bcb3-292ed72efe9e None admin] PATH_INFO: `/v3/projects/dcc3d4b81e0d470bab2492f8eb193665` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:31.889907 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86d816d-c0e2-4d32-bcb3-292ed72efe9e None admin] RBAC: Authorizing `identity:get_project(project_id=dcc3d4b81e0d470bab2492f8eb193665)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:31.892077 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86d816d-c0e2-4d32-bcb3-292ed72efe9e None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:31.893088 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 62/126] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jun 29 12:07:31 2022] GET /identity/v3/projects/dcc3d4b81e0d470bab2492f8eb193665 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:31.893902 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d816d-c0e2-4d32-bcb3-292ed72efe9e None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:31.966340 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e8611-364a-4c7b-bc62-74e23feaaa9f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:32.001179 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d816d-c0e2-4d32-bcb3-292ed72efe9e None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:32.005102 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f07e4a-ee03-4d95-8037-fe7514bf92d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:32.006013 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f07e4a-ee03-4d95-8037-fe7514bf92d1 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:32.006471 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f07e4a-ee03-4d95-8037-fe7514bf92d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:32.006916 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f07e4a-ee03-4d95-8037-fe7514bf92d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:32.007856 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f07e4a-ee03-4d95-8037-fe7514bf92d1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:32.008355 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f07e4a-ee03-4d95-8037-fe7514bf92d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:32.009973 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f07e4a-ee03-4d95-8037-fe7514bf92d1 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:32.020000 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 65/127] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jun 29 12:07:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:32.021251 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f07e4a-ee03-4d95-8037-fe7514bf92d1 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:32.031155 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:32.050520 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b96d2f8-71c8-4011-b8ba-a1bdeac5cdf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:32.052206 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96d2f8-71c8-4011-b8ba-a1bdeac5cdf7 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:32.052566 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96d2f8-71c8-4011-b8ba-a1bdeac5cdf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:32.052922 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96d2f8-71c8-4011-b8ba-a1bdeac5cdf7 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:32.054077 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b96d2f8-71c8-4011-b8ba-a1bdeac5cdf7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:32.054419 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b96d2f8-71c8-4011-b8ba-a1bdeac5cdf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:32.055845 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b96d2f8-71c8-4011-b8ba-a1bdeac5cdf7 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:32.069327 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 63/128] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jun 29 12:07:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:32.071182 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b96d2f8-71c8-4011-b8ba-a1bdeac5cdf7 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:32.112207 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:32.166450 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f07e4a-ee03-4d95-8037-fe7514bf92d1 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:32.193173 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b96d2f8-71c8-4011-b8ba-a1bdeac5cdf7 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:32.204924 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8c482d-223b-4c23-9f7f-aa69920e1f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:32.206114 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c482d-223b-4c23-9f7f-aa69920e1f41 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:32.206629 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c482d-223b-4c23-9f7f-aa69920e1f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:32.207098 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c482d-223b-4c23-9f7f-aa69920e1f41 None admin] PATH_INFO: `/v3/projects/dcc3d4b81e0d470bab2492f8eb193665` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:32.208626 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8c482d-223b-4c23-9f7f-aa69920e1f41 None admin] RBAC: Authorizing `identity:get_project(project_id=dcc3d4b81e0d470bab2492f8eb193665)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:32.210566 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8c482d-223b-4c23-9f7f-aa69920e1f41 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:32.212721 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 66/129] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jun 29 12:07:32 2022] GET /identity/v3/projects/dcc3d4b81e0d470bab2492f8eb193665 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:32.214118 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8c482d-223b-4c23-9f7f-aa69920e1f41 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:32.231140 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca097fa4-d9cb-4697-af4d-6919d4e24a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:32.232084 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca097fa4-d9cb-4697-af4d-6919d4e24a2d None admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:32.232323 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca097fa4-d9cb-4697-af4d-6919d4e24a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:32.232597 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca097fa4-d9cb-4697-af4d-6919d4e24a2d None admin] PATH_INFO: `/v3/projects/dcc3d4b81e0d470bab2492f8eb193665/users/444fe6680fcc4d189dc9e38aeebd3b11/roles/ea54879a52d24a47bada5629b6d8b456` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:32.234859 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca097fa4-d9cb-4697-af4d-6919d4e24a2d None admin] RBAC: Authorizing `identity:create_grant(project_id=dcc3d4b81e0d470bab2492f8eb193665, user_id=444fe6680fcc4d189dc9e38aeebd3b11, role_id=ea54879a52d24a47bada5629b6d8b456)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:32.236315 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca097fa4-d9cb-4697-af4d-6919d4e24a2d None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:32.253614 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 64/130] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jun 29 12:07:32 2022] PUT /identity/v3/projects/dcc3d4b81e0d470bab2492f8eb193665/users/444fe6680fcc4d189dc9e38aeebd3b11/roles/ea54879a52d24a47bada5629b6d8b456 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:07:32.254504 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca097fa4-d9cb-4697-af4d-6919d4e24a2d None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:32.318089 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:32.383273 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8c482d-223b-4c23-9f7f-aa69920e1f41 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:32.428321 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6790ecbc-cf18-4aca-bf45-0ed76f115baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:32.429265 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790ecbc-cf18-4aca-bf45-0ed76f115baf None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:32.429482 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790ecbc-cf18-4aca-bf45-0ed76f115baf None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:32.429810 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790ecbc-cf18-4aca-bf45-0ed76f115baf None admin] PATH_INFO: `/v3/users/444fe6680fcc4d189dc9e38aeebd3b11` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:32.431053 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6790ecbc-cf18-4aca-bf45-0ed76f115baf None admin] RBAC: Authorizing `identity:get_user(user_id=444fe6680fcc4d189dc9e38aeebd3b11)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:32.432516 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6790ecbc-cf18-4aca-bf45-0ed76f115baf None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:32.434621 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 67/131] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jun 29 12:07:32 2022] GET /identity/v3/users/444fe6680fcc4d189dc9e38aeebd3b11 => generated 275 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:32.435267 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6790ecbc-cf18-4aca-bf45-0ed76f115baf None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:32.438182 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:32.451282 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca097fa4-d9cb-4697-af4d-6919d4e24a2d None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:32.492626 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a1de2-f81f-4a9b-a715-b5401ab22c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:32.494036 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a1de2-f81f-4a9b-a715-b5401ab22c0c None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:32.494621 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a1de2-f81f-4a9b-a715-b5401ab22c0c None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:32.495099 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a1de2-f81f-4a9b-a715-b5401ab22c0c None admin] PATH_INFO: `/v3/users/444fe6680fcc4d189dc9e38aeebd3b11` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:32.497175 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751a1de2-f81f-4a9b-a715-b5401ab22c0c None admin] RBAC: Authorizing `identity:get_user(user_id=444fe6680fcc4d189dc9e38aeebd3b11)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:32.498942 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751a1de2-f81f-4a9b-a715-b5401ab22c0c None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:32.500822 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 65/132] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jun 29 12:07:32 2022] GET /identity/v3/users/444fe6680fcc4d189dc9e38aeebd3b11 => generated 275 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:32.502001 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a1de2-f81f-4a9b-a715-b5401ab22c0c None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:32.549511 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6790ecbc-cf18-4aca-bf45-0ed76f115baf None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:32.584912 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2659bb3-aaef-4957-9058-d079cc82a019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:32.585842 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2659bb3-aaef-4957-9058-d079cc82a019 None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:32.586124 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2659bb3-aaef-4957-9058-d079cc82a019 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:32.586395 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2659bb3-aaef-4957-9058-d079cc82a019 None admin] PATH_INFO: `/v3/projects/dcc3d4b81e0d470bab2492f8eb193665/users/06533d70196747b697431af8a9794673/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:32.588413 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2659bb3-aaef-4957-9058-d079cc82a019 None admin] RBAC: Authorizing `identity:create_grant(project_id=dcc3d4b81e0d470bab2492f8eb193665, user_id=06533d70196747b697431af8a9794673, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:32.589902 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2659bb3-aaef-4957-9058-d079cc82a019 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:32.605032 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:32.610857 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 68/133] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jun 29 12:07:32 2022] PUT /identity/v3/projects/dcc3d4b81e0d470bab2492f8eb193665/users/06533d70196747b697431af8a9794673/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:07:32.612152 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2659bb3-aaef-4957-9058-d079cc82a019 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:32.623586 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a1de2-f81f-4a9b-a715-b5401ab22c0c None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:32.672780 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2e5d3-2b98-4f02-b44d-8ca66b3d65c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:32.674354 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2e5d3-2b98-4f02-b44d-8ca66b3d65c8 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:32.674766 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2e5d3-2b98-4f02-b44d-8ca66b3d65c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:32.675140 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2e5d3-2b98-4f02-b44d-8ca66b3d65c8 None admin] PATH_INFO: `/v3/projects/b45ca34b972a47058b9236bb66ea7a42` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:32.677652 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee2e5d3-2b98-4f02-b44d-8ca66b3d65c8 None admin] RBAC: Authorizing `identity:get_project(project_id=b45ca34b972a47058b9236bb66ea7a42)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:32.680380 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee2e5d3-2b98-4f02-b44d-8ca66b3d65c8 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:32.683434 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 66/134] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jun 29 12:07:32 2022] GET /identity/v3/projects/b45ca34b972a47058b9236bb66ea7a42 => generated 312 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:32.689076 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2e5d3-2b98-4f02-b44d-8ca66b3d65c8 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:32.721976 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:32.744610 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2659bb3-aaef-4957-9058-d079cc82a019 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:32.783389 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d164da20-d5e8-4140-a7c2-878ff40de072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:32.784641 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164da20-d5e8-4140-a7c2-878ff40de072 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:32.785109 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164da20-d5e8-4140-a7c2-878ff40de072 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:32.785591 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164da20-d5e8-4140-a7c2-878ff40de072 None admin] PATH_INFO: `/v3/projects/dcc3d4b81e0d470bab2492f8eb193665` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:32.787376 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d164da20-d5e8-4140-a7c2-878ff40de072 None admin] RBAC: Authorizing `identity:get_project(project_id=dcc3d4b81e0d470bab2492f8eb193665)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:32.789221 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d164da20-d5e8-4140-a7c2-878ff40de072 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:32.791604 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 69/135] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jun 29 12:07:32 2022] GET /identity/v3/projects/dcc3d4b81e0d470bab2492f8eb193665 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:32.798000 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d164da20-d5e8-4140-a7c2-878ff40de072 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:32.823065 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2e5d3-2b98-4f02-b44d-8ca66b3d65c8 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:32.890072 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bc287f-252c-468b-8e17-5b821e8c0619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:32.890988 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc287f-252c-468b-8e17-5b821e8c0619 None admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:32.891269 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc287f-252c-468b-8e17-5b821e8c0619 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:32.891543 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc287f-252c-468b-8e17-5b821e8c0619 None admin] PATH_INFO: `/v3/projects/b45ca34b972a47058b9236bb66ea7a42/users/444fe6680fcc4d189dc9e38aeebd3b11/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:32.896071 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bc287f-252c-468b-8e17-5b821e8c0619 None admin] RBAC: Authorizing `identity:create_grant(project_id=b45ca34b972a47058b9236bb66ea7a42, user_id=444fe6680fcc4d189dc9e38aeebd3b11, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:32.897560 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bc287f-252c-468b-8e17-5b821e8c0619 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:32.923303 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 67/136] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jun 29 12:07:32 2022] PUT /identity/v3/projects/b45ca34b972a47058b9236bb66ea7a42/users/444fe6680fcc4d189dc9e38aeebd3b11/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:07:32.934473 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:32.988580 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d164da20-d5e8-4140-a7c2-878ff40de072 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:33.034508 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c8fe66-0e16-475d-84ca-246ee290bd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:33.035702 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8fe66-0e16-475d-84ca-246ee290bd3c None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:33.036136 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8fe66-0e16-475d-84ca-246ee290bd3c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:33.036703 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8fe66-0e16-475d-84ca-246ee290bd3c None admin] PATH_INFO: `/v3/projects/dcc3d4b81e0d470bab2492f8eb193665/users/444fe6680fcc4d189dc9e38aeebd3b11/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:33.038760 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83afacbf-1e16-4798-9dab-41340a1333aa None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:33.039045 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83afacbf-1e16-4798-9dab-41340a1333aa None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:33.039209 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c8fe66-0e16-475d-84ca-246ee290bd3c None admin] RBAC: Authorizing `identity:create_grant(project_id=dcc3d4b81e0d470bab2492f8eb193665, user_id=444fe6680fcc4d189dc9e38aeebd3b11, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:33.039306 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83afacbf-1e16-4798-9dab-41340a1333aa None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:33.040659 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c8fe66-0e16-475d-84ca-246ee290bd3c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:33.040759 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 68/137] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:07:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:33.046998 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e721fe0-2359-49ca-8437-146a9d402ba9 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:33.048040 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e721fe0-2359-49ca-8437-146a9d402ba9 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:33.049476 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e721fe0-2359-49ca-8437-146a9d402ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:33.069445 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 70/138] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jun 29 12:07:32 2022] PUT /identity/v3/projects/dcc3d4b81e0d470bab2492f8eb193665/users/444fe6680fcc4d189dc9e38aeebd3b11/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:07:33.092480 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-0e721fe0-2359-49ca-8437-146a9d402ba9 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:33.093752 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-0e721fe0-2359-49ca-8437-146a9d402ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:33.181269 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 69/139] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 12:07:33.233954 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c8fe66-0e16-475d-84ca-246ee290bd3c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:33.372685 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c8fe66-0e16-475d-84ca-246ee290bd3c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:33.404710 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:33.417297 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2982c3-160e-46b5-a83b-c186efade621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:33.418154 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2982c3-160e-46b5-a83b-c186efade621 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:33.418440 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2982c3-160e-46b5-a83b-c186efade621 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:33.418715 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2982c3-160e-46b5-a83b-c186efade621 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:33.419980 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2982c3-160e-46b5-a83b-c186efade621 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:33.421794 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2982c3-160e-46b5-a83b-c186efade621 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:33.423831 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 71/140] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:33.429363 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e721fe0-2359-49ca-8437-146a9d402ba9 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:33.447850 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:33.538147 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e721fe0-2359-49ca-8437-146a9d402ba9 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:33.574259 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891337b2-4627-49d3-9c5f-fc4b3c47ad13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:33.575216 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891337b2-4627-49d3-9c5f-fc4b3c47ad13 None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:33.575982 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891337b2-4627-49d3-9c5f-fc4b3c47ad13 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:33.576403 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891337b2-4627-49d3-9c5f-fc4b3c47ad13 None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:33.577265 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891337b2-4627-49d3-9c5f-fc4b3c47ad13 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:33.578907 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891337b2-4627-49d3-9c5f-fc4b3c47ad13 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:33.607369 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 70/141] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Jun 29 12:07:33 2022] POST /identity/v3/users => generated 283 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:07:34.030781 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66412d00-8039-4871-828f-f6225bdff52a None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:34.030781 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66412d00-8039-4871-828f-f6225bdff52a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:34.030781 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66412d00-8039-4871-828f-f6225bdff52a None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:34.031827 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 72/142] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:07:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:34.038443 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b7037-59e5-4851-b791-0ece5394c478 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:34.038876 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b7037-59e5-4851-b791-0ece5394c478 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:34.039067 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b7037-59e5-4851-b791-0ece5394c478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:34.064513 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-225b7037-59e5-4851-b791-0ece5394c478 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:34.065732 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-225b7037-59e5-4851-b791-0ece5394c478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:34.156633 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 71/143] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:34.199643 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66412d00-8039-4871-828f-f6225bdff52a None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:34.339047 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66412d00-8039-4871-828f-f6225bdff52a None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:34.382824 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e6fd9a-b130-48fc-b832-0ae916374ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:34.383687 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6fd9a-b130-48fc-b832-0ae916374ae5 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:34.383977 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6fd9a-b130-48fc-b832-0ae916374ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:34.384257 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6fd9a-b130-48fc-b832-0ae916374ae5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:34.398816 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e6fd9a-b130-48fc-b832-0ae916374ae5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:34.406818 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-b4e6fd9a-b130-48fc-b832-0ae916374ae5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 12:07:34.406818 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:34.406818 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:34.406818 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:34.406818 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:34.406818 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:34.406818 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:34.406818 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:34.406818 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:34.406818 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:34.406818 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:34.406818 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:34.406818 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:34.406818 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:34.406818 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:34.406818 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:34.407696 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:34.407696 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:34.407696 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:34.407696 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:34.407696 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:34.407696 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:34.407696 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:34.407696 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:34.407696 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:34.407696 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:34.407696 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:34.407696 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:34.407696 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:34.407696 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:34.407696 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:34.407696 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:34.408479 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:34.408479 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:34.408479 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:34.408479 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:34.408479 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:34.408479 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:34.408479 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:34.408479 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:34.408479 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:34.408479 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:34.408479 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 12:07:34.408479 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:07:34.408479 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 73/144] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:07:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:34.414489 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b7037-59e5-4851-b791-0ece5394c478 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:34.417998 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:34.544352 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b7037-59e5-4851-b791-0ece5394c478 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:34.580130 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b349b08-d8bd-4a43-a9c3-f95238036e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:34.580815 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b349b08-d8bd-4a43-a9c3-f95238036e49 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:34.581100 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b349b08-d8bd-4a43-a9c3-f95238036e49 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:34.581373 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b349b08-d8bd-4a43-a9c3-f95238036e49 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:34.582177 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b349b08-d8bd-4a43-a9c3-f95238036e49 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:34.582488 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b349b08-d8bd-4a43-a9c3-f95238036e49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:34.584136 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b349b08-d8bd-4a43-a9c3-f95238036e49 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:34.593563 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 72/145] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jun 29 12:07:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:34.599389 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e6fd9a-b130-48fc-b832-0ae916374ae5 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:34.676578 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:34.733160 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e6fd9a-b130-48fc-b832-0ae916374ae5 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:34.771464 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e1625a-2133-4d23-922f-dcde7131fcd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:34.772362 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1625a-2133-4d23-922f-dcde7131fcd4 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:34.772644 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1625a-2133-4d23-922f-dcde7131fcd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:34.772926 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1625a-2133-4d23-922f-dcde7131fcd4 None admin] PATH_INFO: `/v3/users/d15f02999f7c45cebd53d64fa8f390d2` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:34.774229 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e1625a-2133-4d23-922f-dcde7131fcd4 None admin] RBAC: Authorizing `identity:get_user(user_id=d15f02999f7c45cebd53d64fa8f390d2)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:34.775699 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e1625a-2133-4d23-922f-dcde7131fcd4 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:34.777364 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 74/146] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jun 29 12:07:34 2022] GET /identity/v3/users/d15f02999f7c45cebd53d64fa8f390d2 => generated 289 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:34.782928 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b349b08-d8bd-4a43-a9c3-f95238036e49 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:34.850148 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:34.898178 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b349b08-d8bd-4a43-a9c3-f95238036e49 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:34.948707 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c8fc37-d91c-41b9-8cce-6b35a0cb9360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:34.949598 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8fc37-d91c-41b9-8cce-6b35a0cb9360 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:34.949912 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8fc37-d91c-41b9-8cce-6b35a0cb9360 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:34.950188 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8fc37-d91c-41b9-8cce-6b35a0cb9360 None admin] PATH_INFO: `/v3/projects/dcc3d4b81e0d470bab2492f8eb193665` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:34.954097 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c8fc37-d91c-41b9-8cce-6b35a0cb9360 None admin] RBAC: Authorizing `identity:get_project(project_id=dcc3d4b81e0d470bab2492f8eb193665)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:34.955581 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c8fc37-d91c-41b9-8cce-6b35a0cb9360 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:34.957363 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 73/147] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jun 29 12:07:34 2022] GET /identity/v3/projects/dcc3d4b81e0d470bab2492f8eb193665 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:34.965948 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e1625a-2133-4d23-922f-dcde7131fcd4 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:35.105982 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e1625a-2133-4d23-922f-dcde7131fcd4 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:35.135324 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:35.147327 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de3bae4-b0fd-4491-a24b-c4b5ae93c28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:35.148240 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3bae4-b0fd-4491-a24b-c4b5ae93c28e None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:35.148524 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3bae4-b0fd-4491-a24b-c4b5ae93c28e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:35.148800 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3bae4-b0fd-4491-a24b-c4b5ae93c28e None admin] PATH_INFO: `/v3/projects/dcc3d4b81e0d470bab2492f8eb193665/users/d15f02999f7c45cebd53d64fa8f390d2/roles/e2336723b86b456e95b87bce11e66e1c` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:35.150935 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de3bae4-b0fd-4491-a24b-c4b5ae93c28e None admin] RBAC: Authorizing `identity:create_grant(project_id=dcc3d4b81e0d470bab2492f8eb193665, user_id=d15f02999f7c45cebd53d64fa8f390d2, role_id=e2336723b86b456e95b87bce11e66e1c)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:35.152456 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de3bae4-b0fd-4491-a24b-c4b5ae93c28e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:35.170531 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 75/148] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jun 29 12:07:34 2022] PUT /identity/v3/projects/dcc3d4b81e0d470bab2492f8eb193665/users/d15f02999f7c45cebd53d64fa8f390d2/roles/e2336723b86b456e95b87bce11e66e1c => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:07:35.473478 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cbf81b-3f37-4adf-b642-1116677be137 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:35.474078 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cbf81b-3f37-4adf-b642-1116677be137 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:35.474171 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cbf81b-3f37-4adf-b642-1116677be137 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:35.475604 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 74/149] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:07:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:35.481361 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ee061-5e55-4381-aa56-70d7ba7e9bdb None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:35.481642 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ee061-5e55-4381-aa56-70d7ba7e9bdb None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:35.481948 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ee061-5e55-4381-aa56-70d7ba7e9bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:35.502758 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-dc9ee061-5e55-4381-aa56-70d7ba7e9bdb None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:35.504034 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-dc9ee061-5e55-4381-aa56-70d7ba7e9bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:35.592083 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 76/150] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:35.631602 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cbf81b-3f37-4adf-b642-1116677be137 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:35.755556 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cbf81b-3f37-4adf-b642-1116677be137 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:35.792982 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:35.801320 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae4e16-246d-4965-b47e-216fc130e084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:35.802320 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae4e16-246d-4965-b47e-216fc130e084 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:35.802602 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae4e16-246d-4965-b47e-216fc130e084 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:35.802884 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae4e16-246d-4965-b47e-216fc130e084 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:35.815894 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae4e16-246d-4965-b47e-216fc130e084 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:35.824377 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-93ae4e16-246d-4965-b47e-216fc130e084 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 12:07:35.824377 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:35.824377 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:35.824377 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:35.824377 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:35.824377 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:35.824377 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:35.824377 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:35.824377 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:35.824377 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:35.824377 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:35.824377 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:35.824377 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:35.824377 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:35.824377 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:35.824377 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:35.825257 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:35.825257 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:35.825257 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:35.825257 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:35.825257 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:35.825257 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:35.825257 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:35.825257 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:35.825257 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:35.825257 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:35.825257 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:35.825257 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:35.825257 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:35.825257 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:35.825257 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:35.825257 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:35.826953 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:35.826953 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:35.826953 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:35.826953 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:35.826953 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:35.826953 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:35.826953 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:35.826953 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:35.826953 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:35.826953 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:35.826953 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 12:07:35.826953 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:07:35.826953 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 75/151] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jun 29 12:07:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:35.832045 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ee061-5e55-4381-aa56-70d7ba7e9bdb None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:35.938868 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ee061-5e55-4381-aa56-70d7ba7e9bdb None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:35.958099 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:35.976469 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cda66a-bcbe-4833-aa15-f7808afb331f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:35.977520 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cda66a-bcbe-4833-aa15-f7808afb331f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:35.982083 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cda66a-bcbe-4833-aa15-f7808afb331f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:35.982376 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cda66a-bcbe-4833-aa15-f7808afb331f None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:35.983234 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cda66a-bcbe-4833-aa15-f7808afb331f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:35.983547 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cda66a-bcbe-4833-aa15-f7808afb331f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:35.985130 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cda66a-bcbe-4833-aa15-f7808afb331f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:35.995084 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 77/152] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jun 29 12:07:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:36.000642 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae4e16-246d-4965-b47e-216fc130e084 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:36.120292 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae4e16-246d-4965-b47e-216fc130e084 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:36.165575 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178a5eb7-021b-4d67-a81e-782dc50a6c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:36.166548 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a5eb7-021b-4d67-a81e-782dc50a6c83 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:36.166833 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a5eb7-021b-4d67-a81e-782dc50a6c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:36.167109 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a5eb7-021b-4d67-a81e-782dc50a6c83 None admin] PATH_INFO: `/v3/users/444fe6680fcc4d189dc9e38aeebd3b11` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:36.171177 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178a5eb7-021b-4d67-a81e-782dc50a6c83 None admin] RBAC: Authorizing `identity:get_user(user_id=444fe6680fcc4d189dc9e38aeebd3b11)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:36.172711 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178a5eb7-021b-4d67-a81e-782dc50a6c83 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:36.174409 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 76/153] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jun 29 12:07:35 2022] GET /identity/v3/users/444fe6680fcc4d189dc9e38aeebd3b11 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:36.180655 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cda66a-bcbe-4833-aa15-f7808afb331f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:36.287197 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cda66a-bcbe-4833-aa15-f7808afb331f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:36.322523 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0baf1da-aff9-4a40-be85-e49a7c936809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:36.323239 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0baf1da-aff9-4a40-be85-e49a7c936809 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:36.323520 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0baf1da-aff9-4a40-be85-e49a7c936809 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:36.323840 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0baf1da-aff9-4a40-be85-e49a7c936809 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:36.371725 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:36.395523 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0baf1da-aff9-4a40-be85-e49a7c936809 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:36.397065 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0baf1da-aff9-4a40-be85-e49a7c936809 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:36.400858 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562f4c2-cab7-4446-90a5-1ee4639494e4 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:36.401138 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562f4c2-cab7-4446-90a5-1ee4639494e4 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:36.401410 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562f4c2-cab7-4446-90a5-1ee4639494e4 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:36.403322 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 77/154] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:07:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:07:36.408759 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c459f1c-0176-4a9b-b851-b137e8f68c90 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:36.409049 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c459f1c-0176-4a9b-b851-b137e8f68c90 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:36.409317 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c459f1c-0176-4a9b-b851-b137e8f68c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:36.435774 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-9c459f1c-0176-4a9b-b851-b137e8f68c90 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:36.437002 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-9c459f1c-0176-4a9b-b851-b137e8f68c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:36.554593 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:36.583860 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 78/155] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 12:07:36.585156 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc4a48-0581-44ba-8428-6eee3cbe6139 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:36.585438 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc4a48-0581-44ba-8428-6eee3cbe6139 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:36.585733 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc4a48-0581-44ba-8428-6eee3cbe6139 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:36.586063 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 78/156] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:07:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:07:36.589832 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 79/157] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:07:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:36.592252 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0baf1da-aff9-4a40-be85-e49a7c936809 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:36.603198 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b9c18b-57b1-416b-ba2b-c8516d16b56b None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:36.603523 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b9c18b-57b1-416b-ba2b-c8516d16b56b None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:36.603773 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b9c18b-57b1-416b-ba2b-c8516d16b56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:36.634730 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-36b9c18b-57b1-416b-ba2b-c8516d16b56b None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:36.636249 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-36b9c18b-57b1-416b-ba2b-c8516d16b56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:36.702206 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:36.723050 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0baf1da-aff9-4a40-be85-e49a7c936809 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:36.782547 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf43785-bb79-4775-b895-a73aff7d655b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:36.783527 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf43785-bb79-4775-b895-a73aff7d655b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:36.783909 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf43785-bb79-4775-b895-a73aff7d655b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:36.784185 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf43785-bb79-4775-b895-a73aff7d655b None admin] PATH_INFO: `/v3/projects/dcc3d4b81e0d470bab2492f8eb193665` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:36.786882 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf43785-bb79-4775-b895-a73aff7d655b None admin] RBAC: Authorizing `identity:get_project(project_id=dcc3d4b81e0d470bab2492f8eb193665)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:36.788726 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf43785-bb79-4775-b895-a73aff7d655b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:36.790838 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 79/158] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jun 29 12:07:36 2022] GET /identity/v3/projects/dcc3d4b81e0d470bab2492f8eb193665 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:36.791755 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf43785-bb79-4775-b895-a73aff7d655b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:36.799239 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 80/159] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:36.800290 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b9c18b-57b1-416b-ba2b-c8516d16b56b None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:36.915130 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf43785-bb79-4775-b895-a73aff7d655b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:36.952255 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a54e2f5-27ca-44b5-911a-003af4d717a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:36.953453 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54e2f5-27ca-44b5-911a-003af4d717a8 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:36.953993 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54e2f5-27ca-44b5-911a-003af4d717a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:36.954479 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54e2f5-27ca-44b5-911a-003af4d717a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:36.966877 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a54e2f5-27ca-44b5-911a-003af4d717a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:36.968799 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b9c18b-57b1-416b-ba2b-c8516d16b56b None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:36.975622 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-8a54e2f5-27ca-44b5-911a-003af4d717a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:07:36.975622 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:36.975622 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:36.975622 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:36.975622 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:36.975622 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:36.975622 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:36.975622 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:36.975622 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:36.975622 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:36.975622 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:36.975622 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:36.975622 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:36.975622 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:36.975622 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:36.975622 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:36.976496 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:36.976496 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:36.976496 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:36.976496 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:36.976496 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:36.976496 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:36.976496 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:36.976496 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:36.976496 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:36.976496 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:36.976496 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:36.976496 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:36.976496 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:36.976496 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:36.976496 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:36.976496 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:36.977392 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:36.977392 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:36.977392 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:36.977392 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:36.977392 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:36.977392 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:36.977392 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:36.977392 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:36.977392 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:36.977392 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:36.977392 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:07:36.977392 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:07:36.979911 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 80/160] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jun 29 12:07:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:36.980895 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a54e2f5-27ca-44b5-911a-003af4d717a8 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:36.994068 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:37.003437 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:37.032841 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa7d913-4a76-4548-8c12-f3a7812eaf11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:37.034714 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7d913-4a76-4548-8c12-f3a7812eaf11 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:37.035421 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7d913-4a76-4548-8c12-f3a7812eaf11 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:37.037485 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7d913-4a76-4548-8c12-f3a7812eaf11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:37.038622 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa7d913-4a76-4548-8c12-f3a7812eaf11 None admin] RBAC: Adding query filter params (role.id=ea54879a52d24a47bada5629b6d8b456, scope.project.id=dcc3d4b81e0d470bab2492f8eb193665, user.id=444fe6680fcc4d189dc9e38aeebd3b11) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:37.040356 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa7d913-4a76-4548-8c12-f3a7812eaf11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:37.042087 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa7d913-4a76-4548-8c12-f3a7812eaf11 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:37.059114 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 81/161] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jun 29 12:07:36 2022] GET /identity/v3/role_assignments?user.id=444fe6680fcc4d189dc9e38aeebd3b11&scope.project.id=dcc3d4b81e0d470bab2492f8eb193665&role.id=ea54879a52d24a47bada5629b6d8b456 => generated 608 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:37.059574 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa7d913-4a76-4548-8c12-f3a7812eaf11 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:37.179730 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a54e2f5-27ca-44b5-911a-003af4d717a8 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:37.254607 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0028ed70-98d3-4d8e-bd1a-c1c78b44c746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:37.255739 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028ed70-98d3-4d8e-bd1a-c1c78b44c746 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:37.256144 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028ed70-98d3-4d8e-bd1a-c1c78b44c746 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:37.256515 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028ed70-98d3-4d8e-bd1a-c1c78b44c746 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:37.272843 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0028ed70-98d3-4d8e-bd1a-c1c78b44c746 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:37.284971 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa7d913-4a76-4548-8c12-f3a7812eaf11 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:37.289928 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-0028ed70-98d3-4d8e-bd1a-c1c78b44c746 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:07:37.289928 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:37.289928 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:37.289928 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:37.289928 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:37.289928 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:37.289928 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:37.289928 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:37.289928 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:37.289928 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:37.289928 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:37.289928 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:37.289928 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:37.289928 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:37.289928 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:37.289928 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:37.290791 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:37.290791 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:37.290791 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:37.290791 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:37.290791 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:37.290791 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:37.290791 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:37.290791 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:37.290791 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:37.290791 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:37.290791 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:37.290791 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:37.290791 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:37.290791 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:37.290791 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:37.290791 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:37.291629 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:37.291629 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:37.291629 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:37.291629 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:37.291629 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:37.291629 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:37.291629 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:37.291629 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:37.291629 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:37.291629 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:37.291629 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:07:37.291629 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:07:37.292242 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 81/162] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:07:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:37.293310 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188271d-ed5a-4bc5-9859-c9866ab0f05d None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:37.293938 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188271d-ed5a-4bc5-9859-c9866ab0f05d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:37.294392 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188271d-ed5a-4bc5-9859-c9866ab0f05d None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:37.296613 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 82/163] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:07:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:37.297182 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188271d-ed5a-4bc5-9859-c9866ab0f05d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:37.354434 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4479ba2f-0196-45ff-bf00-dffa3b6f298a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:37.355509 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479ba2f-0196-45ff-bf00-dffa3b6f298a None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:37.355996 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479ba2f-0196-45ff-bf00-dffa3b6f298a None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:37.356461 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479ba2f-0196-45ff-bf00-dffa3b6f298a None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:37.357461 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4479ba2f-0196-45ff-bf00-dffa3b6f298a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:37.358024 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4479ba2f-0196-45ff-bf00-dffa3b6f298a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:37.359940 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4479ba2f-0196-45ff-bf00-dffa3b6f298a None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:37.377408 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 82/164] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:07:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:37.379050 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8821d48-a22f-41d2-b40f-5bb6ffe62ec4 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:37.379553 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8821d48-a22f-41d2-b40f-5bb6ffe62ec4 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:37.380014 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8821d48-a22f-41d2-b40f-5bb6ffe62ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:37.418058 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-c8821d48-a22f-41d2-b40f-5bb6ffe62ec4 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:37.419606 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-c8821d48-a22f-41d2-b40f-5bb6ffe62ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:37.430157 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:37.468100 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188271d-ed5a-4bc5-9859-c9866ab0f05d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:37.506785 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:37.527677 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a2f78-d662-46d3-83de-cc9647b95dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:37.528699 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a2f78-d662-46d3-83de-cc9647b95dbe None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:37.529122 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a2f78-d662-46d3-83de-cc9647b95dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:37.529536 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a2f78-d662-46d3-83de-cc9647b95dbe None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:37.530597 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a2f78-d662-46d3-83de-cc9647b95dbe None admin] RBAC: Adding query filter params (name=member) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:37.531134 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a2f78-d662-46d3-83de-cc9647b95dbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:37.532673 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a2f78-d662-46d3-83de-cc9647b95dbe None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:37.542392 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 83/165] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:37.543399 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8821d48-a22f-41d2-b40f-5bb6ffe62ec4 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:37.551149 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 83/166] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jun 29 12:07:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:37.557312 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a2f78-d662-46d3-83de-cc9647b95dbe None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:37.680500 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8821d48-a22f-41d2-b40f-5bb6ffe62ec4 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:37.720643 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7189f0-2916-4b7d-bdcb-978ac6ce5ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:37.721715 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7189f0-2916-4b7d-bdcb-978ac6ce5ea9 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:37.722095 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7189f0-2916-4b7d-bdcb-978ac6ce5ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:37.722485 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7189f0-2916-4b7d-bdcb-978ac6ce5ea9 None admin] PATH_INFO: `/v3/users/06533d70196747b697431af8a9794673` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:37.723877 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7189f0-2916-4b7d-bdcb-978ac6ce5ea9 None admin] RBAC: Authorizing `identity:get_user(user_id=06533d70196747b697431af8a9794673)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:37.726193 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7189f0-2916-4b7d-bdcb-978ac6ce5ea9 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:37.728747 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 84/167] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jun 29 12:07:37 2022] GET /identity/v3/users/06533d70196747b697431af8a9794673 => generated 247 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:37.730012 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7189f0-2916-4b7d-bdcb-978ac6ce5ea9 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:37.749949 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a2f78-d662-46d3-83de-cc9647b95dbe None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:37.815215 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:37.816154 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:37.820718 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e83a6-e0ca-4a5d-bbc3-fb4fe4f68124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:37.821621 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e83a6-e0ca-4a5d-bbc3-fb4fe4f68124 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:37.822059 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e83a6-e0ca-4a5d-bbc3-fb4fe4f68124 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:37.822371 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e83a6-e0ca-4a5d-bbc3-fb4fe4f68124 None admin] PATH_INFO: `/v3/users/444fe6680fcc4d189dc9e38aeebd3b11` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:37.823741 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6e83a6-e0ca-4a5d-bbc3-fb4fe4f68124 None admin] RBAC: Authorizing `identity:get_user(user_id=444fe6680fcc4d189dc9e38aeebd3b11)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:37.826241 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6e83a6-e0ca-4a5d-bbc3-fb4fe4f68124 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:37.828309 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 84/168] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jun 29 12:07:37 2022] GET /identity/v3/users/444fe6680fcc4d189dc9e38aeebd3b11 => generated 275 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:37.829091 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e83a6-e0ca-4a5d-bbc3-fb4fe4f68124 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:37.926453 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7189f0-2916-4b7d-bdcb-978ac6ce5ea9 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:37.976950 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21554213-1422-4d23-8082-045a3e4422bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:37.977708 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21554213-1422-4d23-8082-045a3e4422bc None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:37.978000 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21554213-1422-4d23-8082-045a3e4422bc None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:37.978276 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21554213-1422-4d23-8082-045a3e4422bc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:37.993772 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21554213-1422-4d23-8082-045a3e4422bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:38.001773 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-21554213-1422-4d23-8082-045a3e4422bc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:07:38.001773 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:38.001773 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:38.001773 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:38.001773 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:38.001773 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:38.001773 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:38.001773 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:38.001773 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:38.001773 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:38.001773 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:38.001773 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:38.001773 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:38.001773 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:38.001773 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:38.001773 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:38.002809 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:38.002809 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:38.002809 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:38.002809 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:38.002809 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:38.002809 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:38.002809 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:38.002809 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:38.002809 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:38.002809 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:38.002809 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:38.002809 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:38.002809 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:38.002809 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:38.002809 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:38.002809 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:38.003647 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:38.003647 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:38.003647 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:38.003647 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:38.003647 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:38.003647 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:38.003647 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:38.003647 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:38.003647 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:38.003647 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:38.003647 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:07:38.003647 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:07:38.003647 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 85/169] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:07:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:38.006451 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21554213-1422-4d23-8082-045a3e4422bc None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:38.016095 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e83a6-e0ca-4a5d-bbc3-fb4fe4f68124 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:38.101505 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40272b86-9e2e-4ce6-9b69-3814dab41a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:38.102264 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40272b86-9e2e-4ce6-9b69-3814dab41a79 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:38.102543 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40272b86-9e2e-4ce6-9b69-3814dab41a79 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:38.102815 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40272b86-9e2e-4ce6-9b69-3814dab41a79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:38.188908 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21554213-1422-4d23-8082-045a3e4422bc None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:38.198852 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:38.211830 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:38.220840 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40272b86-9e2e-4ce6-9b69-3814dab41a79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:38.222367 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40272b86-9e2e-4ce6-9b69-3814dab41a79 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:38.257330 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f643c1b3-dab0-4486-bcc9-0d07763ae4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:38.257955 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643c1b3-dab0-4486-bcc9-0d07763ae4ea None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:38.258240 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643c1b3-dab0-4486-bcc9-0d07763ae4ea None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:38.258518 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643c1b3-dab0-4486-bcc9-0d07763ae4ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:38.370508 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f643c1b3-dab0-4486-bcc9-0d07763ae4ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:38.372013 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f643c1b3-dab0-4486-bcc9-0d07763ae4ea None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:38.381821 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 85/170] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:07:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:07:38.382755 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40272b86-9e2e-4ce6-9b69-3814dab41a79 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:38.535120 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:38.540861 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40272b86-9e2e-4ce6-9b69-3814dab41a79 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:38.567193 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 86/171] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:07:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:07:38.567828 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63e442-b37c-464e-9e1c-9be8c32df9fb None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:38.567828 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63e442-b37c-464e-9e1c-9be8c32df9fb None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:38.568161 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63e442-b37c-464e-9e1c-9be8c32df9fb None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:38.569580 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 87/172] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:07:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:38.571378 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63e442-b37c-464e-9e1c-9be8c32df9fb None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:38.578010 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:38.588819 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf917e6-43aa-4a8f-934b-5e7c36486cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:38.589539 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf917e6-43aa-4a8f-934b-5e7c36486cfe None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:38.589857 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf917e6-43aa-4a8f-934b-5e7c36486cfe None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:38.590135 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf917e6-43aa-4a8f-934b-5e7c36486cfe None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:38.591235 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf917e6-43aa-4a8f-934b-5e7c36486cfe None admin] RBAC: Adding query filter params (name=member) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:38.591545 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf917e6-43aa-4a8f-934b-5e7c36486cfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:38.593245 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf917e6-43aa-4a8f-934b-5e7c36486cfe None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:38.604485 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 86/173] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jun 29 12:07:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:38.606387 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ad135-128f-4d95-acc2-5a5e0e973d05 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:38.606685 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ad135-128f-4d95-acc2-5a5e0e973d05 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:38.606957 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ad135-128f-4d95-acc2-5a5e0e973d05 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:38.608980 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 87/174] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:07:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:38.613168 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ad135-128f-4d95-acc2-5a5e0e973d05 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:38.698085 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63e442-b37c-464e-9e1c-9be8c32df9fb None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:38.731648 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ad135-128f-4d95-acc2-5a5e0e973d05 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:38.733621 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929b0a0-0277-4768-b5dc-6a706c2e4509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:38.734552 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929b0a0-0277-4768-b5dc-6a706c2e4509 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:38.734836 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929b0a0-0277-4768-b5dc-6a706c2e4509 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:38.735112 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929b0a0-0277-4768-b5dc-6a706c2e4509 None admin] PATH_INFO: `/v3/projects/dcc3d4b81e0d470bab2492f8eb193665` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:38.736318 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e929b0a0-0277-4768-b5dc-6a706c2e4509 None admin] RBAC: Authorizing `identity:get_project(project_id=dcc3d4b81e0d470bab2492f8eb193665)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:38.737817 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e929b0a0-0277-4768-b5dc-6a706c2e4509 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:38.739557 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 88/175] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jun 29 12:07:38 2022] GET /identity/v3/projects/dcc3d4b81e0d470bab2492f8eb193665 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:38.745813 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85a80d-1f2f-40c3-ad55-1f2e00dc19f4 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:38.746003 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85a80d-1f2f-40c3-ad55-1f2e00dc19f4 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:38.746251 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85a80d-1f2f-40c3-ad55-1f2e00dc19f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:38.763211 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-4c85a80d-1f2f-40c3-ad55-1f2e00dc19f4 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:38.764516 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-4c85a80d-1f2f-40c3-ad55-1f2e00dc19f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:38.772993 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c365311b-e7f4-4600-8447-c1cb7f727d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:38.774273 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365311b-e7f4-4600-8447-c1cb7f727d2c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:38.774844 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365311b-e7f4-4600-8447-c1cb7f727d2c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:38.775326 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365311b-e7f4-4600-8447-c1cb7f727d2c None admin] PATH_INFO: `/v3/projects/b45ca34b972a47058b9236bb66ea7a42` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:38.776933 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c365311b-e7f4-4600-8447-c1cb7f727d2c None admin] RBAC: Authorizing `identity:get_project(project_id=b45ca34b972a47058b9236bb66ea7a42)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:38.778829 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c365311b-e7f4-4600-8447-c1cb7f727d2c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:38.785825 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 88/176] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jun 29 12:07:38 2022] GET /identity/v3/projects/b45ca34b972a47058b9236bb66ea7a42 => generated 312 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:38.787194 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c365311b-e7f4-4600-8447-c1cb7f727d2c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:38.816239 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:38.837414 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 89/177] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:38.838992 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0e81a-bbc5-4797-97d9-1934ad10fc7e None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:38.839125 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0e81a-bbc5-4797-97d9-1934ad10fc7e None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:38.839409 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0e81a-bbc5-4797-97d9-1934ad10fc7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:38.844388 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:38.858050 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-87f0e81a-bbc5-4797-97d9-1934ad10fc7e None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:38.859341 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-87f0e81a-bbc5-4797-97d9-1934ad10fc7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:38.906244 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c365311b-e7f4-4600-8447-c1cb7f727d2c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:38.931402 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 90/178] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:38.932268 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f0e81a-bbc5-4797-97d9-1934ad10fc7e None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:38.951005 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90905a-7bdb-47bb-9cad-5469285ef6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:38.952571 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90905a-7bdb-47bb-9cad-5469285ef6ef None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:38.953072 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90905a-7bdb-47bb-9cad-5469285ef6ef None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:38.953603 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90905a-7bdb-47bb-9cad-5469285ef6ef None admin] PATH_INFO: `/v3/users/444fe6680fcc4d189dc9e38aeebd3b11` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:38.954874 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90905a-7bdb-47bb-9cad-5469285ef6ef None admin] RBAC: Authorizing `identity:get_user(user_id=444fe6680fcc4d189dc9e38aeebd3b11)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:38.957121 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90905a-7bdb-47bb-9cad-5469285ef6ef None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:38.959645 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 89/179] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jun 29 12:07:38 2022] GET /identity/v3/users/444fe6680fcc4d189dc9e38aeebd3b11 => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:38.960569 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90905a-7bdb-47bb-9cad-5469285ef6ef None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:39.042964 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f0e81a-bbc5-4797-97d9-1934ad10fc7e None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:39.060397 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:39.069642 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90905a-7bdb-47bb-9cad-5469285ef6ef None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:39.077293 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:39.082601 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da2b4d-2bad-4d98-aeda-fb64e3589eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:39.083269 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da2b4d-2bad-4d98-aeda-fb64e3589eba None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:39.083606 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da2b4d-2bad-4d98-aeda-fb64e3589eba None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:39.083993 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da2b4d-2bad-4d98-aeda-fb64e3589eba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:39.084842 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55da2b4d-2bad-4d98-aeda-fb64e3589eba None admin] RBAC: Adding query filter params (role.id=e0e69ac8a8bf4cc4baa6aa18f2fc9919, scope.project.id=dcc3d4b81e0d470bab2492f8eb193665, user.id=06533d70196747b697431af8a9794673) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:39.085153 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55da2b4d-2bad-4d98-aeda-fb64e3589eba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:39.086652 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55da2b4d-2bad-4d98-aeda-fb64e3589eba None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:39.092664 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 91/180] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jun 29 12:07:38 2022] GET /identity/v3/role_assignments?user.id=06533d70196747b697431af8a9794673&scope.project.id=dcc3d4b81e0d470bab2492f8eb193665&role.id=e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:39.093236 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da2b4d-2bad-4d98-aeda-fb64e3589eba None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:39.105756 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c1c26-7cb8-4fe0-ae53-f76ceb503ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:39.106478 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c1c26-7cb8-4fe0-ae53-f76ceb503ade None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:39.106755 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c1c26-7cb8-4fe0-ae53-f76ceb503ade None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:39.107024 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c1c26-7cb8-4fe0-ae53-f76ceb503ade None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:39.108446 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c1c26-7cb8-4fe0-ae53-f76ceb503ade None admin] RBAC: Adding query filter params (role.id=c49accbc6f81447cb221ef720db04ced, scope.project.id=b45ca34b972a47058b9236bb66ea7a42, user.id=444fe6680fcc4d189dc9e38aeebd3b11) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:39.108773 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c1c26-7cb8-4fe0-ae53-f76ceb503ade None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:39.110698 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c1c26-7cb8-4fe0-ae53-f76ceb503ade None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:39.125739 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 90/181] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jun 29 12:07:38 2022] GET /identity/v3/role_assignments?user.id=444fe6680fcc4d189dc9e38aeebd3b11&scope.project.id=b45ca34b972a47058b9236bb66ea7a42&role.id=c49accbc6f81447cb221ef720db04ced => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:39.125739 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c8d33-1879-4804-84cf-cd90b2d98689 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:39.125739 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c8d33-1879-4804-84cf-cd90b2d98689 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:39.125739 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c8d33-1879-4804-84cf-cd90b2d98689 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:39.125739 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 91/182] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:07:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:39.125739 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c8d33-1879-4804-84cf-cd90b2d98689 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:39.250478 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c8d33-1879-4804-84cf-cd90b2d98689 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:39.266868 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da2b4d-2bad-4d98-aeda-fb64e3589eba None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:39.306640 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da470ca-c52d-412f-9ee1-846e1634c37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:39.307733 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da470ca-c52d-412f-9ee1-846e1634c37b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:39.308172 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da470ca-c52d-412f-9ee1-846e1634c37b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:39.308456 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da470ca-c52d-412f-9ee1-846e1634c37b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:39.319967 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39831848-1488-4656-af46-a7026bff9b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:39.321141 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39831848-1488-4656-af46-a7026bff9b79 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:39.321428 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39831848-1488-4656-af46-a7026bff9b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:39.321761 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39831848-1488-4656-af46-a7026bff9b79 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:39.323663 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da470ca-c52d-412f-9ee1-846e1634c37b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:39.332482 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-2da470ca-c52d-412f-9ee1-846e1634c37b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 12:07:39.332482 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:39.332482 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:39.332482 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:39.332482 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:39.332482 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:39.332482 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:39.332482 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:39.332482 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:39.332482 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:39.332482 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:39.332482 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:39.332482 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:39.332482 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:39.332482 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:39.332482 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:39.333404 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:39.333404 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:39.333404 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:39.333404 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:39.333404 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:39.333404 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:39.333404 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:39.333404 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:39.333404 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:39.333404 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:39.333404 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:39.333404 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:39.333404 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:39.333404 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:39.333404 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:39.333404 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:39.335147 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:39.335147 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:39.335147 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:39.335147 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:39.335147 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:39.335147 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:39.335147 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:39.335147 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:39.335147 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:39.335147 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:39.335147 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 12:07:39.335147 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:07:39.335147 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 92/183] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jun 29 12:07:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:39.335147 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da470ca-c52d-412f-9ee1-846e1634c37b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:39.341835 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39831848-1488-4656-af46-a7026bff9b79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:39.345673 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-39831848-1488-4656-af46-a7026bff9b79 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:07:39.345673 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:39.345673 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:39.345673 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:39.345673 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:39.345673 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:39.345673 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:39.345673 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:39.345673 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:39.345673 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:39.345673 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:39.345673 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:39.345673 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:39.345673 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:39.345673 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:39.345673 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:39.347241 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:39.347241 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:39.347241 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:39.347241 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:39.347241 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:39.347241 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:39.347241 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:39.347241 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:39.347241 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:39.347241 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:39.347241 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:39.347241 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:39.347241 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:39.347241 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:39.347241 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:39.347241 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:39.348509 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:39.348509 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:39.348509 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:39.348509 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:39.348509 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:39.348509 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:39.348509 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:39.348509 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:39.348509 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:39.348509 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:39.348509 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:07:39.348509 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:07:39.348509 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 92/184] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jun 29 12:07:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:39.350191 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb964a6-9e1f-42e2-a7ca-e9847e43deec None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:39.350191 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb964a6-9e1f-42e2-a7ca-e9847e43deec None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:39.350191 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb964a6-9e1f-42e2-a7ca-e9847e43deec None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:39.355745 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 93/185] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:07:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:39.357197 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:39.357471 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4f1ec-0c2b-4448-b5b9-4c8af63ceab0 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:39.357782 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4f1ec-0c2b-4448-b5b9-4c8af63ceab0 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:39.358061 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4f1ec-0c2b-4448-b5b9-4c8af63ceab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:39.379237 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-beb4f1ec-0c2b-4448-b5b9-4c8af63ceab0 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:39.380539 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-beb4f1ec-0c2b-4448-b5b9-4c8af63ceab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:39.437167 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:39.451896 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da470ca-c52d-412f-9ee1-846e1634c37b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:39.454942 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 94/186] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:39.460410 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb4f1ec-0c2b-4448-b5b9-4c8af63ceab0 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:39.498046 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38674d-6db6-4eb6-ace6-b7bdb39f794c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:39.498693 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38674d-6db6-4eb6-ace6-b7bdb39f794c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:39.498970 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38674d-6db6-4eb6-ace6-b7bdb39f794c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:39.499238 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38674d-6db6-4eb6-ace6-b7bdb39f794c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:39.556441 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb4f1ec-0c2b-4448-b5b9-4c8af63ceab0 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:39.570423 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d38674d-6db6-4eb6-ace6-b7bdb39f794c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:39.571938 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d38674d-6db6-4eb6-ace6-b7bdb39f794c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:39.588824 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:39.592451 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097daa08-f5ae-4822-b55f-e435de218f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:39.593378 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097daa08-f5ae-4822-b55f-e435de218f17 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:39.593656 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097daa08-f5ae-4822-b55f-e435de218f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:39.593963 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097daa08-f5ae-4822-b55f-e435de218f17 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:39.594717 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097daa08-f5ae-4822-b55f-e435de218f17 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:39.595022 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097daa08-f5ae-4822-b55f-e435de218f17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:39.596407 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097daa08-f5ae-4822-b55f-e435de218f17 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:39.604611 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 95/187] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jun 29 12:07:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:39.605392 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097daa08-f5ae-4822-b55f-e435de218f17 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:39.655305 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:39.673345 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 93/188] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:07:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:07:39.674693 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43701a-c74e-4153-8d2b-4f94b952f57a None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:39.674984 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43701a-c74e-4153-8d2b-4f94b952f57a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:39.675262 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43701a-c74e-4153-8d2b-4f94b952f57a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:39.691278 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-cb43701a-c74e-4153-8d2b-4f94b952f57a None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:39.692513 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-cb43701a-c74e-4153-8d2b-4f94b952f57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:39.711271 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097daa08-f5ae-4822-b55f-e435de218f17 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:39.744996 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd975c5-92ef-40c7-a50d-640d6beaa25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:39.745664 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd975c5-92ef-40c7-a50d-640d6beaa25d None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:39.745977 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd975c5-92ef-40c7-a50d-640d6beaa25d None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:39.746247 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd975c5-92ef-40c7-a50d-640d6beaa25d None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:39.746998 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd975c5-92ef-40c7-a50d-640d6beaa25d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:39.747302 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd975c5-92ef-40c7-a50d-640d6beaa25d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:39.748686 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd975c5-92ef-40c7-a50d-640d6beaa25d None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:39.756757 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 96/189] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:07:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:39.757436 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd975c5-92ef-40c7-a50d-640d6beaa25d None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:39.761454 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 94/190] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:39.762495 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb43701a-c74e-4153-8d2b-4f94b952f57a None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:39.812653 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:39.857340 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd975c5-92ef-40c7-a50d-640d6beaa25d None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:39.867344 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:39.868366 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb43701a-c74e-4153-8d2b-4f94b952f57a None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:39.890751 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d1f17-212d-4b7b-b16c-e75d4eb81817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:39.891545 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d1f17-212d-4b7b-b16c-e75d4eb81817 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:39.891799 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d1f17-212d-4b7b-b16c-e75d4eb81817 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:39.892110 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d1f17-212d-4b7b-b16c-e75d4eb81817 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:39.902705 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6232f957-dab0-4b2c-ae76-79d5e542676c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:39.903036 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6d1f17-212d-4b7b-b16c-e75d4eb81817 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:39.903582 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232f957-dab0-4b2c-ae76-79d5e542676c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:39.903869 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232f957-dab0-4b2c-ae76-79d5e542676c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:39.904122 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232f957-dab0-4b2c-ae76-79d5e542676c None admin] PATH_INFO: `/v3/users/fff7ba452aa541d8a53efa158c242eb3` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:39.910758 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-4d6d1f17-212d-4b7b-b16c-e75d4eb81817 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 12:07:39.910758 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:39.910758 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:39.910758 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:39.910758 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:39.910758 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:39.910758 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:39.910758 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:39.910758 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:39.910758 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:39.910758 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:39.910758 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:39.910758 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:39.910758 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:39.910758 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:39.910758 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:39.911748 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:39.911748 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:39.911748 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:39.911748 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:39.911748 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:39.911748 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:39.911748 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:39.911748 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:39.911748 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:39.911748 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:39.911748 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:39.911748 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:39.911748 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:39.911748 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:39.911748 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:39.911748 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:39.912754 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:39.912754 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:39.912754 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:39.912754 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:39.912754 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:39.912754 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:39.912754 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:39.912754 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:39.912754 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:39.912754 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:39.912754 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 12:07:39.912754 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:07:39.912754 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 97/191] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:07:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:39.914553 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d1f17-212d-4b7b-b16c-e75d4eb81817 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:39.919747 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6232f957-dab0-4b2c-ae76-79d5e542676c None admin] RBAC: Authorizing `identity:get_user(user_id=fff7ba452aa541d8a53efa158c242eb3)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:39.921213 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6232f957-dab0-4b2c-ae76-79d5e542676c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:39.923103 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 95/192] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jun 29 12:07:39 2022] GET /identity/v3/users/fff7ba452aa541d8a53efa158c242eb3 => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:39.923739 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6232f957-dab0-4b2c-ae76-79d5e542676c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:40.014090 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d1f17-212d-4b7b-b16c-e75d4eb81817 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:40.025573 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6232f957-dab0-4b2c-ae76-79d5e542676c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:40.027911 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:40.049396 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb024a-8b50-4699-9c98-8846089c8a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:40.050357 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb024a-8b50-4699-9c98-8846089c8a66 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:40.050687 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb024a-8b50-4699-9c98-8846089c8a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:40.051272 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb024a-8b50-4699-9c98-8846089c8a66 None admin] PATH_INFO: `/v3/projects/dcc3d4b81e0d470bab2492f8eb193665` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:40.052467 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cb024a-8b50-4699-9c98-8846089c8a66 None admin] RBAC: Authorizing `identity:get_project(project_id=dcc3d4b81e0d470bab2492f8eb193665)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:40.053714 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cb024a-8b50-4699-9c98-8846089c8a66 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:40.055461 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 98/193] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jun 29 12:07:39 2022] GET /identity/v3/projects/dcc3d4b81e0d470bab2492f8eb193665 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:40.056230 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb024a-8b50-4699-9c98-8846089c8a66 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:40.060842 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8359c8-a2f4-4e3a-bbf7-bc98f3adb5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:40.061763 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8359c8-a2f4-4e3a-bbf7-bc98f3adb5e9 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:40.062053 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8359c8-a2f4-4e3a-bbf7-bc98f3adb5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:40.062329 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8359c8-a2f4-4e3a-bbf7-bc98f3adb5e9 None admin] PATH_INFO: `/v3/users/fff7ba452aa541d8a53efa158c242eb3` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:40.063543 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8359c8-a2f4-4e3a-bbf7-bc98f3adb5e9 None admin] RBAC: Authorizing `identity:get_user(user_id=fff7ba452aa541d8a53efa158c242eb3)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:40.065005 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8359c8-a2f4-4e3a-bbf7-bc98f3adb5e9 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:40.071461 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 96/194] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jun 29 12:07:39 2022] GET /identity/v3/users/fff7ba452aa541d8a53efa158c242eb3 => generated 283 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:40.071461 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8359c8-a2f4-4e3a-bbf7-bc98f3adb5e9 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:40.110832 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:40.175835 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb024a-8b50-4699-9c98-8846089c8a66 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:40.176034 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8359c8-a2f4-4e3a-bbf7-bc98f3adb5e9 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:40.209382 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92093ce4-0bcc-4c1c-88f3-1ae45aff4f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:40.210098 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92093ce4-0bcc-4c1c-88f3-1ae45aff4f17 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:40.210382 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92093ce4-0bcc-4c1c-88f3-1ae45aff4f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:40.210525 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed900318-9585-4a1e-8522-e380aabd5211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:40.210646 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92093ce4-0bcc-4c1c-88f3-1ae45aff4f17 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:40.211235 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed900318-9585-4a1e-8522-e380aabd5211 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:40.211384 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92093ce4-0bcc-4c1c-88f3-1ae45aff4f17 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:40.211515 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed900318-9585-4a1e-8522-e380aabd5211 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:40.211684 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92093ce4-0bcc-4c1c-88f3-1ae45aff4f17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:40.211791 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed900318-9585-4a1e-8522-e380aabd5211 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:40.212980 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed900318-9585-4a1e-8522-e380aabd5211 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:40.213065 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92093ce4-0bcc-4c1c-88f3-1ae45aff4f17 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:40.214443 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed900318-9585-4a1e-8522-e380aabd5211 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:40.216071 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 99/195] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:40.221490 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed900318-9585-4a1e-8522-e380aabd5211 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:40.221635 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 97/196] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jun 29 12:07:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:40.222643 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92093ce4-0bcc-4c1c-88f3-1ae45aff4f17 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:40.256509 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:40.319453 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed900318-9585-4a1e-8522-e380aabd5211 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:40.323086 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92093ce4-0bcc-4c1c-88f3-1ae45aff4f17 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:40.327042 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:40.354395 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6977a91-7bd8-4101-b119-88a6ce568f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:40.355046 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6977a91-7bd8-4101-b119-88a6ce568f03 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:40.355324 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6977a91-7bd8-4101-b119-88a6ce568f03 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:40.355564 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610013c4-9d11-41c9-8645-01eecd7327db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:40.355668 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6977a91-7bd8-4101-b119-88a6ce568f03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:40.356222 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610013c4-9d11-41c9-8645-01eecd7327db None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:40.356496 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610013c4-9d11-41c9-8645-01eecd7327db None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:40.356822 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610013c4-9d11-41c9-8645-01eecd7327db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:40.357680 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610013c4-9d11-41c9-8645-01eecd7327db None admin] RBAC: Adding query filter params (role.id=c49accbc6f81447cb221ef720db04ced, scope.project.id=dcc3d4b81e0d470bab2492f8eb193665, user.id=444fe6680fcc4d189dc9e38aeebd3b11) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:40.358040 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610013c4-9d11-41c9-8645-01eecd7327db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:40.359463 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610013c4-9d11-41c9-8645-01eecd7327db None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:40.365593 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 98/197] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jun 29 12:07:40 2022] GET /identity/v3/role_assignments?user.id=444fe6680fcc4d189dc9e38aeebd3b11&scope.project.id=dcc3d4b81e0d470bab2492f8eb193665&role.id=c49accbc6f81447cb221ef720db04ced => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:40.366404 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610013c4-9d11-41c9-8645-01eecd7327db None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:40.436250 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6977a91-7bd8-4101-b119-88a6ce568f03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:40.437807 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6977a91-7bd8-4101-b119-88a6ce568f03 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:40.477924 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:40.484507 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610013c4-9d11-41c9-8645-01eecd7327db None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:40.529473 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ac3a4-2492-49d3-8e74-3f43ad9a38a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:40.530355 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ac3a4-2492-49d3-8e74-3f43ad9a38a9 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:40.530703 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ac3a4-2492-49d3-8e74-3f43ad9a38a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:40.531026 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ac3a4-2492-49d3-8e74-3f43ad9a38a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:40.558726 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 100/198] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:07:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:07:40.559574 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6977a91-7bd8-4101-b119-88a6ce568f03 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:40.570660 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:40.612773 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ac3a4-2492-49d3-8e74-3f43ad9a38a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:40.614334 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ac3a4-2492-49d3-8e74-3f43ad9a38a9 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:40.672300 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6977a91-7bd8-4101-b119-88a6ce568f03 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:40.712133 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5fa180-0f12-4584-8331-0cdae1a22a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:40.712866 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5fa180-0f12-4584-8331-0cdae1a22a09 None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:40.713092 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5fa180-0f12-4584-8331-0cdae1a22a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:40.713367 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5fa180-0f12-4584-8331-0cdae1a22a09 None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:40.713797 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:40.714126 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5fa180-0f12-4584-8331-0cdae1a22a09 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:40.715608 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5fa180-0f12-4584-8331-0cdae1a22a09 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:40.721832 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 99/199] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:07:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:07:40.722812 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ac3a4-2492-49d3-8e74-3f43ad9a38a9 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:40.736899 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 101/200] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Jun 29 12:07:40 2022] POST /identity/v3/users => generated 297 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:07:40.737753 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5fa180-0f12-4584-8331-0cdae1a22a09 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:40.826109 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:40.845248 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ac3a4-2492-49d3-8e74-3f43ad9a38a9 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:40.873136 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5fa180-0f12-4584-8331-0cdae1a22a09 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:40.883169 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90df0ae-301e-4771-83be-27ce7f4ebbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:40.884208 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90df0ae-301e-4771-83be-27ce7f4ebbdb None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:40.884490 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90df0ae-301e-4771-83be-27ce7f4ebbdb None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:40.884720 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90df0ae-301e-4771-83be-27ce7f4ebbdb None admin] PATH_INFO: `/v3/users/d15f02999f7c45cebd53d64fa8f390d2` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:40.886912 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90df0ae-301e-4771-83be-27ce7f4ebbdb None admin] RBAC: Authorizing `identity:get_user(user_id=d15f02999f7c45cebd53d64fa8f390d2)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:40.888493 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90df0ae-301e-4771-83be-27ce7f4ebbdb None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:40.890807 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 100/201] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jun 29 12:07:40 2022] GET /identity/v3/users/d15f02999f7c45cebd53d64fa8f390d2 => generated 289 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:40.891069 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90df0ae-301e-4771-83be-27ce7f4ebbdb None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:40.916877 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7147b3c-6648-4b6f-8539-bdba744b48bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:40.917800 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7147b3c-6648-4b6f-8539-bdba744b48bf None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:40.918087 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7147b3c-6648-4b6f-8539-bdba744b48bf None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:40.918380 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7147b3c-6648-4b6f-8539-bdba744b48bf None admin] PATH_INFO: `/v3/projects/e6ee9295413244e9b7233dd64100ffb7` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:40.919591 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7147b3c-6648-4b6f-8539-bdba744b48bf None admin] RBAC: Authorizing `identity:get_project(project_id=e6ee9295413244e9b7233dd64100ffb7)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:40.921089 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7147b3c-6648-4b6f-8539-bdba744b48bf None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:40.922894 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 102/202] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jun 29 12:07:40 2022] GET /identity/v3/projects/e6ee9295413244e9b7233dd64100ffb7 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:40.923615 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7147b3c-6648-4b6f-8539-bdba744b48bf None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:40.976168 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:41.022156 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90df0ae-301e-4771-83be-27ce7f4ebbdb None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:41.048410 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7147b3c-6648-4b6f-8539-bdba744b48bf None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:41.078505 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e20b7b9-1432-4d35-b45a-a7ee18bb0c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:41.079412 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20b7b9-1432-4d35-b45a-a7ee18bb0c5a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:41.079692 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20b7b9-1432-4d35-b45a-a7ee18bb0c5a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:41.079960 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20b7b9-1432-4d35-b45a-a7ee18bb0c5a None admin] PATH_INFO: `/v3/projects/e6ee9295413244e9b7233dd64100ffb7` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:41.081842 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e20b7b9-1432-4d35-b45a-a7ee18bb0c5a None admin] RBAC: Authorizing `identity:get_project(project_id=e6ee9295413244e9b7233dd64100ffb7)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:41.083369 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e20b7b9-1432-4d35-b45a-a7ee18bb0c5a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:41.085724 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 101/203] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jun 29 12:07:40 2022] GET /identity/v3/projects/e6ee9295413244e9b7233dd64100ffb7 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:41.087604 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e20b7b9-1432-4d35-b45a-a7ee18bb0c5a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:41.091965 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:41.100676 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc0e71c-5938-4df2-b84c-f5f221bba98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:41.101634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0e71c-5938-4df2-b84c-f5f221bba98f None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:41.101955 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0e71c-5938-4df2-b84c-f5f221bba98f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:41.102848 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0e71c-5938-4df2-b84c-f5f221bba98f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:41.186200 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc0e71c-5938-4df2-b84c-f5f221bba98f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:41.187771 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc0e71c-5938-4df2-b84c-f5f221bba98f None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:41.223731 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e20b7b9-1432-4d35-b45a-a7ee18bb0c5a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:41.268923 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce839b-d511-4cc2-a568-02339b5f53b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:41.269592 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce839b-d511-4cc2-a568-02339b5f53b4 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:41.269906 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce839b-d511-4cc2-a568-02339b5f53b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:41.270183 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce839b-d511-4cc2-a568-02339b5f53b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:41.271142 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce839b-d511-4cc2-a568-02339b5f53b4 None admin] RBAC: Adding query filter params (role.id=ea54879a52d24a47bada5629b6d8b456, scope.project.id=e6ee9295413244e9b7233dd64100ffb7, user.id=fff7ba452aa541d8a53efa158c242eb3) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:41.271469 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce839b-d511-4cc2-a568-02339b5f53b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:41.273052 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce839b-d511-4cc2-a568-02339b5f53b4 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:41.275585 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:41.285867 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 102/204] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jun 29 12:07:41 2022] GET /identity/v3/role_assignments?user.id=fff7ba452aa541d8a53efa158c242eb3&scope.project.id=e6ee9295413244e9b7233dd64100ffb7&role.id=ea54879a52d24a47bada5629b6d8b456 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:41.287411 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce839b-d511-4cc2-a568-02339b5f53b4 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:41.303921 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 103/205] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:07:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:07:41.309415 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc0e71c-5938-4df2-b84c-f5f221bba98f None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:41.381178 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:41.482032 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce839b-d511-4cc2-a568-02339b5f53b4 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:41.527777 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affeabe7-cf81-4c48-ad54-e5c26b74be77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:41.528449 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affeabe7-cf81-4c48-ad54-e5c26b74be77 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:41.528731 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affeabe7-cf81-4c48-ad54-e5c26b74be77 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:41.529013 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affeabe7-cf81-4c48-ad54-e5c26b74be77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:41.529890 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affeabe7-cf81-4c48-ad54-e5c26b74be77 None admin] RBAC: Adding query filter params (role.id=e0e69ac8a8bf4cc4baa6aa18f2fc9919, scope.project.id=e6ee9295413244e9b7233dd64100ffb7, user.id=fff7ba452aa541d8a53efa158c242eb3) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:41.530202 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affeabe7-cf81-4c48-ad54-e5c26b74be77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:41.531665 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affeabe7-cf81-4c48-ad54-e5c26b74be77 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:41.532165 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc0e71c-5938-4df2-b84c-f5f221bba98f None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:41.546101 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 103/206] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jun 29 12:07:41 2022] GET /identity/v3/role_assignments?user.id=fff7ba452aa541d8a53efa158c242eb3&scope.project.id=e6ee9295413244e9b7233dd64100ffb7&role.id=e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 259 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:41.576261 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f72a60-4485-443c-be01-8bbadf93d196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:41.577158 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f72a60-4485-443c-be01-8bbadf93d196 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:41.577436 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f72a60-4485-443c-be01-8bbadf93d196 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:41.577724 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f72a60-4485-443c-be01-8bbadf93d196 None admin] PATH_INFO: `/v3/projects/dcc3d4b81e0d470bab2492f8eb193665` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:41.582589 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f72a60-4485-443c-be01-8bbadf93d196 None admin] RBAC: Authorizing `identity:get_project(project_id=dcc3d4b81e0d470bab2492f8eb193665)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:41.584173 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f72a60-4485-443c-be01-8bbadf93d196 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:41.586515 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 104/207] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jun 29 12:07:41 2022] GET /identity/v3/projects/dcc3d4b81e0d470bab2492f8eb193665 => generated 298 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:41.592275 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affeabe7-cf81-4c48-ad54-e5c26b74be77 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:41.668861 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:41.713675 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affeabe7-cf81-4c48-ad54-e5c26b74be77 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:41.757552 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e6220-125b-48d0-9c88-989ac4511a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:41.758183 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e6220-125b-48d0-9c88-989ac4511a74 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:41.758464 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e6220-125b-48d0-9c88-989ac4511a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:41.758737 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e6220-125b-48d0-9c88-989ac4511a74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:41.759607 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36e6220-125b-48d0-9c88-989ac4511a74 None admin] RBAC: Adding query filter params (role.id=e2336723b86b456e95b87bce11e66e1c, scope.project.id=dcc3d4b81e0d470bab2492f8eb193665, user.id=d15f02999f7c45cebd53d64fa8f390d2) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:41.759919 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36e6220-125b-48d0-9c88-989ac4511a74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:41.761427 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36e6220-125b-48d0-9c88-989ac4511a74 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:41.768676 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 104/208] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jun 29 12:07:41 2022] GET /identity/v3/role_assignments?user.id=d15f02999f7c45cebd53d64fa8f390d2&scope.project.id=dcc3d4b81e0d470bab2492f8eb193665&role.id=e2336723b86b456e95b87bce11e66e1c => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:43.049670 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58fb66c-7ee2-49d5-94e5-cb56b6ee736b None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:43.050256 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58fb66c-7ee2-49d5-94e5-cb56b6ee736b None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:43.050256 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58fb66c-7ee2-49d5-94e5-cb56b6ee736b None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:43.051875 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 105/209] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:07:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:43.063518 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f043e-1c5f-4c7c-a3f3-c734a9b53257 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:43.064454 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f043e-1c5f-4c7c-a3f3-c734a9b53257 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:43.064920 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f043e-1c5f-4c7c-a3f3-c734a9b53257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:43.087219 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-ab5f043e-1c5f-4c7c-a3f3-c734a9b53257 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:43.089543 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ab5f043e-1c5f-4c7c-a3f3-c734a9b53257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:43.174669 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986d50f-58cd-44ad-865c-65b9deef1869 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:43.175352 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986d50f-58cd-44ad-865c-65b9deef1869 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:43.175827 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986d50f-58cd-44ad-865c-65b9deef1869 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:43.177875 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 106/210] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:07:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:07:43.182740 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc502cb-0634-457c-aff9-b2d7f1defae3 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:43.183241 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc502cb-0634-457c-aff9-b2d7f1defae3 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:43.183652 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 105/211] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:43.183944 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc502cb-0634-457c-aff9-b2d7f1defae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:43.201660 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-2bc502cb-0634-457c-aff9-b2d7f1defae3 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:43.203195 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-2bc502cb-0634-457c-aff9-b2d7f1defae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:43.207001 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f043e-1c5f-4c7c-a3f3-c734a9b53257 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:43.266813 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:43.274032 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 107/212] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 12:07:43.298881 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc502cb-0634-457c-aff9-b2d7f1defae3 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:43.319183 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f043e-1c5f-4c7c-a3f3-c734a9b53257 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:43.328534 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:43.360174 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e757636-54d6-4c35-9acd-dff8a4fc3351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:43.361667 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e757636-54d6-4c35-9acd-dff8a4fc3351 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:43.362454 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e757636-54d6-4c35-9acd-dff8a4fc3351 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:43.363338 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e757636-54d6-4c35-9acd-dff8a4fc3351 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:43.377900 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e757636-54d6-4c35-9acd-dff8a4fc3351 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:43.388972 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-7e757636-54d6-4c35-9acd-dff8a4fc3351 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:07:43.388972 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:43.388972 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:43.388972 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:43.388972 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:43.388972 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:43.388972 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:43.388972 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:43.388972 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:43.388972 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:43.388972 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:43.388972 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:43.388972 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:43.388972 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:43.388972 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:43.388972 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:43.389924 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:43.389924 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:43.389924 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:43.389924 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:43.389924 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:43.389924 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:43.389924 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:43.389924 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:43.389924 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:43.389924 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:43.389924 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:43.389924 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:43.389924 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:43.389924 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:43.389924 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:43.389924 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:43.390736 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:43.390736 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:43.390736 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:43.390736 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:43.390736 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:43.390736 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:43.390736 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:43.390736 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:43.390736 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:43.390736 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:43.390736 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:07:43.390736 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:07:43.394222 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 106/213] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:07:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:07:43.398403 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e757636-54d6-4c35-9acd-dff8a4fc3351 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:43.417435 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc502cb-0634-457c-aff9-b2d7f1defae3 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:43.457144 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6717a13-673d-4422-a993-0a3f5a5ece5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:43.458172 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6717a13-673d-4422-a993-0a3f5a5ece5b None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:43.458694 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6717a13-673d-4422-a993-0a3f5a5ece5b None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:43.459027 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6717a13-673d-4422-a993-0a3f5a5ece5b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:43.460715 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6717a13-673d-4422-a993-0a3f5a5ece5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:43.462458 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6717a13-673d-4422-a993-0a3f5a5ece5b None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:43.465609 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 108/214] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:07:43.470418 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6717a13-673d-4422-a993-0a3f5a5ece5b None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:43.538417 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e757636-54d6-4c35-9acd-dff8a4fc3351 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:43.555790 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:43.579064 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743bd15-8cb2-4b48-bc41-b9bc6b909bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:43.579665 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743bd15-8cb2-4b48-bc41-b9bc6b909bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:43.580353 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743bd15-8cb2-4b48-bc41-b9bc6b909bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:43.580639 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743bd15-8cb2-4b48-bc41-b9bc6b909bb6 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:43.581400 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2743bd15-8cb2-4b48-bc41-b9bc6b909bb6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:43.581729 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2743bd15-8cb2-4b48-bc41-b9bc6b909bb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:43.583126 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2743bd15-8cb2-4b48-bc41-b9bc6b909bb6 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:43.587185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:43.593441 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6717a13-673d-4422-a993-0a3f5a5ece5b None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:43.596083 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 107/215] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jun 29 12:07:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:43.597581 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a6b79-570d-4fdc-8b14-c28cbbc0f1d4 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:43.597926 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a6b79-570d-4fdc-8b14-c28cbbc0f1d4 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:43.598193 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a6b79-570d-4fdc-8b14-c28cbbc0f1d4 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:43.601858 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 108/216] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:07:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:43.601858 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a6b79-570d-4fdc-8b14-c28cbbc0f1d4 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:43.636199 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26dfe49-1a0c-46c2-af08-7b6beb05ad97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:43.637145 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26dfe49-1a0c-46c2-af08-7b6beb05ad97 None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:43.637495 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26dfe49-1a0c-46c2-af08-7b6beb05ad97 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:43.637736 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26dfe49-1a0c-46c2-af08-7b6beb05ad97 None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:43.638470 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26dfe49-1a0c-46c2-af08-7b6beb05ad97 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:43.640069 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26dfe49-1a0c-46c2-af08-7b6beb05ad97 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:43.663989 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 109/217] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Jun 29 12:07:43 2022] POST /identity/v3/users => generated 297 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:07:43.665154 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980805a-b2e9-434d-9ec8-5a24b40516fb None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:43.665462 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980805a-b2e9-434d-9ec8-5a24b40516fb None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:43.665777 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980805a-b2e9-434d-9ec8-5a24b40516fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:43.684547 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-c980805a-b2e9-434d-9ec8-5a24b40516fb None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:43.685878 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-c980805a-b2e9-434d-9ec8-5a24b40516fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:43.731929 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a6b79-570d-4fdc-8b14-c28cbbc0f1d4 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:43.760641 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 110/218] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:43.767293 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5a1ad-248c-4e27-af44-b7ba5751bdec None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:43.767588 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5a1ad-248c-4e27-af44-b7ba5751bdec None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:43.767849 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5a1ad-248c-4e27-af44-b7ba5751bdec None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:43.769300 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 111/219] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:07:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:43.777835 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103cfc5f-381e-44e4-9a1d-b0638aeb33f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:43.779131 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103cfc5f-381e-44e4-9a1d-b0638aeb33f4 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:43.779378 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d14adc-06bf-4165-bedc-6c3c1fd9a16d None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:43.779679 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d14adc-06bf-4165-bedc-6c3c1fd9a16d None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:43.779962 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d14adc-06bf-4165-bedc-6c3c1fd9a16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:43.780244 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103cfc5f-381e-44e4-9a1d-b0638aeb33f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:43.780710 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103cfc5f-381e-44e4-9a1d-b0638aeb33f4 None admin] PATH_INFO: `/v3/users/f900512326c141e48338cff8511795aa` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:43.798862 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103cfc5f-381e-44e4-9a1d-b0638aeb33f4 None admin] RBAC: Authorizing `identity:get_user(user_id=f900512326c141e48338cff8511795aa)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:43.800385 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103cfc5f-381e-44e4-9a1d-b0638aeb33f4 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:43.800488 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-f8d14adc-06bf-4165-bedc-6c3c1fd9a16d None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:43.801618 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-f8d14adc-06bf-4165-bedc-6c3c1fd9a16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:43.802401 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 109/220] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jun 29 12:07:43 2022] GET /identity/v3/users/f900512326c141e48338cff8511795aa => generated 297 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:43.803037 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103cfc5f-381e-44e4-9a1d-b0638aeb33f4 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:43.853714 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:43.876151 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 112/221] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:43.877310 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d14adc-06bf-4165-bedc-6c3c1fd9a16d None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:43.893176 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:43.933932 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103cfc5f-381e-44e4-9a1d-b0638aeb33f4 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:43.977253 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077de10d-3354-4466-8415-d47e46e37c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:43.978180 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077de10d-3354-4466-8415-d47e46e37c23 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:43.978556 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077de10d-3354-4466-8415-d47e46e37c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:43.978902 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077de10d-3354-4466-8415-d47e46e37c23 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:43.991314 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077de10d-3354-4466-8415-d47e46e37c23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:43.999572 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-077de10d-3354-4466-8415-d47e46e37c23 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 12:07:43.999572 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:43.999572 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:43.999572 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:43.999572 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:43.999572 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:43.999572 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:43.999572 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:43.999572 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:43.999572 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:43.999572 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:43.999572 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:43.999572 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:43.999572 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:43.999572 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:43.999572 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:44.000692 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:44.000692 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:44.000692 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:44.000692 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:44.000692 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:44.000692 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:44.000692 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:44.000692 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:44.000692 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:44.000692 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:44.000692 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:44.000692 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:44.000692 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:44.000692 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:44.000692 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:44.000692 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:44.001825 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:44.001825 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:44.001825 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:44.001825 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:44.001825 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:44.001825 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:44.001825 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:44.001825 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:44.001825 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:44.001825 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:44.001825 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 12:07:44.001825 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:07:44.001825 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 110/222] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jun 29 12:07:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:44.001825 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077de10d-3354-4466-8415-d47e46e37c23 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:44.003663 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d14adc-06bf-4165-bedc-6c3c1fd9a16d None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:44.046522 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57071cc-2c76-4f19-90f3-1e9baa5cc3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:44.047484 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57071cc-2c76-4f19-90f3-1e9baa5cc3b1 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:44.047906 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57071cc-2c76-4f19-90f3-1e9baa5cc3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:44.048344 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57071cc-2c76-4f19-90f3-1e9baa5cc3b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:44.125443 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077de10d-3354-4466-8415-d47e46e37c23 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:44.130291 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57071cc-2c76-4f19-90f3-1e9baa5cc3b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:44.131999 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57071cc-2c76-4f19-90f3-1e9baa5cc3b1 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:44.150313 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:44.154138 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:44.163924 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d38c50f-b350-4093-bc9c-2317c682b02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:44.164820 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38c50f-b350-4093-bc9c-2317c682b02d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:44.165180 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38c50f-b350-4093-bc9c-2317c682b02d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:44.165529 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38c50f-b350-4093-bc9c-2317c682b02d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:44.178325 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d38c50f-b350-4093-bc9c-2317c682b02d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:44.187057 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-3d38c50f-b350-4093-bc9c-2317c682b02d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:07:44.187057 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:44.187057 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:44.187057 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:44.187057 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:44.187057 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:44.187057 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:44.187057 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:44.187057 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:44.187057 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:44.187057 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:44.187057 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:44.187057 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:44.187057 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:44.187057 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:44.187057 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:44.188148 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:44.188148 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:44.188148 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:44.188148 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:44.188148 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:44.188148 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:44.188148 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:44.188148 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:44.188148 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:44.188148 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:44.188148 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:44.188148 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:44.188148 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:44.188148 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:44.188148 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:44.188148 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:44.189163 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:44.189163 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:44.189163 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:44.189163 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:44.189163 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:44.189163 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:44.189163 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:44.189163 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:44.189163 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:44.189163 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:44.189163 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:07:44.189163 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:07:44.190955 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 111/223] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jun 29 12:07:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:44.191747 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d38c50f-b350-4093-bc9c-2317c682b02d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:44.253814 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 113/224] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:07:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:07:44.254685 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57071cc-2c76-4f19-90f3-1e9baa5cc3b1 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:44.325453 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d38c50f-b350-4093-bc9c-2317c682b02d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:44.363972 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a120a6d-4a94-46a6-99a8-d4b24fb4422b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:44.364646 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a120a6d-4a94-46a6-99a8-d4b24fb4422b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:44.364980 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a120a6d-4a94-46a6-99a8-d4b24fb4422b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:44.365446 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a120a6d-4a94-46a6-99a8-d4b24fb4422b None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:44.366586 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a120a6d-4a94-46a6-99a8-d4b24fb4422b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:44.366900 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a120a6d-4a94-46a6-99a8-d4b24fb4422b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:44.368304 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a120a6d-4a94-46a6-99a8-d4b24fb4422b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:44.377648 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 112/225] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jun 29 12:07:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:44.378563 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a120a6d-4a94-46a6-99a8-d4b24fb4422b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:44.385428 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57071cc-2c76-4f19-90f3-1e9baa5cc3b1 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:44.399405 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:44.401569 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:44.427586 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30181f9-1d90-48b7-8497-177fc89a382b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:44.429049 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30181f9-1d90-48b7-8497-177fc89a382b None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:44.429331 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30181f9-1d90-48b7-8497-177fc89a382b None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:44.429599 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30181f9-1d90-48b7-8497-177fc89a382b None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:44.430488 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30181f9-1d90-48b7-8497-177fc89a382b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:44.430793 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30181f9-1d90-48b7-8497-177fc89a382b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:44.432235 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30181f9-1d90-48b7-8497-177fc89a382b None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:44.441455 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 114/226] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:07:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:44.447436 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30181f9-1d90-48b7-8497-177fc89a382b None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:44.494190 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a120a6d-4a94-46a6-99a8-d4b24fb4422b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:44.537570 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2680462-78bf-4532-92ce-59485a43e0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:44.538494 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2680462-78bf-4532-92ce-59485a43e0a7 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:44.539019 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2680462-78bf-4532-92ce-59485a43e0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:44.539296 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2680462-78bf-4532-92ce-59485a43e0a7 None admin] PATH_INFO: `/v3/projects/e6ee9295413244e9b7233dd64100ffb7` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:44.540613 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2680462-78bf-4532-92ce-59485a43e0a7 None admin] RBAC: Authorizing `identity:get_project(project_id=e6ee9295413244e9b7233dd64100ffb7)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:44.542093 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2680462-78bf-4532-92ce-59485a43e0a7 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:44.544329 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 113/227] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jun 29 12:07:44 2022] GET /identity/v3/projects/e6ee9295413244e9b7233dd64100ffb7 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:44.545114 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2680462-78bf-4532-92ce-59485a43e0a7 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:44.564268 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30181f9-1d90-48b7-8497-177fc89a382b None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:44.603735 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba8ca2d-2fca-4950-a8c3-b05ccf4befed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:44.604624 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba8ca2d-2fca-4950-a8c3-b05ccf4befed None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:44.604902 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba8ca2d-2fca-4950-a8c3-b05ccf4befed None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:44.605272 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba8ca2d-2fca-4950-a8c3-b05ccf4befed None admin] PATH_INFO: `/v3/users/fff7ba452aa541d8a53efa158c242eb3` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:44.606602 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba8ca2d-2fca-4950-a8c3-b05ccf4befed None admin] RBAC: Authorizing `identity:get_user(user_id=fff7ba452aa541d8a53efa158c242eb3)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:44.608083 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba8ca2d-2fca-4950-a8c3-b05ccf4befed None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:44.610151 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 115/228] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jun 29 12:07:44 2022] GET /identity/v3/users/fff7ba452aa541d8a53efa158c242eb3 => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:44.610737 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba8ca2d-2fca-4950-a8c3-b05ccf4befed None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:44.636941 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:44.653890 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2680462-78bf-4532-92ce-59485a43e0a7 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:44.661204 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:44.692059 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c447606-ee43-4252-80f2-5b3df04827b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:44.693182 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c447606-ee43-4252-80f2-5b3df04827b6 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:44.693503 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c447606-ee43-4252-80f2-5b3df04827b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:44.693868 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c447606-ee43-4252-80f2-5b3df04827b6 None admin] PATH_INFO: `/v3/users/fff7ba452aa541d8a53efa158c242eb3` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:44.695169 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c447606-ee43-4252-80f2-5b3df04827b6 None admin] RBAC: Authorizing `identity:get_user(user_id=fff7ba452aa541d8a53efa158c242eb3)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:44.696683 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c447606-ee43-4252-80f2-5b3df04827b6 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:44.698897 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 114/229] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jun 29 12:07:44 2022] GET /identity/v3/users/fff7ba452aa541d8a53efa158c242eb3 => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:44.699529 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c447606-ee43-4252-80f2-5b3df04827b6 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:44.730420 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba8ca2d-2fca-4950-a8c3-b05ccf4befed None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:44.766938 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321e71c6-d9cb-487b-b5fb-41de6b0a1077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:44.767592 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e71c6-d9cb-487b-b5fb-41de6b0a1077 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:44.767868 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e71c6-d9cb-487b-b5fb-41de6b0a1077 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:44.768136 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e71c6-d9cb-487b-b5fb-41de6b0a1077 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:44.769067 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321e71c6-d9cb-487b-b5fb-41de6b0a1077 None admin] RBAC: Adding query filter params (role.id=c49accbc6f81447cb221ef720db04ced, scope.project.id=e6ee9295413244e9b7233dd64100ffb7, user.id=f900512326c141e48338cff8511795aa) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:44.769375 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321e71c6-d9cb-487b-b5fb-41de6b0a1077 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:44.770948 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321e71c6-d9cb-487b-b5fb-41de6b0a1077 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:44.777264 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 116/230] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jun 29 12:07:44 2022] GET /identity/v3/role_assignments?user.id=f900512326c141e48338cff8511795aa&scope.project.id=e6ee9295413244e9b7233dd64100ffb7&role.id=c49accbc6f81447cb221ef720db04ced => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:44.778072 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321e71c6-d9cb-487b-b5fb-41de6b0a1077 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:44.806919 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c447606-ee43-4252-80f2-5b3df04827b6 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:44.846790 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a49a3-ad38-43ac-8a0c-7e431dc1ced9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:44.847668 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a49a3-ad38-43ac-8a0c-7e431dc1ced9 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:44.848017 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a49a3-ad38-43ac-8a0c-7e431dc1ced9 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:44.848299 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a49a3-ad38-43ac-8a0c-7e431dc1ced9 None admin] PATH_INFO: `/v3/projects/e6ee9295413244e9b7233dd64100ffb7` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:44.850223 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473a49a3-ad38-43ac-8a0c-7e431dc1ced9 None admin] RBAC: Authorizing `identity:get_project(project_id=e6ee9295413244e9b7233dd64100ffb7)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:44.851888 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473a49a3-ad38-43ac-8a0c-7e431dc1ced9 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:44.854122 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 115/231] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jun 29 12:07:44 2022] GET /identity/v3/projects/e6ee9295413244e9b7233dd64100ffb7 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:44.859611 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a49a3-ad38-43ac-8a0c-7e431dc1ced9 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:44.898488 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:44.904331 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321e71c6-d9cb-487b-b5fb-41de6b0a1077 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:44.914326 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:44.958432 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a44949-7cec-4ba7-9ba8-ce6dedb179fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:44.960077 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a44949-7cec-4ba7-9ba8-ce6dedb179fc None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:44.960591 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a44949-7cec-4ba7-9ba8-ce6dedb179fc None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:44.960970 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a44949-7cec-4ba7-9ba8-ce6dedb179fc None admin] PATH_INFO: `/v3/projects/e6ee9295413244e9b7233dd64100ffb7` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:44.962642 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a44949-7cec-4ba7-9ba8-ce6dedb179fc None admin] RBAC: Authorizing `identity:get_project(project_id=e6ee9295413244e9b7233dd64100ffb7)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:44.965306 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a44949-7cec-4ba7-9ba8-ce6dedb179fc None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:44.967319 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 117/232] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jun 29 12:07:44 2022] GET /identity/v3/projects/e6ee9295413244e9b7233dd64100ffb7 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:44.973907 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a44949-7cec-4ba7-9ba8-ce6dedb179fc None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:45.029255 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a49a3-ad38-43ac-8a0c-7e431dc1ced9 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:45.106910 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a44949-7cec-4ba7-9ba8-ce6dedb179fc None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:45.130445 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b7996-ce02-47d5-958f-9e49bbc834f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:45.131682 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b7996-ce02-47d5-958f-9e49bbc834f5 None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:45.132040 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b7996-ce02-47d5-958f-9e49bbc834f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:45.132321 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b7996-ce02-47d5-958f-9e49bbc834f5 None admin] PATH_INFO: `/v3/projects/e6ee9295413244e9b7233dd64100ffb7/users/fff7ba452aa541d8a53efa158c242eb3/roles/ea54879a52d24a47bada5629b6d8b456` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:45.139157 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2b7996-ce02-47d5-958f-9e49bbc834f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=e6ee9295413244e9b7233dd64100ffb7, user_id=fff7ba452aa541d8a53efa158c242eb3, role_id=ea54879a52d24a47bada5629b6d8b456)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:45.140648 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2b7996-ce02-47d5-958f-9e49bbc834f5 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:45.144793 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e047385-c92e-4a99-81dc-26bed15ffb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:45.145736 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e047385-c92e-4a99-81dc-26bed15ffb31 None admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:45.145995 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e047385-c92e-4a99-81dc-26bed15ffb31 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:45.146435 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e047385-c92e-4a99-81dc-26bed15ffb31 None admin] PATH_INFO: `/v3/projects/e6ee9295413244e9b7233dd64100ffb7/users/fff7ba452aa541d8a53efa158c242eb3/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:45.148801 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e047385-c92e-4a99-81dc-26bed15ffb31 None admin] RBAC: Authorizing `identity:create_grant(project_id=e6ee9295413244e9b7233dd64100ffb7, user_id=fff7ba452aa541d8a53efa158c242eb3, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:45.150241 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e047385-c92e-4a99-81dc-26bed15ffb31 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:45.177581 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 116/233] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jun 29 12:07:44 2022] PUT /identity/v3/projects/e6ee9295413244e9b7233dd64100ffb7/users/fff7ba452aa541d8a53efa158c242eb3/roles/ea54879a52d24a47bada5629b6d8b456 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:07:45.177967 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 118/234] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jun 29 12:07:44 2022] PUT /identity/v3/projects/e6ee9295413244e9b7233dd64100ffb7/users/fff7ba452aa541d8a53efa158c242eb3/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:07:46.146681 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8f1f6-795b-45d4-b7eb-7966674e6516 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:46.147763 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8f1f6-795b-45d4-b7eb-7966674e6516 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:46.148228 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8f1f6-795b-45d4-b7eb-7966674e6516 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:46.150112 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 117/235] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:07:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:46.155024 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99007aa3-ab3f-44f8-95a5-9a6f0395b745 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:46.155834 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99007aa3-ab3f-44f8-95a5-9a6f0395b745 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:46.156315 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99007aa3-ab3f-44f8-95a5-9a6f0395b745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:46.173611 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-99007aa3-ab3f-44f8-95a5-9a6f0395b745 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:46.179185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-99007aa3-ab3f-44f8-95a5-9a6f0395b745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:46.212354 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:46.272429 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 119/236] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:46.310033 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc8f1f6-795b-45d4-b7eb-7966674e6516 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:46.375263 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f6ea7-4e77-4051-b2db-c821ad7f6b86 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:46.375593 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f6ea7-4e77-4051-b2db-c821ad7f6b86 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:46.375823 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f6ea7-4e77-4051-b2db-c821ad7f6b86 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:46.377834 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 120/237] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:07:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:07:46.382427 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5e3c0-0472-437b-b7b7-46b22da71f26 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:46.382717 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5e3c0-0472-437b-b7b7-46b22da71f26 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:46.382996 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5e3c0-0472-437b-b7b7-46b22da71f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:46.410106 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:46.410689 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-44b5e3c0-0472-437b-b7b7-46b22da71f26 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:46.412087 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-44b5e3c0-0472-437b-b7b7-46b22da71f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:46.436306 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc8f1f6-795b-45d4-b7eb-7966674e6516 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:46.519369 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e85afd-e881-4531-8837-caad3c30b307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:46.520384 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e85afd-e881-4531-8837-caad3c30b307 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:46.520492 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e85afd-e881-4531-8837-caad3c30b307 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:46.520724 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e85afd-e881-4531-8837-caad3c30b307 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:46.525783 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 121/238] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 12:07:46.526463 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e85afd-e881-4531-8837-caad3c30b307 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:46.527957 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e85afd-e881-4531-8837-caad3c30b307 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:46.529790 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 118/239] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:46.538231 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b5e3c0-0472-437b-b7b7-46b22da71f26 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:46.550845 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e85afd-e881-4531-8837-caad3c30b307 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:46.668457 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e85afd-e881-4531-8837-caad3c30b307 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:46.687511 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:46.694953 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b5e3c0-0472-437b-b7b7-46b22da71f26 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:46.718281 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9b0cb-37d7-4d5f-810b-5d39723377df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:46.719099 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9b0cb-37d7-4d5f-810b-5d39723377df None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:46.719378 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9b0cb-37d7-4d5f-810b-5d39723377df None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:46.719646 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9b0cb-37d7-4d5f-810b-5d39723377df None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:46.739685 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e9b0cb-37d7-4d5f-810b-5d39723377df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:46.747763 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53ff87-dec8-4ce4-88b4-f23f4b25a9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:46.748457 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53ff87-dec8-4ce4-88b4-f23f4b25a9d3 None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:46.748735 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53ff87-dec8-4ce4-88b4-f23f4b25a9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:46.749002 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53ff87-dec8-4ce4-88b4-f23f4b25a9d3 None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:46.749713 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-64e9b0cb-37d7-4d5f-810b-5d39723377df None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 12:07:46.749713 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:46.749713 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:46.749713 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:46.749713 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:46.749713 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:46.749713 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:46.749713 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:46.749713 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:46.749713 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:46.749713 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:46.749713 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:46.749713 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:46.749713 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:46.749713 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:46.749713 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:46.750594 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:46.750594 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:46.750594 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:46.750594 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:46.750594 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:46.750594 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:46.750594 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:46.750594 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:46.750594 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:46.750594 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:46.750594 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:46.750594 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:46.750594 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:46.750594 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:46.750594 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:46.750594 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:46.751390 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:46.751390 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:46.751390 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:46.751390 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:46.751390 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:46.751390 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:46.751390 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:46.751390 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:46.751390 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:46.751390 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:46.751390 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 12:07:46.751390 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:07:46.752001 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce53ff87-dec8-4ce4-88b4-f23f4b25a9d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:46.752001 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce53ff87-dec8-4ce4-88b4-f23f4b25a9d3 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:46.754040 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 119/240] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:07:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:46.760197 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9b0cb-37d7-4d5f-810b-5d39723377df None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:46.776970 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:46.804498 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 122/241] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Jun 29 12:07:46 2022] POST /identity/v3/users => generated 293 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:07:46.914311 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9b0cb-37d7-4d5f-810b-5d39723377df None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:46.950338 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb87af-c17f-4250-ba40-5677a2340025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:46.951730 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb87af-c17f-4250-ba40-5677a2340025 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:46.952208 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb87af-c17f-4250-ba40-5677a2340025 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:46.952690 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb87af-c17f-4250-ba40-5677a2340025 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:46.953643 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bb87af-c17f-4250-ba40-5677a2340025 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:46.954164 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bb87af-c17f-4250-ba40-5677a2340025 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:46.955747 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bb87af-c17f-4250-ba40-5677a2340025 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:46.969318 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 120/242] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jun 29 12:07:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:07:46.975682 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53ff87-dec8-4ce4-88b4-f23f4b25a9d3 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:47.108697 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4a211-5eb1-4c47-a226-07964233daf7 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:47.108989 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4a211-5eb1-4c47-a226-07964233daf7 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:47.109267 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4a211-5eb1-4c47-a226-07964233daf7 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:47.110988 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 121/243] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:07:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:47.119572 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80488f0c-7da7-4141-891a-5df33639b14b None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:47.119860 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80488f0c-7da7-4141-891a-5df33639b14b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:47.120288 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80488f0c-7da7-4141-891a-5df33639b14b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:47.123001 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53ff87-dec8-4ce4-88b4-f23f4b25a9d3 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:47.142169 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-80488f0c-7da7-4141-891a-5df33639b14b None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:47.143409 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-80488f0c-7da7-4141-891a-5df33639b14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:47.174356 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145302f4-d33f-4a89-8f22-3c077643fd37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:47.175354 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145302f4-d33f-4a89-8f22-3c077643fd37 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:47.175640 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145302f4-d33f-4a89-8f22-3c077643fd37 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:47.175914 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145302f4-d33f-4a89-8f22-3c077643fd37 None admin] PATH_INFO: `/v3/users/c28ec579daf646b591ab6b4517d845a5` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:47.194499 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145302f4-d33f-4a89-8f22-3c077643fd37 None admin] RBAC: Authorizing `identity:get_user(user_id=c28ec579daf646b591ab6b4517d845a5)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:47.196810 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145302f4-d33f-4a89-8f22-3c077643fd37 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:47.199143 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 123/244] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jun 29 12:07:46 2022] GET /identity/v3/users/c28ec579daf646b591ab6b4517d845a5 => generated 297 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:07:47.205613 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145302f4-d33f-4a89-8f22-3c077643fd37 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:47.219886 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:47.250611 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 122/245] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:47.279235 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80488f0c-7da7-4141-891a-5df33639b14b None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:47.281508 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:47.344894 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145302f4-d33f-4a89-8f22-3c077643fd37 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:47.385874 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978a0bf-a3b9-4485-8170-64d8fa6d77f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:47.386907 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978a0bf-a3b9-4485-8170-64d8fa6d77f8 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:47.387193 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978a0bf-a3b9-4485-8170-64d8fa6d77f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:47.387470 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978a0bf-a3b9-4485-8170-64d8fa6d77f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:47.403299 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80488f0c-7da7-4141-891a-5df33639b14b None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:47.463605 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b4d41-fc76-42ae-a230-d0e0c94b3901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:47.464333 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b4d41-fc76-42ae-a230-d0e0c94b3901 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:47.464612 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b4d41-fc76-42ae-a230-d0e0c94b3901 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:47.464880 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b4d41-fc76-42ae-a230-d0e0c94b3901 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:47.479469 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4b4d41-fc76-42ae-a230-d0e0c94b3901 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:47.485961 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c978a0bf-a3b9-4485-8170-64d8fa6d77f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:47.487453 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c978a0bf-a3b9-4485-8170-64d8fa6d77f8 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:47.488189 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-8f4b4d41-fc76-42ae-a230-d0e0c94b3901 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:07:47.488189 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:47.488189 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:47.488189 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:47.488189 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:47.488189 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:47.488189 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:47.488189 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:47.488189 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:47.488189 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:47.488189 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:47.488189 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:47.488189 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:47.488189 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:47.488189 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:47.488189 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:47.489067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:47.489067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:47.489067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:47.489067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:47.489067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:47.489067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:47.489067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:47.489067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:47.489067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:47.489067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:47.489067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:47.489067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:47.489067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:47.489067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:47.489067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:47.489067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:47.490465 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:47.490465 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:47.490465 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:47.490465 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:47.490465 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:47.490465 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:47.490465 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:47.490465 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:47.490465 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:47.490465 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:47.490465 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:07:47.490465 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:07:47.490465 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 123/246] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:07:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:47.496283 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b4d41-fc76-42ae-a230-d0e0c94b3901 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:47.499877 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:47.564641 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:47.593590 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 124/247] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:07:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 29 12:07:47.602856 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978a0bf-a3b9-4485-8170-64d8fa6d77f8 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:47.609026 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b4d41-fc76-42ae-a230-d0e0c94b3901 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:47.645616 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f97703-d595-47dd-bfec-d6a9a2a069b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:47.646554 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f97703-d595-47dd-bfec-d6a9a2a069b7 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:47.646868 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f97703-d595-47dd-bfec-d6a9a2a069b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:47.647233 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f97703-d595-47dd-bfec-d6a9a2a069b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:47.647979 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f97703-d595-47dd-bfec-d6a9a2a069b7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:47.648292 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f97703-d595-47dd-bfec-d6a9a2a069b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:47.649722 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f97703-d595-47dd-bfec-d6a9a2a069b7 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:47.659282 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 124/248] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jun 29 12:07:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:07:47.665112 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f97703-d595-47dd-bfec-d6a9a2a069b7 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:47.757258 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978a0bf-a3b9-4485-8170-64d8fa6d77f8 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:47.775048 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f97703-d595-47dd-bfec-d6a9a2a069b7 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:47.776137 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:47.800057 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:47.811993 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bbcf75-566e-4182-9a97-15a3ba59ffc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:47.816027 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bbcf75-566e-4182-9a97-15a3ba59ffc0 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:47.816027 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bbcf75-566e-4182-9a97-15a3ba59ffc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:47.816027 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bbcf75-566e-4182-9a97-15a3ba59ffc0 None admin] PATH_INFO: `/v3/users/f900512326c141e48338cff8511795aa` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:47.816027 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bbcf75-566e-4182-9a97-15a3ba59ffc0 None admin] RBAC: Authorizing `identity:get_user(user_id=f900512326c141e48338cff8511795aa)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:47.816338 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bbcf75-566e-4182-9a97-15a3ba59ffc0 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:47.818560 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 125/249] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jun 29 12:07:47 2022] GET /identity/v3/users/f900512326c141e48338cff8511795aa => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:47.824125 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bbcf75-566e-4182-9a97-15a3ba59ffc0 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:47.824989 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854458bd-1573-4874-95b4-cc3fe8f2e503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:47.826563 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854458bd-1573-4874-95b4-cc3fe8f2e503 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:47.827142 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854458bd-1573-4874-95b4-cc3fe8f2e503 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:47.827608 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854458bd-1573-4874-95b4-cc3fe8f2e503 None admin] PATH_INFO: `/v3/projects/e6ee9295413244e9b7233dd64100ffb7` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:47.834814 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854458bd-1573-4874-95b4-cc3fe8f2e503 None admin] RBAC: Authorizing `identity:get_project(project_id=e6ee9295413244e9b7233dd64100ffb7)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:47.836697 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854458bd-1573-4874-95b4-cc3fe8f2e503 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:47.839218 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 125/250] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jun 29 12:07:47 2022] GET /identity/v3/projects/e6ee9295413244e9b7233dd64100ffb7 => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:47.845609 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854458bd-1573-4874-95b4-cc3fe8f2e503 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:47.949619 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bbcf75-566e-4182-9a97-15a3ba59ffc0 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:47.990618 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c5fc3-e2f8-4e09-a7cc-b78368e11543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:47.992043 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c5fc3-e2f8-4e09-a7cc-b78368e11543 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:47.992546 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c5fc3-e2f8-4e09-a7cc-b78368e11543 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:47.993012 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c5fc3-e2f8-4e09-a7cc-b78368e11543 None admin] PATH_INFO: `/v3/projects/e6ee9295413244e9b7233dd64100ffb7` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:47.994483 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c5fc3-e2f8-4e09-a7cc-b78368e11543 None admin] RBAC: Authorizing `identity:get_project(project_id=e6ee9295413244e9b7233dd64100ffb7)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:47.996331 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c5fc3-e2f8-4e09-a7cc-b78368e11543 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:47.998794 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 126/251] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jun 29 12:07:47 2022] GET /identity/v3/projects/e6ee9295413244e9b7233dd64100ffb7 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:07:48.000362 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571395bd-17cc-474f-b4f5-e6d85e64fe2b None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:48.000848 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571395bd-17cc-474f-b4f5-e6d85e64fe2b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:48.001329 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571395bd-17cc-474f-b4f5-e6d85e64fe2b None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:48.006971 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 127/252] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:07:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:48.008083 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571395bd-17cc-474f-b4f5-e6d85e64fe2b None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:48.025083 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854458bd-1573-4874-95b4-cc3fe8f2e503 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:48.074134 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac0e59-d453-4d96-8f4a-ce7a38b982ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:48.074795 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac0e59-d453-4d96-8f4a-ce7a38b982ac None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:48.075080 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac0e59-d453-4d96-8f4a-ce7a38b982ac None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:48.075354 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac0e59-d453-4d96-8f4a-ce7a38b982ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:48.076636 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac0e59-d453-4d96-8f4a-ce7a38b982ac None admin] RBAC: Adding query filter params (role.id=e2336723b86b456e95b87bce11e66e1c, scope.project.id=e6ee9295413244e9b7233dd64100ffb7, user.id=c28ec579daf646b591ab6b4517d845a5) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:48.076973 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac0e59-d453-4d96-8f4a-ce7a38b982ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:48.078443 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac0e59-d453-4d96-8f4a-ce7a38b982ac None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:48.078547 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:48.089734 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 126/253] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jun 29 12:07:47 2022] GET /identity/v3/role_assignments?user.id=c28ec579daf646b591ab6b4517d845a5&scope.project.id=e6ee9295413244e9b7233dd64100ffb7&role.id=e2336723b86b456e95b87bce11e66e1c => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:48.089734 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1ad0d-c139-414c-8cc0-6ac9003d3925 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:48.089734 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1ad0d-c139-414c-8cc0-6ac9003d3925 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:48.089734 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1ad0d-c139-414c-8cc0-6ac9003d3925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:48.109730 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-dca1ad0d-c139-414c-8cc0-6ac9003d3925 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:48.109730 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-dca1ad0d-c139-414c-8cc0-6ac9003d3925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:48.160971 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571395bd-17cc-474f-b4f5-e6d85e64fe2b None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:48.175736 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:48.212654 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 127/254] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:48.214017 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abeec3f-5446-4b98-8adc-fdc0fa3df438 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:48.214255 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abeec3f-5446-4b98-8adc-fdc0fa3df438 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:48.214468 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abeec3f-5446-4b98-8adc-fdc0fa3df438 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:48.216394 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 128/255] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:07:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:48.222068 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04702a4-9b50-4e51-856d-58306cefb8ae None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:48.222559 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04702a4-9b50-4e51-856d-58306cefb8ae None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:48.222903 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04702a4-9b50-4e51-856d-58306cefb8ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:48.237893 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943920b3-7151-4ed4-8627-831e4b93e1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:48.238908 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943920b3-7151-4ed4-8627-831e4b93e1cb None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:48.239186 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943920b3-7151-4ed4-8627-831e4b93e1cb None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:48.239455 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943920b3-7151-4ed4-8627-831e4b93e1cb None admin] PATH_INFO: `/v3/projects/e6ee9295413244e9b7233dd64100ffb7/users/f900512326c141e48338cff8511795aa/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:48.241429 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-c04702a4-9b50-4e51-856d-58306cefb8ae None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:48.242763 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-c04702a4-9b50-4e51-856d-58306cefb8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:48.246678 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943920b3-7151-4ed4-8627-831e4b93e1cb None admin] RBAC: Authorizing `identity:create_grant(project_id=e6ee9295413244e9b7233dd64100ffb7, user_id=f900512326c141e48338cff8511795aa, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:48.248277 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943920b3-7151-4ed4-8627-831e4b93e1cb None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:48.282740 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 128/256] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jun 29 12:07:48 2022] PUT /identity/v3/projects/e6ee9295413244e9b7233dd64100ffb7/users/f900512326c141e48338cff8511795aa/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:07:48.284088 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943920b3-7151-4ed4-8627-831e4b93e1cb None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:48.378756 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 129/257] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:48.438249 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04702a4-9b50-4e51-856d-58306cefb8ae None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:48.481714 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943920b3-7151-4ed4-8627-831e4b93e1cb None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:48.531447 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:48.549801 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdcdfdd-cc2e-4449-a907-963861448176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:48.550516 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdcdfdd-cc2e-4449-a907-963861448176 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:48.550802 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdcdfdd-cc2e-4449-a907-963861448176 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:48.551080 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdcdfdd-cc2e-4449-a907-963861448176 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:48.578476 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:48.581643 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04702a4-9b50-4e51-856d-58306cefb8ae None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:48.582764 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdcdfdd-cc2e-4449-a907-963861448176 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:48.590898 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-9cdcdfdd-cc2e-4449-a907-963861448176 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:07:48.590898 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:48.590898 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:48.590898 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:48.590898 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:48.590898 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:48.590898 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:48.590898 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:48.590898 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:48.590898 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:48.590898 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:48.590898 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:48.590898 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:48.590898 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:48.590898 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:48.590898 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:48.591805 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:48.591805 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:48.591805 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:48.591805 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:48.591805 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:48.591805 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:48.591805 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:48.591805 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:48.591805 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:48.591805 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:48.591805 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:48.591805 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:48.591805 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:48.591805 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:48.591805 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:48.591805 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:48.592612 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:48.592612 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:48.592612 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:48.592612 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:48.592612 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:48.592612 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:48.592612 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:48.592612 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:48.592612 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:48.592612 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:48.592612 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:07:48.592612 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:07:48.592612 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 129/258] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jun 29 12:07:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:48.600363 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdcdfdd-cc2e-4449-a907-963861448176 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:48.620385 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ebaeb8-153c-443f-a1df-22c9e5fcdfc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:48.621211 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ebaeb8-153c-443f-a1df-22c9e5fcdfc4 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:48.621484 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ebaeb8-153c-443f-a1df-22c9e5fcdfc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:48.621782 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ebaeb8-153c-443f-a1df-22c9e5fcdfc4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:48.642545 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ebaeb8-153c-443f-a1df-22c9e5fcdfc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:48.652381 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-39ebaeb8-153c-443f-a1df-22c9e5fcdfc4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 12:07:48.652381 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:48.652381 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:48.652381 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:48.652381 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:48.652381 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:48.652381 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:48.652381 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:48.652381 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:48.652381 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:48.652381 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:48.652381 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:48.652381 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:48.652381 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:48.652381 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:48.652381 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:48.653802 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:48.653802 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:48.653802 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:48.653802 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:48.653802 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:48.653802 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:48.653802 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:48.653802 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:48.653802 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:48.653802 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:48.653802 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:48.653802 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:48.653802 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:48.653802 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:48.653802 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:48.653802 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:48.655389 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:48.655389 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:48.655389 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:48.655389 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:48.655389 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:48.655389 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:48.655389 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:48.655389 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:48.655389 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:48.655389 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:48.655389 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 12:07:48.655389 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:07:48.655389 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 130/259] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jun 29 12:07:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:07:48.667514 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ebaeb8-153c-443f-a1df-22c9e5fcdfc4 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:48.784749 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdcdfdd-cc2e-4449-a907-963861448176 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:48.859426 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23474938-9ddb-4c84-a15f-69922025b1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:48.860120 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23474938-9ddb-4c84-a15f-69922025b1e8 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:48.860404 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23474938-9ddb-4c84-a15f-69922025b1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:48.860770 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23474938-9ddb-4c84-a15f-69922025b1e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:48.861530 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23474938-9ddb-4c84-a15f-69922025b1e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:48.865953 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23474938-9ddb-4c84-a15f-69922025b1e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:48.867520 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23474938-9ddb-4c84-a15f-69922025b1e8 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:48.884344 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 130/260] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:07:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:48.888255 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ebaeb8-153c-443f-a1df-22c9e5fcdfc4 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:48.895232 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23474938-9ddb-4c84-a15f-69922025b1e8 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:48.970943 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e149a7d6-2d20-4779-a007-f705c097743e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:48.971934 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149a7d6-2d20-4779-a007-f705c097743e None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:48.972357 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149a7d6-2d20-4779-a007-f705c097743e None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:48.972769 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149a7d6-2d20-4779-a007-f705c097743e None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:48.973672 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e149a7d6-2d20-4779-a007-f705c097743e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:48.974042 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:48.974197 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e149a7d6-2d20-4779-a007-f705c097743e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:48.975800 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e149a7d6-2d20-4779-a007-f705c097743e None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:49.001795 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 131/261] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jun 29 12:07:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:49.007526 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e149a7d6-2d20-4779-a007-f705c097743e None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:49.063134 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23474938-9ddb-4c84-a15f-69922025b1e8 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:49.074053 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:49.109272 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a19ef0-24e2-4cbb-90b1-1d1998cee27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:49.110238 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a19ef0-24e2-4cbb-90b1-1d1998cee27f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:49.110460 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a19ef0-24e2-4cbb-90b1-1d1998cee27f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:49.110728 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a19ef0-24e2-4cbb-90b1-1d1998cee27f None admin] PATH_INFO: `/v3/users/fff7ba452aa541d8a53efa158c242eb3` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:49.114477 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a19ef0-24e2-4cbb-90b1-1d1998cee27f None admin] RBAC: Authorizing `identity:get_user(user_id=fff7ba452aa541d8a53efa158c242eb3)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:49.116205 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a19ef0-24e2-4cbb-90b1-1d1998cee27f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:49.118339 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 131/262] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jun 29 12:07:48 2022] GET /identity/v3/users/fff7ba452aa541d8a53efa158c242eb3 => generated 283 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:07:49.134761 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a19ef0-24e2-4cbb-90b1-1d1998cee27f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:49.225484 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e149a7d6-2d20-4779-a007-f705c097743e None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:49.271459 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a19ef0-24e2-4cbb-90b1-1d1998cee27f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:49.285789 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:49.323709 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5edd8f-2cf1-4011-babf-9134a7f1c03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:49.324321 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5edd8f-2cf1-4011-babf-9134a7f1c03d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:49.324605 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5edd8f-2cf1-4011-babf-9134a7f1c03d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:49.324878 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5edd8f-2cf1-4011-babf-9134a7f1c03d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:49.325081 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3fe26-479d-4af7-88a5-8959311ec9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:49.326374 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3fe26-479d-4af7-88a5-8959311ec9d9 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:49.326661 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3fe26-479d-4af7-88a5-8959311ec9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:49.326936 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3fe26-479d-4af7-88a5-8959311ec9d9 None admin] PATH_INFO: `/v3/users/fff7ba452aa541d8a53efa158c242eb3` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:49.333026 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda3fe26-479d-4af7-88a5-8959311ec9d9 None admin] RBAC: Authorizing `identity:get_user(user_id=fff7ba452aa541d8a53efa158c242eb3)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:49.334908 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda3fe26-479d-4af7-88a5-8959311ec9d9 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:49.336959 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 132/263] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jun 29 12:07:49 2022] GET /identity/v3/users/fff7ba452aa541d8a53efa158c242eb3 => generated 283 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:07:49.342488 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3fe26-479d-4af7-88a5-8959311ec9d9 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:49.435532 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5edd8f-2cf1-4011-babf-9134a7f1c03d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:49.436939 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5edd8f-2cf1-4011-babf-9134a7f1c03d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:49.561999 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 132/264] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:07:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:07:49.570637 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5edd8f-2cf1-4011-babf-9134a7f1c03d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:49.598136 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:49.644784 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:49.659400 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3fe26-479d-4af7-88a5-8959311ec9d9 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:49.727258 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5edd8f-2cf1-4011-babf-9134a7f1c03d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:49.757854 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19973cf3-e57d-4447-8104-a4a7725261f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:49.758904 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19973cf3-e57d-4447-8104-a4a7725261f2 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:49.759388 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19973cf3-e57d-4447-8104-a4a7725261f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:49.759856 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19973cf3-e57d-4447-8104-a4a7725261f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:49.779005 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea065624-4d6b-4578-aae6-a5870ab70cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:49.779886 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea065624-4d6b-4578-aae6-a5870ab70cdf None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:49.780171 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea065624-4d6b-4578-aae6-a5870ab70cdf None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:49.780443 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea065624-4d6b-4578-aae6-a5870ab70cdf None admin] PATH_INFO: `/v3/projects/e6ee9295413244e9b7233dd64100ffb7` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:49.781790 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea065624-4d6b-4578-aae6-a5870ab70cdf None admin] RBAC: Authorizing `identity:get_project(project_id=e6ee9295413244e9b7233dd64100ffb7)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:49.785716 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea065624-4d6b-4578-aae6-a5870ab70cdf None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:49.790936 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 133/265] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jun 29 12:07:49 2022] GET /identity/v3/projects/e6ee9295413244e9b7233dd64100ffb7 => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:49.792163 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea065624-4d6b-4578-aae6-a5870ab70cdf None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:49.882351 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19973cf3-e57d-4447-8104-a4a7725261f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:49.884246 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19973cf3-e57d-4447-8104-a4a7725261f2 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:49.961655 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:50.025656 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea065624-4d6b-4578-aae6-a5870ab70cdf None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:50.062068 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:50.065151 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 133/266] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:07:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 723 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 29 12:07:50.071183 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19973cf3-e57d-4447-8104-a4a7725261f2 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:50.110711 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f504bb-24a7-434f-a68f-83b8cd3366d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:50.111384 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f504bb-24a7-434f-a68f-83b8cd3366d7 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:50.111671 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f504bb-24a7-434f-a68f-83b8cd3366d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:50.111950 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f504bb-24a7-434f-a68f-83b8cd3366d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:50.113264 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f504bb-24a7-434f-a68f-83b8cd3366d7 None admin] RBAC: Adding query filter params (role.id=e0e69ac8a8bf4cc4baa6aa18f2fc9919, scope.project.id=e6ee9295413244e9b7233dd64100ffb7, user.id=fff7ba452aa541d8a53efa158c242eb3) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:50.113587 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f504bb-24a7-434f-a68f-83b8cd3366d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:50.115460 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f504bb-24a7-434f-a68f-83b8cd3366d7 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:50.131191 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 134/267] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jun 29 12:07:49 2022] GET /identity/v3/role_assignments?user.id=fff7ba452aa541d8a53efa158c242eb3&scope.project.id=e6ee9295413244e9b7233dd64100ffb7&role.id=e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 608 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:50.260668 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19973cf3-e57d-4447-8104-a4a7725261f2 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:50.287287 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c691bde-8efc-4b76-92fe-f494f6aeaccb None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:50.288256 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c691bde-8efc-4b76-92fe-f494f6aeaccb None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:50.288756 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c691bde-8efc-4b76-92fe-f494f6aeaccb None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:50.290760 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 135/268] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:07:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:07:50.297184 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66395e1c-29ad-474d-90ba-f32739201a0a None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:50.298382 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66395e1c-29ad-474d-90ba-f32739201a0a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:50.298898 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66395e1c-29ad-474d-90ba-f32739201a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:50.340593 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-66395e1c-29ad-474d-90ba-f32739201a0a None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:50.341856 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-66395e1c-29ad-474d-90ba-f32739201a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:50.344858 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a44ae8-9319-4a06-aea8-8fd5dad5138b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:50.345832 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a44ae8-9319-4a06-aea8-8fd5dad5138b None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:50.346118 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a44ae8-9319-4a06-aea8-8fd5dad5138b None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:50.346393 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a44ae8-9319-4a06-aea8-8fd5dad5138b None admin] PATH_INFO: `/v3/projects/e6ee9295413244e9b7233dd64100ffb7` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:50.348963 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a44ae8-9319-4a06-aea8-8fd5dad5138b None admin] RBAC: Authorizing `identity:get_project(project_id=e6ee9295413244e9b7233dd64100ffb7)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:50.351654 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a44ae8-9319-4a06-aea8-8fd5dad5138b None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:50.358442 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 134/269] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jun 29 12:07:50 2022] GET /identity/v3/projects/e6ee9295413244e9b7233dd64100ffb7 => generated 302 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:07:50.360293 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16571ca5-bd22-4695-b90c-969e5cec8be7 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:50.360724 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16571ca5-bd22-4695-b90c-969e5cec8be7 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:50.361139 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16571ca5-bd22-4695-b90c-969e5cec8be7 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:50.363077 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 135/270] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:07:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:50.366584 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16571ca5-bd22-4695-b90c-969e5cec8be7 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:50.439744 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 136/271] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:50.441273 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657e731-0656-4eca-9b5b-cb54fe1a2a70 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:50.441722 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657e731-0656-4eca-9b5b-cb54fe1a2a70 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:50.442126 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657e731-0656-4eca-9b5b-cb54fe1a2a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:50.473155 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e657e731-0656-4eca-9b5b-cb54fe1a2a70 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:50.474982 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e657e731-0656-4eca-9b5b-cb54fe1a2a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:50.477149 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:50.539685 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16571ca5-bd22-4695-b90c-969e5cec8be7 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:50.561723 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 137/272] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:50.562847 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e657e731-0656-4eca-9b5b-cb54fe1a2a70 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:50.569716 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:50.589732 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee3c74-782f-4821-8ae9-826cd37e63f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:50.589732 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee3c74-782f-4821-8ae9-826cd37e63f1 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:50.589732 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee3c74-782f-4821-8ae9-826cd37e63f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:50.589732 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee3c74-782f-4821-8ae9-826cd37e63f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:50.590182 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ee3c74-782f-4821-8ae9-826cd37e63f1 None admin] RBAC: Adding query filter params (role.id=ea54879a52d24a47bada5629b6d8b456, scope.project.id=e6ee9295413244e9b7233dd64100ffb7, user.id=fff7ba452aa541d8a53efa158c242eb3) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:50.590182 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ee3c74-782f-4821-8ae9-826cd37e63f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:50.590461 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ee3c74-782f-4821-8ae9-826cd37e63f1 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:50.598782 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 136/273] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jun 29 12:07:50 2022] GET /identity/v3/role_assignments?user.id=fff7ba452aa541d8a53efa158c242eb3&scope.project.id=e6ee9295413244e9b7233dd64100ffb7&role.id=ea54879a52d24a47bada5629b6d8b456 => generated 608 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:50.615763 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee3c74-782f-4821-8ae9-826cd37e63f1 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:50.748117 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee3c74-782f-4821-8ae9-826cd37e63f1 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:50.775966 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:50.790819 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c598d5d-cf4c-46fb-8e38-214ca28441aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:50.791738 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c598d5d-cf4c-46fb-8e38-214ca28441aa None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:50.792394 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c598d5d-cf4c-46fb-8e38-214ca28441aa None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:50.792679 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c598d5d-cf4c-46fb-8e38-214ca28441aa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:50.794345 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c598d5d-cf4c-46fb-8e38-214ca28441aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:50.795874 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c598d5d-cf4c-46fb-8e38-214ca28441aa None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:50.797961 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 137/274] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:50.805440 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c598d5d-cf4c-46fb-8e38-214ca28441aa None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:50.839226 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e657e731-0656-4eca-9b5b-cb54fe1a2a70 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:50.902026 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d489b5-9e80-4a25-8d2e-1b9560a0b437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:50.903182 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d489b5-9e80-4a25-8d2e-1b9560a0b437 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:50.903613 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d489b5-9e80-4a25-8d2e-1b9560a0b437 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:50.904152 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d489b5-9e80-4a25-8d2e-1b9560a0b437 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:50.919574 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d489b5-9e80-4a25-8d2e-1b9560a0b437 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:50.931746 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-12d489b5-9e80-4a25-8d2e-1b9560a0b437 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:07:50.931746 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:50.931746 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:50.931746 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:50.931746 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:50.931746 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:50.931746 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:50.931746 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:50.931746 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:50.931746 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:50.931746 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:50.931746 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:50.931746 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:50.931746 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:50.931746 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:50.931746 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:50.932712 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:50.932712 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:50.932712 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:50.932712 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:50.932712 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:50.932712 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:50.932712 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:50.932712 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:50.932712 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:50.932712 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:50.932712 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:50.932712 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:50.932712 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:50.932712 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:50.932712 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:50.932712 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:50.933506 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:50.933506 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:50.933506 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:50.933506 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:50.933506 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:50.933506 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:50.933506 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:50.933506 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:50.933506 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:50.933506 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:50.933506 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:07:50.933506 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:07:50.934141 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 138/275] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:07:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:50.939754 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d489b5-9e80-4a25-8d2e-1b9560a0b437 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:50.951306 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c598d5d-cf4c-46fb-8e38-214ca28441aa None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:51.002551 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2aacbf-32a9-4b49-b0f5-f518c910503f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:51.003270 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2aacbf-32a9-4b49-b0f5-f518c910503f None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:51.003552 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2aacbf-32a9-4b49-b0f5-f518c910503f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:51.003827 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2aacbf-32a9-4b49-b0f5-f518c910503f None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:51.004570 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2aacbf-32a9-4b49-b0f5-f518c910503f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:51.006299 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2aacbf-32a9-4b49-b0f5-f518c910503f None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:51.013730 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:51.040048 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 138/276] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Jun 29 12:07:50 2022] POST /identity/v3/users => generated 293 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:07:51.061526 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d489b5-9e80-4a25-8d2e-1b9560a0b437 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:51.068882 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b38d2-b766-4b71-899a-de0aa8751bf1 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:51.069488 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b38d2-b766-4b71-899a-de0aa8751bf1 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:51.070070 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b38d2-b766-4b71-899a-de0aa8751bf1 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:51.071907 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 139/277] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:07:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:07:51.077646 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be8eba-92e2-4674-a567-bb77ff2a81dc None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:51.078271 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be8eba-92e2-4674-a567-bb77ff2a81dc None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:51.078759 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be8eba-92e2-4674-a567-bb77ff2a81dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:51.098992 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-37be8eba-92e2-4674-a567-bb77ff2a81dc None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:51.101541 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-37be8eba-92e2-4674-a567-bb77ff2a81dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:51.106896 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dcc4f4-e75e-43c8-940f-433adffa06f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:51.107879 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dcc4f4-e75e-43c8-940f-433adffa06f9 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:51.108380 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dcc4f4-e75e-43c8-940f-433adffa06f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:51.108845 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dcc4f4-e75e-43c8-940f-433adffa06f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:51.109840 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dcc4f4-e75e-43c8-940f-433adffa06f9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:51.110356 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dcc4f4-e75e-43c8-940f-433adffa06f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:51.112253 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dcc4f4-e75e-43c8-940f-433adffa06f9 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:51.123433 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 139/278] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jun 29 12:07:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:51.133747 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dcc4f4-e75e-43c8-940f-433adffa06f9 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:51.156138 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:51.187832 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 140/279] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 12:07:51.214196 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be8eba-92e2-4674-a567-bb77ff2a81dc None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:51.248131 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dcc4f4-e75e-43c8-940f-433adffa06f9 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:51.274360 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:51.289494 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d158f-b52f-46b0-8b11-63508ddffe8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:51.290421 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d158f-b52f-46b0-8b11-63508ddffe8c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:51.290705 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d158f-b52f-46b0-8b11-63508ddffe8c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:51.290974 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d158f-b52f-46b0-8b11-63508ddffe8c None admin] PATH_INFO: `/v3/users/3b893166ad914c979b809acc338d74dc` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:51.307006 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931d158f-b52f-46b0-8b11-63508ddffe8c None admin] RBAC: Authorizing `identity:get_user(user_id=3b893166ad914c979b809acc338d74dc)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:51.308413 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931d158f-b52f-46b0-8b11-63508ddffe8c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:51.310355 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 140/280] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jun 29 12:07:51 2022] GET /identity/v3/users/3b893166ad914c979b809acc338d74dc => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:51.311590 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd373611-9ea6-44e0-97d5-14d594dc7f11 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:51.311882 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd373611-9ea6-44e0-97d5-14d594dc7f11 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:51.312164 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd373611-9ea6-44e0-97d5-14d594dc7f11 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:51.313551 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 141/281] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:07:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:51.318991 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd373611-9ea6-44e0-97d5-14d594dc7f11 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:51.346306 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be8eba-92e2-4674-a567-bb77ff2a81dc None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:51.389351 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f897e3-ec53-4963-9f9c-3e60dc80f1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:51.390272 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f897e3-ec53-4963-9f9c-3e60dc80f1d0 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:51.390555 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f897e3-ec53-4963-9f9c-3e60dc80f1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:51.390826 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f897e3-ec53-4963-9f9c-3e60dc80f1d0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:51.403458 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f897e3-ec53-4963-9f9c-3e60dc80f1d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:51.412690 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-e4f897e3-ec53-4963-9f9c-3e60dc80f1d0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:07:51.412690 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:51.412690 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:51.412690 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:51.412690 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:51.412690 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:51.412690 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:51.412690 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:51.412690 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:51.412690 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:51.412690 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:51.412690 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:51.412690 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:51.412690 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:51.412690 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:51.412690 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:51.413635 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:51.413635 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:51.413635 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:51.413635 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:51.413635 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:51.413635 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:51.413635 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:51.413635 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:51.413635 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:51.413635 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:51.413635 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:51.413635 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:51.413635 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:51.413635 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:51.413635 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:51.413635 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:51.414491 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:51.414491 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:51.414491 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:51.414491 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:51.414491 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:51.414491 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:51.414491 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:51.414491 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:51.414491 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:51.414491 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:51.414491 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:07:51.414491 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:07:51.414491 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 141/282] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:07:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:51.415545 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a6357-5de2-4471-b574-8aaf0629712f None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:51.415824 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a6357-5de2-4471-b574-8aaf0629712f None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:51.417732 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a6357-5de2-4471-b574-8aaf0629712f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:51.434745 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-493a6357-5de2-4471-b574-8aaf0629712f None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:51.435933 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-493a6357-5de2-4471-b574-8aaf0629712f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:51.453042 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd373611-9ea6-44e0-97d5-14d594dc7f11 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:51.474331 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:51.491007 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1385be-9187-4d61-954a-2a6b69c0a0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:51.491622 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1385be-9187-4d61-954a-2a6b69c0a0a3 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:51.491902 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1385be-9187-4d61-954a-2a6b69c0a0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:51.492175 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1385be-9187-4d61-954a-2a6b69c0a0a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:51.493148 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1385be-9187-4d61-954a-2a6b69c0a0a3 None admin] RBAC: Adding query filter params (role.id=c49accbc6f81447cb221ef720db04ced, user.id=3b893166ad914c979b809acc338d74dc, scope.system=all) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:51.493391 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1385be-9187-4d61-954a-2a6b69c0a0a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:51.494815 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1385be-9187-4d61-954a-2a6b69c0a0a3 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:51.500712 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 142/283] 10.222.0.27 () {56 vars in 1308 bytes} [Wed Jun 29 12:07:51 2022] GET /identity/v3/role_assignments?user.id=3b893166ad914c979b809acc338d74dc&scope.system=all&role.id=c49accbc6f81447cb221ef720db04ced => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:51.501655 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1385be-9187-4d61-954a-2a6b69c0a0a3 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:51.522301 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 142/284] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:51.545088 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a6357-5de2-4471-b574-8aaf0629712f None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:51.623138 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:51.664327 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a6357-5de2-4471-b574-8aaf0629712f None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:51.712183 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb082e0-c8c8-4b66-b8ef-d62a49c289b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:51.713398 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb082e0-c8c8-4b66-b8ef-d62a49c289b9 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:51.713902 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb082e0-c8c8-4b66-b8ef-d62a49c289b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:51.714370 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb082e0-c8c8-4b66-b8ef-d62a49c289b9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:51.736359 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb082e0-c8c8-4b66-b8ef-d62a49c289b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:51.745720 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-3bb082e0-c8c8-4b66-b8ef-d62a49c289b9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 12:07:51.745720 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:51.745720 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:51.745720 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:51.745720 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:51.745720 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:51.745720 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:51.745720 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:51.745720 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:51.745720 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:51.745720 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:51.745720 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:51.745720 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:51.745720 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:51.745720 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:51.745720 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:51.746630 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:51.746630 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:51.746630 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:51.746630 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:51.746630 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:51.746630 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:51.746630 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:51.746630 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:51.746630 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:51.746630 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:51.746630 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:51.746630 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:51.746630 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:51.746630 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:51.746630 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:51.746630 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:51.747414 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:51.747414 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:51.747414 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:51.747414 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:51.747414 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:51.747414 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:51.747414 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:51.747414 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:51.747414 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:51.747414 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:51.747414 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 12:07:51.747414 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:07:51.748010 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1385be-9187-4d61-954a-2a6b69c0a0a3 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:51.750254 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 143/285] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:07:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:07:51.755934 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb082e0-c8c8-4b66-b8ef-d62a49c289b9 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:51.790141 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79662110-f79c-4e2f-bc97-a1091d2f4ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:51.790141 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79662110-f79c-4e2f-bc97-a1091d2f4ac7 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:51.790141 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79662110-f79c-4e2f-bc97-a1091d2f4ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:51.790141 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79662110-f79c-4e2f-bc97-a1091d2f4ac7 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:51.790545 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79662110-f79c-4e2f-bc97-a1091d2f4ac7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:51.790545 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79662110-f79c-4e2f-bc97-a1091d2f4ac7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:51.790545 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79662110-f79c-4e2f-bc97-a1091d2f4ac7 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:51.805285 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 143/286] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jun 29 12:07:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:51.810365 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:51.811539 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79662110-f79c-4e2f-bc97-a1091d2f4ac7 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:51.916061 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79662110-f79c-4e2f-bc97-a1091d2f4ac7 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:51.925214 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:51.952409 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceefaa01-7353-4f22-bdaa-40fb59124dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:51.953335 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceefaa01-7353-4f22-bdaa-40fb59124dcf None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:51.953638 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceefaa01-7353-4f22-bdaa-40fb59124dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:51.957727 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceefaa01-7353-4f22-bdaa-40fb59124dcf None admin] PATH_INFO: `/v3/users/f900512326c141e48338cff8511795aa` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:51.957727 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceefaa01-7353-4f22-bdaa-40fb59124dcf None admin] RBAC: Authorizing `identity:get_user(user_id=f900512326c141e48338cff8511795aa)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:51.957727 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceefaa01-7353-4f22-bdaa-40fb59124dcf None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:51.958698 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 144/287] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jun 29 12:07:51 2022] GET /identity/v3/users/f900512326c141e48338cff8511795aa => generated 297 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:51.964166 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceefaa01-7353-4f22-bdaa-40fb59124dcf None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:51.971088 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb082e0-c8c8-4b66-b8ef-d62a49c289b9 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:52.035021 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e22981-f426-46e5-aaf6-2bd5514e2752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:52.035830 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e22981-f426-46e5-aaf6-2bd5514e2752 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:52.036113 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e22981-f426-46e5-aaf6-2bd5514e2752 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:52.036385 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e22981-f426-46e5-aaf6-2bd5514e2752 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:52.037957 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e22981-f426-46e5-aaf6-2bd5514e2752 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:52.038308 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e22981-f426-46e5-aaf6-2bd5514e2752 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:52.039975 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e22981-f426-46e5-aaf6-2bd5514e2752 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:52.053259 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 144/288] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jun 29 12:07:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:52.058409 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e22981-f426-46e5-aaf6-2bd5514e2752 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:52.158222 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:52.173961 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e22981-f426-46e5-aaf6-2bd5514e2752 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:52.219163 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43129b-5b5a-44a3-a17c-a334a4acaf5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:52.220500 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43129b-5b5a-44a3-a17c-a334a4acaf5b None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:52.221016 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43129b-5b5a-44a3-a17c-a334a4acaf5b None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:52.221478 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43129b-5b5a-44a3-a17c-a334a4acaf5b None admin] PATH_INFO: `/v3/users/c28ec579daf646b591ab6b4517d845a5` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:52.222910 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d43129b-5b5a-44a3-a17c-a334a4acaf5b None admin] RBAC: Authorizing `identity:get_user(user_id=c28ec579daf646b591ab6b4517d845a5)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:52.224581 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d43129b-5b5a-44a3-a17c-a334a4acaf5b None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:52.227220 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 145/289] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jun 29 12:07:52 2022] GET /identity/v3/users/c28ec579daf646b591ab6b4517d845a5 => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:07:52.233179 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43129b-5b5a-44a3-a17c-a334a4acaf5b None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:52.246342 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceefaa01-7353-4f22-bdaa-40fb59124dcf None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:52.354413 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62775ab7-6a68-42d9-b403-6d6d22f30ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:52.355062 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62775ab7-6a68-42d9-b403-6d6d22f30ddb None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:52.355365 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62775ab7-6a68-42d9-b403-6d6d22f30ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:52.355648 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62775ab7-6a68-42d9-b403-6d6d22f30ddb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:52.356286 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43129b-5b5a-44a3-a17c-a334a4acaf5b None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:52.434224 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:52.446940 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62775ab7-6a68-42d9-b403-6d6d22f30ddb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:52.449050 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62775ab7-6a68-42d9-b403-6d6d22f30ddb None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:52.493674 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e553e-57c1-4fcd-83b7-ec99244b1ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:52.494769 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e553e-57c1-4fcd-83b7-ec99244b1ce9 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:52.494896 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e553e-57c1-4fcd-83b7-ec99244b1ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:52.495114 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e553e-57c1-4fcd-83b7-ec99244b1ce9 None admin] PATH_INFO: `/v3/projects/e6ee9295413244e9b7233dd64100ffb7` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:52.496321 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957e553e-57c1-4fcd-83b7-ec99244b1ce9 None admin] RBAC: Authorizing `identity:get_project(project_id=e6ee9295413244e9b7233dd64100ffb7)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:52.497799 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957e553e-57c1-4fcd-83b7-ec99244b1ce9 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:52.499535 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 146/290] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jun 29 12:07:52 2022] GET /identity/v3/projects/e6ee9295413244e9b7233dd64100ffb7 => generated 302 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:52.510835 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e553e-57c1-4fcd-83b7-ec99244b1ce9 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:52.567002 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 145/291] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:07:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 603 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:07:52.569310 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62775ab7-6a68-42d9-b403-6d6d22f30ddb None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:52.582053 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:52.722139 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:52.726217 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e553e-57c1-4fcd-83b7-ec99244b1ce9 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:52.767693 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62775ab7-6a68-42d9-b403-6d6d22f30ddb None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:52.780627 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e134c-a119-44b9-8895-88bec4e53d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:52.781530 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e134c-a119-44b9-8895-88bec4e53d60 None admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:52.781859 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e134c-a119-44b9-8895-88bec4e53d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:52.782136 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e134c-a119-44b9-8895-88bec4e53d60 None admin] PATH_INFO: `/v3/projects/e6ee9295413244e9b7233dd64100ffb7/users/c28ec579daf646b591ab6b4517d845a5/roles/e2336723b86b456e95b87bce11e66e1c` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:52.784626 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705e134c-a119-44b9-8895-88bec4e53d60 None admin] RBAC: Authorizing `identity:create_grant(project_id=e6ee9295413244e9b7233dd64100ffb7, user_id=c28ec579daf646b591ab6b4517d845a5, role_id=e2336723b86b456e95b87bce11e66e1c)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:52.786115 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705e134c-a119-44b9-8895-88bec4e53d60 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:52.803554 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 147/292] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jun 29 12:07:52 2022] PUT /identity/v3/projects/e6ee9295413244e9b7233dd64100ffb7/users/c28ec579daf646b591ab6b4517d845a5/roles/e2336723b86b456e95b87bce11e66e1c => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:07:52.854178 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab01bd49-5ab2-42b9-a5fc-f18397ee5b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:52.855072 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01bd49-5ab2-42b9-a5fc-f18397ee5b88 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:52.855358 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01bd49-5ab2-42b9-a5fc-f18397ee5b88 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:52.855632 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01bd49-5ab2-42b9-a5fc-f18397ee5b88 None admin] PATH_INFO: `/v3/projects/e6ee9295413244e9b7233dd64100ffb7` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:52.856927 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab01bd49-5ab2-42b9-a5fc-f18397ee5b88 None admin] RBAC: Authorizing `identity:get_project(project_id=e6ee9295413244e9b7233dd64100ffb7)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:52.858429 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab01bd49-5ab2-42b9-a5fc-f18397ee5b88 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:52.865022 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 146/293] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jun 29 12:07:52 2022] GET /identity/v3/projects/e6ee9295413244e9b7233dd64100ffb7 => generated 302 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:52.866926 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e134c-a119-44b9-8895-88bec4e53d60 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:53.007419 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:53.026873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e134c-a119-44b9-8895-88bec4e53d60 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:53.067469 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c68b76-96c4-4ff7-ae73-47356f1d2b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:53.068139 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c68b76-96c4-4ff7-ae73-47356f1d2b83 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:53.068453 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c68b76-96c4-4ff7-ae73-47356f1d2b83 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:53.068729 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c68b76-96c4-4ff7-ae73-47356f1d2b83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:53.069684 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c68b76-96c4-4ff7-ae73-47356f1d2b83 None admin] RBAC: Adding query filter params (role.id=c49accbc6f81447cb221ef720db04ced, scope.project.id=e6ee9295413244e9b7233dd64100ffb7, user.id=f900512326c141e48338cff8511795aa) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:53.070046 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c68b76-96c4-4ff7-ae73-47356f1d2b83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:53.071508 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c68b76-96c4-4ff7-ae73-47356f1d2b83 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:53.079866 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 148/294] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jun 29 12:07:52 2022] GET /identity/v3/role_assignments?user.id=f900512326c141e48338cff8511795aa&scope.project.id=e6ee9295413244e9b7233dd64100ffb7&role.id=c49accbc6f81447cb221ef720db04ced => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:53.459936 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fa25c-3f4d-4516-992e-4056038511bb None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:53.460980 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fa25c-3f4d-4516-992e-4056038511bb None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:53.461456 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fa25c-3f4d-4516-992e-4056038511bb None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:53.463328 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 147/295] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:07:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:53.468780 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342cf53-901f-423f-a4b2-df52194e4d95 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:53.469626 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342cf53-901f-423f-a4b2-df52194e4d95 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:53.470146 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342cf53-901f-423f-a4b2-df52194e4d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:53.488078 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-5342cf53-901f-423f-a4b2-df52194e4d95 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:53.489601 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-5342cf53-901f-423f-a4b2-df52194e4d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:53.566311 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 149/296] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:53.592527 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12fa25c-3f4d-4516-992e-4056038511bb None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:53.616306 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dfa1b5-9ca6-4fba-a118-bb55e45b6798 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:53.616306 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dfa1b5-9ca6-4fba-a118-bb55e45b6798 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:53.616623 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dfa1b5-9ca6-4fba-a118-bb55e45b6798 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:53.618315 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 150/297] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:07:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:53.623886 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48307f8a-a969-4d34-ba63-3035d55a95ee None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:53.624164 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48307f8a-a969-4d34-ba63-3035d55a95ee None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:53.624446 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48307f8a-a969-4d34-ba63-3035d55a95ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:53.643800 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-48307f8a-a969-4d34-ba63-3035d55a95ee None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:53.644477 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-48307f8a-a969-4d34-ba63-3035d55a95ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:53.725881 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 151/298] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 12:07:53.727749 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12fa25c-3f4d-4516-992e-4056038511bb None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:53.745494 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48307f8a-a969-4d34-ba63-3035d55a95ee None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:53.757524 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:53.773169 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255a2e3-ca1d-45df-b2b9-b27a3f3b0bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:53.774498 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255a2e3-ca1d-45df-b2b9-b27a3f3b0bfe None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:53.775180 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255a2e3-ca1d-45df-b2b9-b27a3f3b0bfe None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:53.775625 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255a2e3-ca1d-45df-b2b9-b27a3f3b0bfe None admin] PATH_INFO: `/v3/domains/default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:53.777684 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f255a2e3-ca1d-45df-b2b9-b27a3f3b0bfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:53.779969 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f255a2e3-ca1d-45df-b2b9-b27a3f3b0bfe None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:53.782997 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 148/299] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:53.789150 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255a2e3-ca1d-45df-b2b9-b27a3f3b0bfe None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:53.806162 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:53.861399 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48307f8a-a969-4d34-ba63-3035d55a95ee None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:53.897966 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1646482f-e220-4ec3-a087-ab922bbdeeb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:53.898630 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255a2e3-ca1d-45df-b2b9-b27a3f3b0bfe None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:53.898827 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1646482f-e220-4ec3-a087-ab922bbdeeb6 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:53.899045 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1646482f-e220-4ec3-a087-ab922bbdeeb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:53.899317 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1646482f-e220-4ec3-a087-ab922bbdeeb6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:53.910222 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1646482f-e220-4ec3-a087-ab922bbdeeb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:53.918649 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-1646482f-e220-4ec3-a087-ab922bbdeeb6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 12:07:53.918649 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:53.918649 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:53.918649 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:53.918649 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:53.918649 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:53.918649 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:53.918649 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:53.918649 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:53.918649 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:53.918649 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:53.918649 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:53.918649 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:53.918649 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:53.918649 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:53.918649 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:53.919550 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:53.919550 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:53.919550 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:53.919550 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:53.919550 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:53.919550 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:53.919550 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:53.919550 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:53.919550 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:53.919550 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:53.919550 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:53.919550 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:53.919550 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:53.919550 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:53.919550 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:53.919550 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:53.920330 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:53.920330 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:53.920330 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:53.920330 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:53.920330 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:53.920330 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:53.920330 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:53.920330 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:53.920330 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:53.920330 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:53.920330 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 12:07:53.920330 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:07:53.920330 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 152/300] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:07:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:07:53.921584 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4aded-3d2d-4717-a831-1a5d2c3934a6 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:53.921584 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4aded-3d2d-4717-a831-1a5d2c3934a6 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:53.921837 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4aded-3d2d-4717-a831-1a5d2c3934a6 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:53.923302 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 153/301] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:07:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:53.928236 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4390d57-22d0-4221-a43a-c013d9f67e8b None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:53.928617 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4390d57-22d0-4221-a43a-c013d9f67e8b None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:53.928985 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4390d57-22d0-4221-a43a-c013d9f67e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:53.943444 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389b1acd-6a51-4a22-891a-45791d9057fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:53.944751 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b1acd-6a51-4a22-891a-45791d9057fc None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:53.945032 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b1acd-6a51-4a22-891a-45791d9057fc None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:53.945302 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b1acd-6a51-4a22-891a-45791d9057fc None admin] PATH_INFO: `/v3/groups` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:53.946072 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389b1acd-6a51-4a22-891a-45791d9057fc None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:53.946922 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-b4390d57-22d0-4221-a43a-c013d9f67e8b None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:53.947462 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389b1acd-6a51-4a22-891a-45791d9057fc None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:53.948103 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-b4390d57-22d0-4221-a43a-c013d9f67e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:53.966522 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 149/302] 10.222.0.27 () {60 vars in 1134 bytes} [Wed Jun 29 12:07:53 2022] POST /identity/v3/groups => generated 229 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:07:53.975141 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389b1acd-6a51-4a22-891a-45791d9057fc None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:54.023438 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:54.038158 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 154/303] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 12:07:54.060716 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4390d57-22d0-4221-a43a-c013d9f67e8b None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:54.090139 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:54.135103 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389b1acd-6a51-4a22-891a-45791d9057fc None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:54.182577 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad54ec-6cf8-4289-8824-ed6a8b13306d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:54.182577 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad54ec-6cf8-4289-8824-ed6a8b13306d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:54.182577 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad54ec-6cf8-4289-8824-ed6a8b13306d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:54.182577 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad54ec-6cf8-4289-8824-ed6a8b13306d None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:54.182981 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ad54ec-6cf8-4289-8824-ed6a8b13306d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:54.183275 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ad54ec-6cf8-4289-8824-ed6a8b13306d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:54.186684 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ad54ec-6cf8-4289-8824-ed6a8b13306d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:54.190022 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4390d57-22d0-4221-a43a-c013d9f67e8b None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:54.199458 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 150/304] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jun 29 12:07:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:54.205781 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad54ec-6cf8-4289-8824-ed6a8b13306d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:54.236292 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b4dab-8adf-469c-882d-ce82bbbda12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:54.237108 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b4dab-8adf-469c-882d-ce82bbbda12c None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:54.237383 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b4dab-8adf-469c-882d-ce82bbbda12c None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:54.237650 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b4dab-8adf-469c-882d-ce82bbbda12c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:54.250876 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b4dab-8adf-469c-882d-ce82bbbda12c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:54.258887 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-4c9b4dab-8adf-469c-882d-ce82bbbda12c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:07:54.258887 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:54.258887 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:54.258887 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:54.258887 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:54.258887 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:54.258887 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:54.258887 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:54.258887 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:54.258887 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:54.258887 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:54.258887 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:54.258887 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:54.258887 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:54.258887 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:54.258887 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:54.259834 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:54.259834 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:54.259834 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:54.259834 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:54.259834 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:54.259834 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:54.259834 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:54.259834 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:54.259834 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:54.259834 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:54.259834 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:54.259834 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:54.259834 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:54.259834 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:54.259834 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:54.259834 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:54.260701 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:54.260701 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:54.260701 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:54.260701 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:54.260701 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:54.260701 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:54.260701 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:54.260701 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:54.260701 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:54.260701 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:54.260701 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:07:54.260701 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:07:54.261296 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 155/305] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:07:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:54.268924 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b4dab-8adf-469c-882d-ce82bbbda12c None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:54.337269 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad54ec-6cf8-4289-8824-ed6a8b13306d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:54.343342 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:54.372918 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627f1215-42bf-47d4-9cb4-7737d05f675b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:54.373845 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f1215-42bf-47d4-9cb4-7737d05f675b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:54.374129 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f1215-42bf-47d4-9cb4-7737d05f675b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:54.374402 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f1215-42bf-47d4-9cb4-7737d05f675b None admin] PATH_INFO: `/v3/users/fcf685ea331147f6abda37a0667abc54` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:54.376394 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:54.389537 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b4dab-8adf-469c-882d-ce82bbbda12c None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:54.390875 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627f1215-42bf-47d4-9cb4-7737d05f675b None admin] RBAC: Authorizing `identity:get_user(user_id=fcf685ea331147f6abda37a0667abc54)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:54.392400 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627f1215-42bf-47d4-9cb4-7737d05f675b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:54.399260 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 151/306] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jun 29 12:07:54 2022] GET /identity/v3/users/fcf685ea331147f6abda37a0667abc54 => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:54.400134 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627f1215-42bf-47d4-9cb4-7737d05f675b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:54.426600 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36917781-62ca-46a0-88ab-fa664917d680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:54.427617 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36917781-62ca-46a0-88ab-fa664917d680 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:54.428183 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36917781-62ca-46a0-88ab-fa664917d680 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:54.428726 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36917781-62ca-46a0-88ab-fa664917d680 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:54.429673 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36917781-62ca-46a0-88ab-fa664917d680 None admin] RBAC: Adding query filter params (name=member) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:54.430195 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36917781-62ca-46a0-88ab-fa664917d680 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:54.431830 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36917781-62ca-46a0-88ab-fa664917d680 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:54.441134 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 156/307] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jun 29 12:07:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:07:54.447237 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36917781-62ca-46a0-88ab-fa664917d680 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:54.505414 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627f1215-42bf-47d4-9cb4-7737d05f675b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:54.541643 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93b8b6-a1d2-4bd5-b70b-97e41ee562fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:54.542340 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93b8b6-a1d2-4bd5-b70b-97e41ee562fc None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:54.542621 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93b8b6-a1d2-4bd5-b70b-97e41ee562fc None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:54.542894 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93b8b6-a1d2-4bd5-b70b-97e41ee562fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:54.544013 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f93b8b6-a1d2-4bd5-b70b-97e41ee562fc None admin] RBAC: Adding query filter params (role.id=e2336723b86b456e95b87bce11e66e1c, user.id=fcf685ea331147f6abda37a0667abc54, scope.system=all) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:54.544013 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f93b8b6-a1d2-4bd5-b70b-97e41ee562fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:54.545521 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f93b8b6-a1d2-4bd5-b70b-97e41ee562fc None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:54.551395 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 152/308] 10.222.0.27 () {56 vars in 1308 bytes} [Wed Jun 29 12:07:54 2022] GET /identity/v3/role_assignments?user.id=fcf685ea331147f6abda37a0667abc54&scope.system=all&role.id=e2336723b86b456e95b87bce11e66e1c => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:07:54.557495 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36917781-62ca-46a0-88ab-fa664917d680 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:54.582884 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:54.599687 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164fb05a-b8ec-452b-9b27-76f6a08b396c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:54.600925 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164fb05a-b8ec-452b-9b27-76f6a08b396c None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:54.601419 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164fb05a-b8ec-452b-9b27-76f6a08b396c None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:54.601906 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164fb05a-b8ec-452b-9b27-76f6a08b396c None admin] PATH_INFO: `/v3/users/3b893166ad914c979b809acc338d74dc` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:54.603411 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164fb05a-b8ec-452b-9b27-76f6a08b396c None admin] RBAC: Authorizing `identity:get_user(user_id=3b893166ad914c979b809acc338d74dc)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:54.605085 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164fb05a-b8ec-452b-9b27-76f6a08b396c None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:54.607392 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 157/309] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jun 29 12:07:54 2022] GET /identity/v3/users/3b893166ad914c979b809acc338d74dc => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:07:54.613489 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93b8b6-a1d2-4bd5-b70b-97e41ee562fc None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:54.679639 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:54.728209 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93b8b6-a1d2-4bd5-b70b-97e41ee562fc None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:54.764051 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557cc6c0-471d-40f5-8e64-f4ca86b53927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:54.764944 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cc6c0-471d-40f5-8e64-f4ca86b53927 None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:54.765224 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cc6c0-471d-40f5-8e64-f4ca86b53927 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:54.765499 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cc6c0-471d-40f5-8e64-f4ca86b53927 None admin] PATH_INFO: `/v3/system/users/3b893166ad914c979b809acc338d74dc/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:54.767054 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557cc6c0-471d-40f5-8e64-f4ca86b53927 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3b893166ad914c979b809acc338d74dc, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:54.768447 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557cc6c0-471d-40f5-8e64-f4ca86b53927 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:54.780204 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 153/310] 10.222.0.27 () {58 vars in 1334 bytes} [Wed Jun 29 12:07:54 2022] PUT /identity/v3/system/users/3b893166ad914c979b809acc338d74dc/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:07:55.071494 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d51cee-366f-4a9a-bfc8-fbf9172366e0 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:55.071800 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d51cee-366f-4a9a-bfc8-fbf9172366e0 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:55.072047 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d51cee-366f-4a9a-bfc8-fbf9172366e0 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:55.073568 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 158/311] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:07:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:55.079404 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32292c8-4e46-42d5-8d0c-357a784844ba None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:55.079945 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32292c8-4e46-42d5-8d0c-357a784844ba None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:55.080439 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32292c8-4e46-42d5-8d0c-357a784844ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:55.097861 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c32292c8-4e46-42d5-8d0c-357a784844ba None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:55.099389 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c32292c8-4e46-42d5-8d0c-357a784844ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:55.168435 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 154/312] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 12:07:55.191978 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d51cee-366f-4a9a-bfc8-fbf9172366e0 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:55.302322 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d51cee-366f-4a9a-bfc8-fbf9172366e0 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:55.336990 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc539f0-ad14-4e9f-b643-1459885022ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:55.337822 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc539f0-ad14-4e9f-b643-1459885022ed None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:55.338101 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc539f0-ad14-4e9f-b643-1459885022ed None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:55.338372 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc539f0-ad14-4e9f-b643-1459885022ed None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:55.348758 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc539f0-ad14-4e9f-b643-1459885022ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:55.356801 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-1cc539f0-ad14-4e9f-b643-1459885022ed None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 12:07:55.356801 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:55.356801 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:55.356801 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:55.356801 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:55.356801 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:55.356801 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:55.356801 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:55.356801 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:55.356801 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:55.356801 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:55.356801 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:55.356801 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:55.356801 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:55.356801 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:55.356801 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:55.357742 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:55.357742 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:55.357742 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:55.357742 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:55.357742 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:55.357742 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:55.357742 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:55.357742 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:55.357742 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:55.357742 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:55.357742 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:55.357742 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:55.357742 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:55.357742 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:55.357742 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:55.357742 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:55.358548 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:55.358548 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:55.358548 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:55.358548 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:55.358548 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:55.358548 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:55.358548 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:55.358548 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:55.358548 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:55.358548 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:55.358548 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 12:07:55.358548 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:07:55.358548 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 159/313] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:07:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:55.365685 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32292c8-4e46-42d5-8d0c-357a784844ba None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:55.418691 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:55.467478 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32292c8-4e46-42d5-8d0c-357a784844ba None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:55.502487 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3190b61-b0e7-49a1-ad99-fbc75da77682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:55.503166 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3190b61-b0e7-49a1-ad99-fbc75da77682 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:55.503446 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3190b61-b0e7-49a1-ad99-fbc75da77682 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:55.503717 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3190b61-b0e7-49a1-ad99-fbc75da77682 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:55.504474 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3190b61-b0e7-49a1-ad99-fbc75da77682 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:55.504778 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3190b61-b0e7-49a1-ad99-fbc75da77682 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:55.506256 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3190b61-b0e7-49a1-ad99-fbc75da77682 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:55.515169 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 155/314] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jun 29 12:07:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:55.520645 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc539f0-ad14-4e9f-b643-1459885022ed None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:55.571819 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:55.623403 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc539f0-ad14-4e9f-b643-1459885022ed None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:55.656993 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15398b1f-b152-40c5-92a2-2ddf5ebe9727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:55.657894 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15398b1f-b152-40c5-92a2-2ddf5ebe9727 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:55.658173 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15398b1f-b152-40c5-92a2-2ddf5ebe9727 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:55.658442 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15398b1f-b152-40c5-92a2-2ddf5ebe9727 None admin] PATH_INFO: `/v3/users/c28ec579daf646b591ab6b4517d845a5` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:55.659635 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15398b1f-b152-40c5-92a2-2ddf5ebe9727 None admin] RBAC: Authorizing `identity:get_user(user_id=c28ec579daf646b591ab6b4517d845a5)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:55.661168 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15398b1f-b152-40c5-92a2-2ddf5ebe9727 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:55.663371 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 160/315] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jun 29 12:07:55 2022] GET /identity/v3/users/c28ec579daf646b591ab6b4517d845a5 => generated 297 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:55.668970 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3190b61-b0e7-49a1-ad99-fbc75da77682 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:55.780978 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3190b61-b0e7-49a1-ad99-fbc75da77682 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:55.794389 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:55.816819 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4178bc2d-d0f6-4467-9cbf-ff8cb761c704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:55.817479 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178bc2d-d0f6-4467-9cbf-ff8cb761c704 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:55.817788 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178bc2d-d0f6-4467-9cbf-ff8cb761c704 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:55.818071 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178bc2d-d0f6-4467-9cbf-ff8cb761c704 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:55.888372 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4178bc2d-d0f6-4467-9cbf-ff8cb761c704 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:55.889785 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4178bc2d-d0f6-4467-9cbf-ff8cb761c704 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:55.994996 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 156/316] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:07:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:07:56.000573 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15398b1f-b152-40c5-92a2-2ddf5ebe9727 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:56.107695 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15398b1f-b152-40c5-92a2-2ddf5ebe9727 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:56.124632 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:56.135494 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a1c16-b03e-498b-81aa-4a68506ae9c9 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:56.135787 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a1c16-b03e-498b-81aa-4a68506ae9c9 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:56.136063 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a1c16-b03e-498b-81aa-4a68506ae9c9 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:56.137652 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 157/317] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:07:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:07:56.143400 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ed93d-cb11-4035-9e81-aa8db5cf86f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:56.143778 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d642e9-555d-4701-be58-cc9958cc3ef5 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:56.144202 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ed93d-cb11-4035-9e81-aa8db5cf86f2 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:56.144479 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ed93d-cb11-4035-9e81-aa8db5cf86f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:56.144677 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d642e9-555d-4701-be58-cc9958cc3ef5 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:56.144770 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ed93d-cb11-4035-9e81-aa8db5cf86f2 None admin] PATH_INFO: `/v3/projects/e6ee9295413244e9b7233dd64100ffb7` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:56.145217 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d642e9-555d-4701-be58-cc9958cc3ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:56.145994 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436ed93d-cb11-4035-9e81-aa8db5cf86f2 None admin] RBAC: Authorizing `identity:get_project(project_id=e6ee9295413244e9b7233dd64100ffb7)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:56.147890 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436ed93d-cb11-4035-9e81-aa8db5cf86f2 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:56.149871 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 161/318] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jun 29 12:07:55 2022] GET /identity/v3/projects/e6ee9295413244e9b7233dd64100ffb7 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:07:56.158276 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ed93d-cb11-4035-9e81-aa8db5cf86f2 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:56.164627 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-31d642e9-555d-4701-be58-cc9958cc3ef5 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:56.166110 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-31d642e9-555d-4701-be58-cc9958cc3ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:56.176376 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:56.262082 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 158/319] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:56.270730 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ed93d-cb11-4035-9e81-aa8db5cf86f2 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:56.284573 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d642e9-555d-4701-be58-cc9958cc3ef5 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:56.310000 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330914af-5b2f-4741-b470-a9306e303550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:56.311041 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330914af-5b2f-4741-b470-a9306e303550 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:56.311629 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330914af-5b2f-4741-b470-a9306e303550 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:56.312097 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330914af-5b2f-4741-b470-a9306e303550 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:56.313197 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330914af-5b2f-4741-b470-a9306e303550 None admin] RBAC: Adding query filter params (role.id=e2336723b86b456e95b87bce11e66e1c, scope.project.id=e6ee9295413244e9b7233dd64100ffb7, user.id=c28ec579daf646b591ab6b4517d845a5) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:56.313720 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330914af-5b2f-4741-b470-a9306e303550 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:56.315694 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330914af-5b2f-4741-b470-a9306e303550 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:56.322904 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 162/320] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jun 29 12:07:56 2022] GET /identity/v3/role_assignments?user.id=c28ec579daf646b591ab6b4517d845a5&scope.project.id=e6ee9295413244e9b7233dd64100ffb7&role.id=e2336723b86b456e95b87bce11e66e1c => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:56.404431 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d642e9-555d-4701-be58-cc9958cc3ef5 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:56.442605 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d958fdb5-643e-429a-9c02-da7fed33e81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:56.443704 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d958fdb5-643e-429a-9c02-da7fed33e81a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:56.444093 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d958fdb5-643e-429a-9c02-da7fed33e81a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:56.444369 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d958fdb5-643e-429a-9c02-da7fed33e81a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:56.445650 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d958fdb5-643e-429a-9c02-da7fed33e81a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:56.447246 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d958fdb5-643e-429a-9c02-da7fed33e81a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:56.449191 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 159/321] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:07:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:07:56.455242 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330914af-5b2f-4741-b470-a9306e303550 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:56.516501 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:56.572114 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330914af-5b2f-4741-b470-a9306e303550 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:56.612770 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc59101-add7-4bdb-b6fb-bcc1a813dc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:56.613447 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc59101-add7-4bdb-b6fb-bcc1a813dc73 None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:56.613746 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc59101-add7-4bdb-b6fb-bcc1a813dc73 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:56.614020 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc59101-add7-4bdb-b6fb-bcc1a813dc73 None admin] PATH_INFO: `/v3/groups` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:56.614727 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc59101-add7-4bdb-b6fb-bcc1a813dc73 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:56.616809 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc59101-add7-4bdb-b6fb-bcc1a813dc73 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:56.634838 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 163/322] 10.222.0.27 () {60 vars in 1134 bytes} [Wed Jun 29 12:07:56 2022] POST /identity/v3/groups => generated 226 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:07:56.753470 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa859f0-eece-4289-8921-2c91b90c8f78 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:56.754557 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa859f0-eece-4289-8921-2c91b90c8f78 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:56.755038 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa859f0-eece-4289-8921-2c91b90c8f78 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:56.756694 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 160/323] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:07:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:56.763075 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c680651d-9630-48c5-af42-99eef7f4d894 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:56.763547 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c680651d-9630-48c5-af42-99eef7f4d894 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:56.763831 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c680651d-9630-48c5-af42-99eef7f4d894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:56.782560 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-c680651d-9630-48c5-af42-99eef7f4d894 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:56.783821 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-c680651d-9630-48c5-af42-99eef7f4d894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:56.859880 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 164/324] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:56.874621 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f2916-fe80-46a4-9276-cd7142050694 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:56.874884 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f2916-fe80-46a4-9276-cd7142050694 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:56.875335 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f2916-fe80-46a4-9276-cd7142050694 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:56.876690 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 161/325] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:07:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:56.882385 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0adc446-eac4-4cd2-97da-9330f0966690 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:56.882624 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0adc446-eac4-4cd2-97da-9330f0966690 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:56.882903 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0adc446-eac4-4cd2-97da-9330f0966690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:56.883142 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f2916-fe80-46a4-9276-cd7142050694 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:56.898825 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:56.904208 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-f0adc446-eac4-4cd2-97da-9330f0966690 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:56.906224 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-f0adc446-eac4-4cd2-97da-9330f0966690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:56.950268 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:57.011424 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 165/326] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:57.021721 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f2916-fe80-46a4-9276-cd7142050694 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:57.034423 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0adc446-eac4-4cd2-97da-9330f0966690 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:57.067181 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f294c43-4767-4581-94d9-c7ef3d1006f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:57.068726 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f294c43-4767-4581-94d9-c7ef3d1006f2 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:57.069458 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f294c43-4767-4581-94d9-c7ef3d1006f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:57.069907 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f294c43-4767-4581-94d9-c7ef3d1006f2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:57.082971 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f294c43-4767-4581-94d9-c7ef3d1006f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:57.091263 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-8f294c43-4767-4581-94d9-c7ef3d1006f2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 12:07:57.091263 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:57.091263 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:57.091263 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:57.091263 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:57.091263 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:57.091263 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:57.091263 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:57.091263 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:57.091263 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:57.091263 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:57.091263 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:57.091263 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:57.091263 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:57.091263 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:57.091263 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:57.092284 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:57.092284 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:57.092284 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:57.092284 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:57.092284 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:57.092284 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:57.092284 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:57.092284 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:57.092284 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:57.092284 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:57.092284 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:57.092284 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:57.092284 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:57.092284 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:57.092284 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:57.092284 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:57.093079 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:57.093079 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:57.093079 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:57.093079 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:57.093079 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:57.093079 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:57.093079 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:57.093079 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:57.093079 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:57.093079 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:57.093079 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 12:07:57.093079 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:07:57.095781 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 162/327] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:07:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:57.102883 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f294c43-4767-4581-94d9-c7ef3d1006f2 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:57.174967 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0adc446-eac4-4cd2-97da-9330f0966690 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:57.201392 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:57.219263 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b88701-468f-40b7-ae26-a3036e9aa8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:57.220647 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b88701-468f-40b7-ae26-a3036e9aa8c4 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:57.221107 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b88701-468f-40b7-ae26-a3036e9aa8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:57.221586 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b88701-468f-40b7-ae26-a3036e9aa8c4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:57.234480 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b88701-468f-40b7-ae26-a3036e9aa8c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:57.242420 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f294c43-4767-4581-94d9-c7ef3d1006f2 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:57.243630 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-51b88701-468f-40b7-ae26-a3036e9aa8c4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:07:57.243630 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:57.243630 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:57.243630 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:57.243630 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:57.243630 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:57.243630 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:57.243630 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:57.243630 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:57.243630 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:57.243630 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:57.243630 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:57.243630 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:57.243630 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:57.243630 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:57.243630 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:57.244479 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:57.244479 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:57.244479 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:57.244479 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:57.244479 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:57.244479 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:57.244479 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:57.244479 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:57.244479 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:57.244479 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:57.244479 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:57.244479 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:57.244479 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:57.244479 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:57.244479 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:57.244479 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:57.245281 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:57.245281 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:57.245281 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:57.245281 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:57.245281 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:57.245281 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:57.245281 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:57.245281 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:57.245281 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:57.245281 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:57.245281 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:07:57.245281 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:07:57.251597 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 166/328] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:07:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:57.254036 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b88701-468f-40b7-ae26-a3036e9aa8c4 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:57.284849 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637afc2d-2543-4475-898e-0c9cf64a2188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:57.286473 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637afc2d-2543-4475-898e-0c9cf64a2188 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:57.287479 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637afc2d-2543-4475-898e-0c9cf64a2188 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:57.287969 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637afc2d-2543-4475-898e-0c9cf64a2188 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:57.289631 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637afc2d-2543-4475-898e-0c9cf64a2188 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:57.290183 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637afc2d-2543-4475-898e-0c9cf64a2188 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:57.290414 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:57.294136 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637afc2d-2543-4475-898e-0c9cf64a2188 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:57.306965 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 163/329] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jun 29 12:07:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:07:57.312832 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637afc2d-2543-4475-898e-0c9cf64a2188 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:57.377880 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b88701-468f-40b7-ae26-a3036e9aa8c4 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:57.413344 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7256a-2ad5-434c-943d-69ca8bcb05ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:57.414340 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7256a-2ad5-434c-943d-69ca8bcb05ce None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:57.414759 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7256a-2ad5-434c-943d-69ca8bcb05ce None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:57.415166 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7256a-2ad5-434c-943d-69ca8bcb05ce None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:57.416059 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f7256a-2ad5-434c-943d-69ca8bcb05ce None admin] RBAC: Adding query filter params (name=member) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:57.416513 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f7256a-2ad5-434c-943d-69ca8bcb05ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:57.418068 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f7256a-2ad5-434c-943d-69ca8bcb05ce None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:57.426171 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637afc2d-2543-4475-898e-0c9cf64a2188 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:57.427514 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 167/330] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jun 29 12:07:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:57.434272 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7256a-2ad5-434c-943d-69ca8bcb05ce None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:57.458570 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:57.463736 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a35e11-c08a-4e93-a5d2-2268e44bfe51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:57.464777 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a35e11-c08a-4e93-a5d2-2268e44bfe51 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:57.465081 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a35e11-c08a-4e93-a5d2-2268e44bfe51 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:57.465625 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a35e11-c08a-4e93-a5d2-2268e44bfe51 None admin] PATH_INFO: `/v3/users/fcf685ea331147f6abda37a0667abc54` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:57.466581 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a35e11-c08a-4e93-a5d2-2268e44bfe51 None admin] RBAC: Authorizing `identity:get_user(user_id=fcf685ea331147f6abda37a0667abc54)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:57.468218 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a35e11-c08a-4e93-a5d2-2268e44bfe51 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:57.471352 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 164/331] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jun 29 12:07:57 2022] GET /identity/v3/users/fcf685ea331147f6abda37a0667abc54 => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:07:57.478044 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a35e11-c08a-4e93-a5d2-2268e44bfe51 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:57.544311 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:57.559649 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7256a-2ad5-434c-943d-69ca8bcb05ce None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:57.606224 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36098bb4-bbb9-404f-9a20-c52f9c36c2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:57.607902 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36098bb4-bbb9-404f-9a20-c52f9c36c2ab None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:57.608396 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36098bb4-bbb9-404f-9a20-c52f9c36c2ab None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:57.609973 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36098bb4-bbb9-404f-9a20-c52f9c36c2ab None admin] PATH_INFO: `/v3/users/3b893166ad914c979b809acc338d74dc` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:57.611555 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36098bb4-bbb9-404f-9a20-c52f9c36c2ab None admin] RBAC: Authorizing `identity:get_user(user_id=3b893166ad914c979b809acc338d74dc)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:57.613469 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36098bb4-bbb9-404f-9a20-c52f9c36c2ab None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:57.615356 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 168/332] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jun 29 12:07:57 2022] GET /identity/v3/users/3b893166ad914c979b809acc338d74dc => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:07:57.619916 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a35e11-c08a-4e93-a5d2-2268e44bfe51 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:57.622438 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36098bb4-bbb9-404f-9a20-c52f9c36c2ab None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:57.663886 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69464138-a428-4b68-8abb-bf2704b1910e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:57.665150 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69464138-a428-4b68-8abb-bf2704b1910e None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:57.665438 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69464138-a428-4b68-8abb-bf2704b1910e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:57.665721 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69464138-a428-4b68-8abb-bf2704b1910e None admin] PATH_INFO: `/v3/system/users/fcf685ea331147f6abda37a0667abc54/roles/e2336723b86b456e95b87bce11e66e1c` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:57.667288 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69464138-a428-4b68-8abb-bf2704b1910e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=fcf685ea331147f6abda37a0667abc54, role_id=e2336723b86b456e95b87bce11e66e1c)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:57.668815 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69464138-a428-4b68-8abb-bf2704b1910e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:57.683735 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 165/333] 10.222.0.27 () {58 vars in 1334 bytes} [Wed Jun 29 12:07:57 2022] PUT /identity/v3/system/users/fcf685ea331147f6abda37a0667abc54/roles/e2336723b86b456e95b87bce11e66e1c => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:07:57.749075 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36098bb4-bbb9-404f-9a20-c52f9c36c2ab None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:57.789904 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b91c544-0ab4-4c91-8cca-e6912a305ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:57.790635 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91c544-0ab4-4c91-8cca-e6912a305ea4 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:57.790925 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91c544-0ab4-4c91-8cca-e6912a305ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:57.791203 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91c544-0ab4-4c91-8cca-e6912a305ea4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:57.792058 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b91c544-0ab4-4c91-8cca-e6912a305ea4 None admin] RBAC: Adding query filter params (role.id=c49accbc6f81447cb221ef720db04ced, user.id=3b893166ad914c979b809acc338d74dc, scope.system=all) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:57.792373 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b91c544-0ab4-4c91-8cca-e6912a305ea4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:57.793883 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b91c544-0ab4-4c91-8cca-e6912a305ea4 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:57.808668 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 169/334] 10.222.0.27 () {56 vars in 1308 bytes} [Wed Jun 29 12:07:57 2022] GET /identity/v3/role_assignments?user.id=3b893166ad914c979b809acc338d74dc&scope.system=all&role.id=c49accbc6f81447cb221ef720db04ced => generated 510 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:07:59.204445 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50d5bd-97b1-4c83-8c87-c6fad5160de6 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:59.205478 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50d5bd-97b1-4c83-8c87-c6fad5160de6 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:59.205989 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50d5bd-97b1-4c83-8c87-c6fad5160de6 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:59.207827 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 166/335] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:07:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:59.215859 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b59e7-582d-4514-bc13-e3066568d23a None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:59.216738 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b59e7-582d-4514-bc13-e3066568d23a None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:59.217211 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b59e7-582d-4514-bc13-e3066568d23a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:59.238925 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-d42b59e7-582d-4514-bc13-e3066568d23a None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:59.240110 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-d42b59e7-582d-4514-bc13-e3066568d23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:59.254140 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:59.323688 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 170/336] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 12:07:59.369280 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c50d5bd-97b1-4c83-8c87-c6fad5160de6 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:59.413428 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6aa622-b0b1-4d0e-b06c-ebff491cae1c None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:59.414101 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6aa622-b0b1-4d0e-b06c-ebff491cae1c None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:59.414594 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6aa622-b0b1-4d0e-b06c-ebff491cae1c None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:59.416223 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 171/337] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:07:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:07:59.422290 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9f66f-7ce5-4952-aa8a-baa864a71219 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:59.422826 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9f66f-7ce5-4952-aa8a-baa864a71219 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:59.423291 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9f66f-7ce5-4952-aa8a-baa864a71219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:59.451892 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-e0b9f66f-7ce5-4952-aa8a-baa864a71219 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:07:59.453413 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e0b9f66f-7ce5-4952-aa8a-baa864a71219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:07:59.466189 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:59.533000 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c50d5bd-97b1-4c83-8c87-c6fad5160de6 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:59.578562 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8dc52e-e7d3-4b0f-a674-4763878f0503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:59.579298 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8dc52e-e7d3-4b0f-a674-4763878f0503 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:59.579580 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8dc52e-e7d3-4b0f-a674-4763878f0503 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:59.579854 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8dc52e-e7d3-4b0f-a674-4763878f0503 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:59.614652 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8dc52e-e7d3-4b0f-a674-4763878f0503 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:07:59.631797 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-4d8dc52e-e7d3-4b0f-a674-4763878f0503 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:07:59.631797 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:07:59.631797 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:07:59.631797 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:07:59.631797 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:07:59.631797 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:07:59.631797 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:07:59.631797 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:07:59.631797 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:07:59.631797 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:07:59.631797 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:07:59.631797 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:07:59.631797 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:07:59.631797 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:07:59.631797 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:07:59.631797 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:07:59.632780 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:07:59.632780 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:07:59.632780 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:07:59.632780 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:07:59.632780 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:07:59.632780 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:07:59.632780 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:07:59.632780 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:07:59.632780 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:07:59.632780 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:07:59.632780 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:07:59.632780 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:07:59.632780 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:07:59.632780 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:07:59.632780 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:07:59.632780 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:07:59.634089 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:07:59.634089 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:07:59.634089 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:07:59.634089 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:07:59.634089 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:07:59.634089 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:07:59.634089 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:07:59.634089 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:07:59.634089 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:07:59.634089 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:07:59.634089 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:07:59.634089 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:07:59.634089 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 167/338] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:07:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:07:59.635278 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 172/339] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:07:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:07:59.639338 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8dc52e-e7d3-4b0f-a674-4763878f0503 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:59.690897 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b9f66f-7ce5-4952-aa8a-baa864a71219 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:07:59.874809 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8dc52e-e7d3-4b0f-a674-4763878f0503 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:07:59.926289 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:59.935852 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:07:59.982846 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83450e1e-c062-4d1f-8964-705b06203843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:07:59.983979 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83450e1e-c062-4d1f-8964-705b06203843 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:07:59.984472 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83450e1e-c062-4d1f-8964-705b06203843 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:07:59.984957 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83450e1e-c062-4d1f-8964-705b06203843 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:07:59.986346 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83450e1e-c062-4d1f-8964-705b06203843 None admin] RBAC: Adding query filter params (name=member) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:07:59.986887 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83450e1e-c062-4d1f-8964-705b06203843 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:07:59.989481 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83450e1e-c062-4d1f-8964-705b06203843 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:07:59.992640 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b9f66f-7ce5-4952-aa8a-baa864a71219 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:00.005773 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 168/340] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jun 29 12:07:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:00.014708 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83450e1e-c062-4d1f-8964-705b06203843 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:00.114990 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a09742-0bca-4e9a-94b7-dbb91fc53c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:00.115865 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a09742-0bca-4e9a-94b7-dbb91fc53c2a None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:00.116297 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a09742-0bca-4e9a-94b7-dbb91fc53c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:00.116577 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a09742-0bca-4e9a-94b7-dbb91fc53c2a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:00.132110 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a09742-0bca-4e9a-94b7-dbb91fc53c2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:08:00.143240 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-b8a09742-0bca-4e9a-94b7-dbb91fc53c2a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 12:08:00.143240 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:00.143240 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:00.143240 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:00.143240 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:00.143240 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:00.143240 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:00.143240 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:00.143240 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:00.143240 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:00.143240 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:00.143240 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:00.143240 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:08:00.143240 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:08:00.143240 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:08:00.143240 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:08:00.144900 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:08:00.144900 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:08:00.144900 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:08:00.144900 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:08:00.144900 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:00.144900 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:00.144900 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:00.144900 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:00.144900 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:00.144900 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:00.144900 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:00.144900 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:00.144900 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:00.144900 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:00.144900 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:00.144900 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:00.147421 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:00.147421 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:00.147421 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:00.147421 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:00.147421 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:08:00.147421 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:08:00.147421 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:08:00.147421 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:08:00.147421 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:08:00.147421 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:08:00.147421 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 12:08:00.147421 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:00.147421 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 173/341] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jun 29 12:07:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 454 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:00.153912 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a09742-0bca-4e9a-94b7-dbb91fc53c2a None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:00.165668 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83450e1e-c062-4d1f-8964-705b06203843 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:00.225826 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ca231-f36f-4efb-97e9-bf5cf4d26ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:00.226958 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ca231-f36f-4efb-97e9-bf5cf4d26ab0 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:00.226958 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ca231-f36f-4efb-97e9-bf5cf4d26ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:00.227424 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ca231-f36f-4efb-97e9-bf5cf4d26ab0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:00.280977 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a09742-0bca-4e9a-94b7-dbb91fc53c2a None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:00.320495 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8230876c-87cd-4b4c-9181-912cb3ba735a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:00.321183 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230876c-87cd-4b4c-9181-912cb3ba735a None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:00.321452 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230876c-87cd-4b4c-9181-912cb3ba735a None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:00.321768 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230876c-87cd-4b4c-9181-912cb3ba735a None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:00.322542 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8230876c-87cd-4b4c-9181-912cb3ba735a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:00.322844 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8230876c-87cd-4b4c-9181-912cb3ba735a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:00.324265 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8230876c-87cd-4b4c-9181-912cb3ba735a None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:00.334850 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 174/342] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jun 29 12:08:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:00.335699 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:00.342697 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8230876c-87cd-4b4c-9181-912cb3ba735a None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:00.379295 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:00.407057 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ca231-f36f-4efb-97e9-bf5cf4d26ab0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:00.408488 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ca231-f36f-4efb-97e9-bf5cf4d26ab0 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:00.467602 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8230876c-87cd-4b4c-9181-912cb3ba735a None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:00.529176 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31777bcc-7f05-4e2e-8215-9bbeba5e5263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:00.530188 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31777bcc-7f05-4e2e-8215-9bbeba5e5263 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:00.530646 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31777bcc-7f05-4e2e-8215-9bbeba5e5263 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:00.531285 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31777bcc-7f05-4e2e-8215-9bbeba5e5263 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:00.627718 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31777bcc-7f05-4e2e-8215-9bbeba5e5263 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:00.629487 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31777bcc-7f05-4e2e-8215-9bbeba5e5263 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:00.661987 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:00.662941 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 169/343] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:08:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 649 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 29 12:08:00.668250 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10764b27-66ed-41c3-9b4c-2e57b7a06c0a None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:00.668752 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10764b27-66ed-41c3-9b4c-2e57b7a06c0a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:00.669295 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10764b27-66ed-41c3-9b4c-2e57b7a06c0a None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:00.672122 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 170/344] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:08:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:00.679512 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10764b27-66ed-41c3-9b4c-2e57b7a06c0a None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:00.804409 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 175/345] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:08:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 29 12:08:00.806203 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b3758-2cf8-495d-91d4-ecd1c2e1b445 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:00.806810 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b3758-2cf8-495d-91d4-ecd1c2e1b445 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:00.807258 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b3758-2cf8-495d-91d4-ecd1c2e1b445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:00.844365 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-a80b3758-2cf8-495d-91d4-ecd1c2e1b445 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:00.848240 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a80b3758-2cf8-495d-91d4-ecd1c2e1b445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:00.901436 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:00.939527 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10764b27-66ed-41c3-9b4c-2e57b7a06c0a None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:00.945810 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 176/346] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:08:00.946896 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b3758-2cf8-495d-91d4-ecd1c2e1b445 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:00.986341 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:01.007616 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b154f1-0f69-4349-a989-7f8918d94a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:01.008503 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b154f1-0f69-4349-a989-7f8918d94a7b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:01.008785 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b154f1-0f69-4349-a989-7f8918d94a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:01.009059 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b154f1-0f69-4349-a989-7f8918d94a7b None admin] PATH_INFO: `/v3/projects/dcc3d4b81e0d470bab2492f8eb193665` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:01.010545 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b154f1-0f69-4349-a989-7f8918d94a7b None admin] RBAC: Authorizing `identity:get_project(project_id=dcc3d4b81e0d470bab2492f8eb193665)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:01.011847 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b154f1-0f69-4349-a989-7f8918d94a7b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:01.013588 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 171/347] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jun 29 12:08:00 2022] GET /identity/v3/projects/dcc3d4b81e0d470bab2492f8eb193665 => generated 298 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:01.014570 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b154f1-0f69-4349-a989-7f8918d94a7b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:01.063586 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b3758-2cf8-495d-91d4-ecd1c2e1b445 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:01.103393 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1892fee2-373b-4abe-bf17-fb8d720b5918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:01.104377 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892fee2-373b-4abe-bf17-fb8d720b5918 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:01.104757 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892fee2-373b-4abe-bf17-fb8d720b5918 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:01.105067 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892fee2-373b-4abe-bf17-fb8d720b5918 None admin] PATH_INFO: `/v3/projects/dcc3d4b81e0d470bab2492f8eb193665` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:01.106422 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1892fee2-373b-4abe-bf17-fb8d720b5918 None admin] RBAC: Authorizing `identity:get_project(project_id=dcc3d4b81e0d470bab2492f8eb193665)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:01.108238 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1892fee2-373b-4abe-bf17-fb8d720b5918 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:01.110233 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 177/348] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jun 29 12:08:00 2022] GET /identity/v3/projects/dcc3d4b81e0d470bab2492f8eb193665 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:01.111034 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1892fee2-373b-4abe-bf17-fb8d720b5918 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:01.174059 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b154f1-0f69-4349-a989-7f8918d94a7b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:01.219767 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:01.225470 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ab62d-4203-4474-9ff2-f917211b77e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:01.226010 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ab62d-4203-4474-9ff2-f917211b77e1 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:01.226629 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ab62d-4203-4474-9ff2-f917211b77e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:01.226629 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ab62d-4203-4474-9ff2-f917211b77e1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:01.226760 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1892fee2-373b-4abe-bf17-fb8d720b5918 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:01.237815 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676ab62d-4203-4474-9ff2-f917211b77e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:08:01.247083 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-676ab62d-4203-4474-9ff2-f917211b77e1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:08:01.247083 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:01.247083 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:01.247083 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:01.247083 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:01.247083 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:01.247083 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:01.247083 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:01.247083 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:01.247083 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:01.247083 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:01.247083 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:01.247083 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:08:01.247083 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:08:01.247083 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:08:01.247083 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:08:01.248029 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:08:01.248029 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:08:01.248029 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:08:01.248029 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:08:01.248029 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:01.248029 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:01.248029 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:01.248029 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:01.248029 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:01.248029 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:01.248029 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:01.248029 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:01.248029 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:01.248029 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:01.248029 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:01.248029 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:01.248842 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:01.248842 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:01.248842 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:01.248842 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:01.248842 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:08:01.248842 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:08:01.248842 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:08:01.248842 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:08:01.248842 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:08:01.248842 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:08:01.248842 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:08:01.248842 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:01.248842 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 172/349] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:08:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:01.249514 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ab62d-4203-4474-9ff2-f917211b77e1 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:01.265343 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec6246f-36be-42a7-9c2c-9b1b0cc36c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:01.266299 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6246f-36be-42a7-9c2c-9b1b0cc36c9c None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:01.266588 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6246f-36be-42a7-9c2c-9b1b0cc36c9c None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:01.266866 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6246f-36be-42a7-9c2c-9b1b0cc36c9c None admin] PATH_INFO: `/v3/groups/c108973954db4096ae0c3c3a2e903362` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:01.267341 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:01.273971 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec6246f-36be-42a7-9c2c-9b1b0cc36c9c None admin] RBAC: Authorizing `identity:get_group(group_id=c108973954db4096ae0c3c3a2e903362)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:01.275720 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec6246f-36be-42a7-9c2c-9b1b0cc36c9c None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:01.279117 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 178/350] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Jun 29 12:08:01 2022] GET /identity/v3/groups/c108973954db4096ae0c3c3a2e903362 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:01.280430 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa02e3-633d-44d7-9b70-9d78b14fdc1a None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:01.280714 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa02e3-633d-44d7-9b70-9d78b14fdc1a None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:01.280989 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa02e3-633d-44d7-9b70-9d78b14fdc1a None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:01.282551 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 179/351] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:08:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:01.283253 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa02e3-633d-44d7-9b70-9d78b14fdc1a None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:01.380592 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ab62d-4203-4474-9ff2-f917211b77e1 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:01.399363 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa02e3-633d-44d7-9b70-9d78b14fdc1a None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:01.419080 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd181df-a1e9-4fcb-b8a7-658e88796424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:01.419961 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd181df-a1e9-4fcb-b8a7-658e88796424 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:01.420247 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd181df-a1e9-4fcb-b8a7-658e88796424 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:01.420525 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd181df-a1e9-4fcb-b8a7-658e88796424 None admin] PATH_INFO: `/v3/groups/c108973954db4096ae0c3c3a2e903362` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:01.421788 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd181df-a1e9-4fcb-b8a7-658e88796424 None admin] RBAC: Authorizing `identity:get_group(group_id=c108973954db4096ae0c3c3a2e903362)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:01.423245 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd181df-a1e9-4fcb-b8a7-658e88796424 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:01.429812 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 173/352] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Jun 29 12:08:01 2022] GET /identity/v3/groups/c108973954db4096ae0c3c3a2e903362 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:01.431155 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e54bf-0dbd-43f1-9342-dfb9504c10e4 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:01.431422 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e54bf-0dbd-43f1-9342-dfb9504c10e4 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:01.432371 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e54bf-0dbd-43f1-9342-dfb9504c10e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:01.451053 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d44e575-fb34-43d6-b845-1be25ab79b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:01.451894 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-769e54bf-0dbd-43f1-9342-dfb9504c10e4 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:01.452142 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44e575-fb34-43d6-b845-1be25ab79b82 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:01.452426 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44e575-fb34-43d6-b845-1be25ab79b82 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:01.453211 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44e575-fb34-43d6-b845-1be25ab79b82 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:01.453472 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-769e54bf-0dbd-43f1-9342-dfb9504c10e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:01.454020 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d44e575-fb34-43d6-b845-1be25ab79b82 None admin] RBAC: Adding query filter params (name=member) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:01.454417 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d44e575-fb34-43d6-b845-1be25ab79b82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:01.456955 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d44e575-fb34-43d6-b845-1be25ab79b82 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:01.468012 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 180/353] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jun 29 12:08:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:01.469165 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d44e575-fb34-43d6-b845-1be25ab79b82 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:01.504194 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:01.551881 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 174/354] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:08:01.553404 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8aa755-7c74-4c90-a67f-b4dfd0f5a14d None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:01.553404 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8aa755-7c74-4c90-a67f-b4dfd0f5a14d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:01.554077 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8aa755-7c74-4c90-a67f-b4dfd0f5a14d None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:01.555454 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 175/355] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:08:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:01.556170 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8aa755-7c74-4c90-a67f-b4dfd0f5a14d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:01.572531 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:01.608033 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d44e575-fb34-43d6-b845-1be25ab79b82 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:01.649028 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ffc4f8-4398-4afd-b2fa-9b7c7d60d8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:01.649763 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffc4f8-4398-4afd-b2fa-9b7c7d60d8f0 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:01.650032 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffc4f8-4398-4afd-b2fa-9b7c7d60d8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:01.650309 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffc4f8-4398-4afd-b2fa-9b7c7d60d8f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:01.651155 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ffc4f8-4398-4afd-b2fa-9b7c7d60d8f0 None admin] RBAC: Adding query filter params (group.id=c108973954db4096ae0c3c3a2e903362, role.id=c49accbc6f81447cb221ef720db04ced, scope.project.id=dcc3d4b81e0d470bab2492f8eb193665) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:01.651471 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ffc4f8-4398-4afd-b2fa-9b7c7d60d8f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:01.652972 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ffc4f8-4398-4afd-b2fa-9b7c7d60d8f0 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:01.658984 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 181/356] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Jun 29 12:08:01 2022] GET /identity/v3/role_assignments?group.id=c108973954db4096ae0c3c3a2e903362&scope.project.id=dcc3d4b81e0d470bab2492f8eb193665&role.id=c49accbc6f81447cb221ef720db04ced => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:01.662410 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ffc4f8-4398-4afd-b2fa-9b7c7d60d8f0 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:01.676060 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8aa755-7c74-4c90-a67f-b4dfd0f5a14d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:01.718653 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a103d4c-4f3e-49e0-9e56-3cd38b11c25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:01.719722 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a103d4c-4f3e-49e0-9e56-3cd38b11c25c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:01.720217 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a103d4c-4f3e-49e0-9e56-3cd38b11c25c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:01.720710 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a103d4c-4f3e-49e0-9e56-3cd38b11c25c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:01.721641 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a103d4c-4f3e-49e0-9e56-3cd38b11c25c None admin] RBAC: Adding query filter params (group.id=c108973954db4096ae0c3c3a2e903362, role.id=ea54879a52d24a47bada5629b6d8b456, scope.project.id=dcc3d4b81e0d470bab2492f8eb193665) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:01.722048 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a103d4c-4f3e-49e0-9e56-3cd38b11c25c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:01.723599 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a103d4c-4f3e-49e0-9e56-3cd38b11c25c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:01.736113 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 176/357] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Jun 29 12:08:01 2022] GET /identity/v3/role_assignments?group.id=c108973954db4096ae0c3c3a2e903362&scope.project.id=dcc3d4b81e0d470bab2492f8eb193665&role.id=ea54879a52d24a47bada5629b6d8b456 => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:01.736113 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3c6a7-fa99-4da4-93b8-c32dde9e1954 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:01.736113 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3c6a7-fa99-4da4-93b8-c32dde9e1954 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:01.736113 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3c6a7-fa99-4da4-93b8-c32dde9e1954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:01.772463 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-6ac3c6a7-fa99-4da4-93b8-c32dde9e1954 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:01.772463 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6ac3c6a7-fa99-4da4-93b8-c32dde9e1954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:01.792417 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:01.809771 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ffc4f8-4398-4afd-b2fa-9b7c7d60d8f0 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:01.865084 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ea00f-a421-48a9-9938-f7f69ec7d195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:01.866421 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ea00f-a421-48a9-9938-f7f69ec7d195 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:01.866897 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ea00f-a421-48a9-9938-f7f69ec7d195 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:01.867425 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ea00f-a421-48a9-9938-f7f69ec7d195 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:01.913163 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 177/358] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:08:01.919061 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac3c6a7-fa99-4da4-93b8-c32dde9e1954 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:01.932605 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:02.043098 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ea00f-a421-48a9-9938-f7f69ec7d195 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:02.044681 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ea00f-a421-48a9-9938-f7f69ec7d195 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:02.054722 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac3c6a7-fa99-4da4-93b8-c32dde9e1954 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:02.094650 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d3af9f-e209-4e33-90b4-a173b7ae54bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:02.095805 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3af9f-e209-4e33-90b4-a173b7ae54bd None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:02.096267 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3af9f-e209-4e33-90b4-a173b7ae54bd None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:02.096708 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3af9f-e209-4e33-90b4-a173b7ae54bd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:02.108484 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d3af9f-e209-4e33-90b4-a173b7ae54bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:08:02.116758 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-e8d3af9f-e209-4e33-90b4-a173b7ae54bd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 12:08:02.116758 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:02.116758 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:02.116758 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:02.116758 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:02.116758 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:02.116758 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:02.116758 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:02.116758 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:02.116758 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:02.116758 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:02.116758 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:02.116758 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:08:02.116758 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:08:02.116758 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:08:02.116758 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:08:02.117711 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:08:02.117711 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:08:02.117711 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:08:02.117711 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:08:02.117711 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:02.117711 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:02.117711 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:02.117711 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:02.117711 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:02.117711 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:02.117711 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:02.117711 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:02.117711 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:02.117711 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:02.117711 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:02.117711 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:02.118559 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:02.118559 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:02.118559 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:02.118559 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:02.118559 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:08:02.118559 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:08:02.118559 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:08:02.118559 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:08:02.118559 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:08:02.118559 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:08:02.118559 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 12:08:02.118559 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:02.120980 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 178/359] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:08:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:02.122056 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d3af9f-e209-4e33-90b4-a173b7ae54bd None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:02.190998 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:02.194171 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:02.233176 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 182/360] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:08:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:08:02.233176 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ea00f-a421-48a9-9938-f7f69ec7d195 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:02.234321 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d3af9f-e209-4e33-90b4-a173b7ae54bd None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:02.274499 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c0a522-c53f-4d91-8e47-c7ad1f0a1b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:02.275573 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0a522-c53f-4d91-8e47-c7ad1f0a1b2f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:02.276000 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0a522-c53f-4d91-8e47-c7ad1f0a1b2f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:02.276441 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0a522-c53f-4d91-8e47-c7ad1f0a1b2f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:02.291246 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c0a522-c53f-4d91-8e47-c7ad1f0a1b2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:08:02.299693 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-24c0a522-c53f-4d91-8e47-c7ad1f0a1b2f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 12:08:02.299693 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:02.299693 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:02.299693 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:02.299693 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:02.299693 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:02.299693 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:02.299693 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:02.299693 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:02.299693 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:02.299693 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:02.299693 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:02.299693 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:08:02.299693 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:08:02.299693 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:08:02.299693 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:08:02.300810 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:08:02.300810 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:08:02.300810 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:08:02.300810 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:08:02.300810 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:02.300810 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:02.300810 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:02.300810 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:02.300810 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:02.300810 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:02.300810 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:02.300810 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:02.300810 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:02.300810 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:02.300810 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:02.300810 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:02.301880 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:02.301880 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:02.301880 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:02.301880 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:02.301880 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:08:02.301880 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:08:02.301880 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:08:02.301880 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:08:02.301880 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:08:02.301880 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:08:02.301880 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 12:08:02.301880 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:02.305911 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 179/361] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jun 29 12:08:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:02.305911 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c0a522-c53f-4d91-8e47-c7ad1f0a1b2f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:02.387950 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ea00f-a421-48a9-9938-f7f69ec7d195 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:02.421585 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c0a522-c53f-4d91-8e47-c7ad1f0a1b2f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:02.432731 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a468b-1df3-4a04-91e2-669523129b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:02.433428 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a468b-1df3-4a04-91e2-669523129b44 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:02.433731 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a468b-1df3-4a04-91e2-669523129b44 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:02.434007 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a468b-1df3-4a04-91e2-669523129b44 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:02.435183 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5a468b-1df3-4a04-91e2-669523129b44 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:02.435499 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5a468b-1df3-4a04-91e2-669523129b44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:02.437191 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5a468b-1df3-4a04-91e2-669523129b44 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:02.449083 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 183/362] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jun 29 12:08:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:02.450692 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a636b-b758-4410-b94e-f5d673074704 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:02.450978 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a636b-b758-4410-b94e-f5d673074704 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:02.451620 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a636b-b758-4410-b94e-f5d673074704 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:02.453572 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 184/363] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:08:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:02.458300 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4a636b-b758-4410-b94e-f5d673074704 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:02.459809 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:02.471019 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da43b6f5-de9a-4bd9-a255-926b115a04a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:02.472250 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43b6f5-de9a-4bd9-a255-926b115a04a5 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:02.472756 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43b6f5-de9a-4bd9-a255-926b115a04a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:02.473343 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43b6f5-de9a-4bd9-a255-926b115a04a5 None admin] PATH_INFO: `/v3/projects/e6ee9295413244e9b7233dd64100ffb7` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:02.475597 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da43b6f5-de9a-4bd9-a255-926b115a04a5 None admin] RBAC: Authorizing `identity:get_project(project_id=e6ee9295413244e9b7233dd64100ffb7)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:02.477167 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da43b6f5-de9a-4bd9-a255-926b115a04a5 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:02.481114 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 180/364] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jun 29 12:08:02 2022] GET /identity/v3/projects/e6ee9295413244e9b7233dd64100ffb7 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:02.487096 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da43b6f5-de9a-4bd9-a255-926b115a04a5 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:02.531753 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:02.608502 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4a636b-b758-4410-b94e-f5d673074704 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:02.618193 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da43b6f5-de9a-4bd9-a255-926b115a04a5 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:02.653830 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad11d0-c70e-4079-95ed-6ae8d02a68e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:02.654930 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad11d0-c70e-4079-95ed-6ae8d02a68e0 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:02.655435 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad11d0-c70e-4079-95ed-6ae8d02a68e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:02.656292 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad11d0-c70e-4079-95ed-6ae8d02a68e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:02.657551 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ad11d0-c70e-4079-95ed-6ae8d02a68e0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:02.658183 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ad11d0-c70e-4079-95ed-6ae8d02a68e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:02.660005 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ad11d0-c70e-4079-95ed-6ae8d02a68e0 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:02.660888 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe3f95-5d5d-422a-83f7-57f8573641f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:02.662063 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe3f95-5d5d-422a-83f7-57f8573641f3 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:02.662580 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe3f95-5d5d-422a-83f7-57f8573641f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:02.662674 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe3f95-5d5d-422a-83f7-57f8573641f3 None admin] PATH_INFO: `/v3/users/fcf685ea331147f6abda37a0667abc54` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:02.664227 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fe3f95-5d5d-422a-83f7-57f8573641f3 None admin] RBAC: Authorizing `identity:get_user(user_id=fcf685ea331147f6abda37a0667abc54)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:02.665924 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fe3f95-5d5d-422a-83f7-57f8573641f3 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:02.667925 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 181/365] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jun 29 12:08:02 2022] GET /identity/v3/users/fcf685ea331147f6abda37a0667abc54 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:02.669548 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e30bd7-1c00-47b3-bae5-e4b06db978ec None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:02.669900 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e30bd7-1c00-47b3-bae5-e4b06db978ec None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:02.670236 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e30bd7-1c00-47b3-bae5-e4b06db978ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:02.673366 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 185/366] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jun 29 12:08:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:02.674544 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad11d0-c70e-4079-95ed-6ae8d02a68e0 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:02.693179 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-a0e30bd7-1c00-47b3-bae5-e4b06db978ec None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:02.694640 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a0e30bd7-1c00-47b3-bae5-e4b06db978ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:02.768402 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:02.786113 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 182/367] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:08:02.794317 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e30bd7-1c00-47b3-bae5-e4b06db978ec None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:02.816661 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad11d0-c70e-4079-95ed-6ae8d02a68e0 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:02.834641 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:02.864109 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c958a-1504-4eed-8c71-02c76749ba3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:02.865227 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c958a-1504-4eed-8c71-02c76749ba3f None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:02.865754 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c958a-1504-4eed-8c71-02c76749ba3f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:02.866185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c958a-1504-4eed-8c71-02c76749ba3f None admin] PATH_INFO: `/v3/groups/c108973954db4096ae0c3c3a2e903362` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:02.867845 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209c958a-1504-4eed-8c71-02c76749ba3f None admin] RBAC: Authorizing `identity:get_group(group_id=c108973954db4096ae0c3c3a2e903362)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:02.869513 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209c958a-1504-4eed-8c71-02c76749ba3f None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:02.871380 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 186/368] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Jun 29 12:08:02 2022] GET /identity/v3/groups/c108973954db4096ae0c3c3a2e903362 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:02.877045 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c958a-1504-4eed-8c71-02c76749ba3f None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:02.908737 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e30bd7-1c00-47b3-bae5-e4b06db978ec None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:02.945013 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e4f25-fa4f-4017-bc5d-b71977311b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:02.946703 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e4f25-fa4f-4017-bc5d-b71977311b46 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:02.946703 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e4f25-fa4f-4017-bc5d-b71977311b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:02.946703 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e4f25-fa4f-4017-bc5d-b71977311b46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:02.947521 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6e4f25-fa4f-4017-bc5d-b71977311b46 None admin] RBAC: Adding query filter params (role.id=e2336723b86b456e95b87bce11e66e1c, user.id=fcf685ea331147f6abda37a0667abc54, scope.system=all) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:02.947928 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6e4f25-fa4f-4017-bc5d-b71977311b46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:02.949466 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6e4f25-fa4f-4017-bc5d-b71977311b46 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:02.962978 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 183/369] 10.222.0.27 () {56 vars in 1308 bytes} [Wed Jun 29 12:08:02 2022] GET /identity/v3/role_assignments?user.id=fcf685ea331147f6abda37a0667abc54&scope.system=all&role.id=e2336723b86b456e95b87bce11e66e1c => generated 510 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:02.963952 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e4f25-fa4f-4017-bc5d-b71977311b46 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:03.022283 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:03.028193 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c958a-1504-4eed-8c71-02c76749ba3f None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:03.088832 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e4f25-fa4f-4017-bc5d-b71977311b46 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:03.099654 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f56cc-29e5-4291-9fdd-6d7a49ce695e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:03.100789 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f56cc-29e5-4291-9fdd-6d7a49ce695e None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:03.100789 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f56cc-29e5-4291-9fdd-6d7a49ce695e None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:03.100977 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f56cc-29e5-4291-9fdd-6d7a49ce695e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:03.128806 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae0892c-5b98-4696-abc3-81724d0e79a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:03.130041 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0892c-5b98-4696-abc3-81724d0e79a7 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:03.130539 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0892c-5b98-4696-abc3-81724d0e79a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:03.131080 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0892c-5b98-4696-abc3-81724d0e79a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:03.143282 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae0892c-5b98-4696-abc3-81724d0e79a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:08:03.151902 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-6ae0892c-5b98-4696-abc3-81724d0e79a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:08:03.151902 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:03.151902 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:03.151902 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:03.151902 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:03.151902 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:03.151902 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:03.151902 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:03.151902 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:03.151902 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:03.151902 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:03.151902 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:03.151902 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:08:03.151902 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:08:03.151902 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:08:03.151902 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:08:03.152888 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:08:03.152888 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:08:03.152888 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:08:03.152888 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:08:03.152888 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:03.152888 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:03.152888 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:03.152888 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:03.152888 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:03.152888 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:03.152888 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:03.152888 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:03.152888 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:03.152888 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:03.152888 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:03.152888 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:03.153784 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:03.153784 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:03.153784 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:03.153784 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:03.153784 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:08:03.153784 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:08:03.153784 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:08:03.153784 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:08:03.153784 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:08:03.153784 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:08:03.153784 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:08:03.153784 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:03.156587 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 184/370] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jun 29 12:08:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:03.157606 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae0892c-5b98-4696-abc3-81724d0e79a7 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:03.190964 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:03.242916 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5f56cc-29e5-4291-9fdd-6d7a49ce695e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:03.244435 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5f56cc-29e5-4291-9fdd-6d7a49ce695e None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:03.275136 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae0892c-5b98-4696-abc3-81724d0e79a7 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:03.286962 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:03.314819 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4113099f-c93f-42d1-96dd-5112d4ec3096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:03.315855 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4113099f-c93f-42d1-96dd-5112d4ec3096 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:03.316334 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4113099f-c93f-42d1-96dd-5112d4ec3096 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:03.316808 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4113099f-c93f-42d1-96dd-5112d4ec3096 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:03.317923 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4113099f-c93f-42d1-96dd-5112d4ec3096 None admin] RBAC: Adding query filter params (group.id=c108973954db4096ae0c3c3a2e903362, role.id=c49accbc6f81447cb221ef720db04ced, scope.project.id=e6ee9295413244e9b7233dd64100ffb7) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:03.318792 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4113099f-c93f-42d1-96dd-5112d4ec3096 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:03.320630 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4113099f-c93f-42d1-96dd-5112d4ec3096 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:03.328110 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 185/371] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Jun 29 12:08:03 2022] GET /identity/v3/role_assignments?group.id=c108973954db4096ae0c3c3a2e903362&scope.project.id=e6ee9295413244e9b7233dd64100ffb7&role.id=c49accbc6f81447cb221ef720db04ced => generated 260 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:03.329280 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4113099f-c93f-42d1-96dd-5112d4ec3096 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:03.426714 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 187/372] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:08:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:08:03.432435 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f56cc-29e5-4291-9fdd-6d7a49ce695e None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:03.448573 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4113099f-c93f-42d1-96dd-5112d4ec3096 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:03.488678 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067976e5-eb4a-49b9-8c01-baf2d20bb867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:03.489859 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067976e5-eb4a-49b9-8c01-baf2d20bb867 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:03.490410 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067976e5-eb4a-49b9-8c01-baf2d20bb867 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:03.490941 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067976e5-eb4a-49b9-8c01-baf2d20bb867 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:03.491923 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067976e5-eb4a-49b9-8c01-baf2d20bb867 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:03.492444 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067976e5-eb4a-49b9-8c01-baf2d20bb867 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:03.494095 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067976e5-eb4a-49b9-8c01-baf2d20bb867 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:03.503852 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 186/373] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:08:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:03.509559 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067976e5-eb4a-49b9-8c01-baf2d20bb867 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:03.549030 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:03.592788 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:03.626457 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067976e5-eb4a-49b9-8c01-baf2d20bb867 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:03.659288 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f56cc-29e5-4291-9fdd-6d7a49ce695e None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:03.665185 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2cbd7e-daa6-4ef7-9d10-412e832b1a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:03.666257 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2cbd7e-daa6-4ef7-9d10-412e832b1a14 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:03.666755 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2cbd7e-daa6-4ef7-9d10-412e832b1a14 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:03.667228 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2cbd7e-daa6-4ef7-9d10-412e832b1a14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:03.717086 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c75b82-e0ca-4f22-b8cb-ab63dde9d1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:03.718392 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c75b82-e0ca-4f22-b8cb-ab63dde9d1d6 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:03.718885 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c75b82-e0ca-4f22-b8cb-ab63dde9d1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:03.719353 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c75b82-e0ca-4f22-b8cb-ab63dde9d1d6 None admin] PATH_INFO: `/v3/projects/e6ee9295413244e9b7233dd64100ffb7` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:03.720836 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c75b82-e0ca-4f22-b8cb-ab63dde9d1d6 None admin] RBAC: Authorizing `identity:get_project(project_id=e6ee9295413244e9b7233dd64100ffb7)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:03.722548 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c75b82-e0ca-4f22-b8cb-ab63dde9d1d6 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:03.724835 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 188/374] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jun 29 12:08:03 2022] GET /identity/v3/projects/e6ee9295413244e9b7233dd64100ffb7 => generated 302 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:08:03.730650 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c75b82-e0ca-4f22-b8cb-ab63dde9d1d6 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:03.754355 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2cbd7e-daa6-4ef7-9d10-412e832b1a14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:03.756066 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2cbd7e-daa6-4ef7-9d10-412e832b1a14 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:03.796779 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:03.875344 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 187/375] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:08:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 29 12:08:03.883231 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2cbd7e-daa6-4ef7-9d10-412e832b1a14 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:03.960941 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c75b82-e0ca-4f22-b8cb-ab63dde9d1d6 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:04.025656 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48badcc9-f023-45ff-b0ac-04576888a060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:04.026481 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48badcc9-f023-45ff-b0ac-04576888a060 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:04.026760 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48badcc9-f023-45ff-b0ac-04576888a060 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:04.027030 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48badcc9-f023-45ff-b0ac-04576888a060 None admin] PATH_INFO: `/v3/groups/c108973954db4096ae0c3c3a2e903362` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:04.028710 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48badcc9-f023-45ff-b0ac-04576888a060 None admin] RBAC: Authorizing `identity:get_group(group_id=c108973954db4096ae0c3c3a2e903362)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:04.030222 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48badcc9-f023-45ff-b0ac-04576888a060 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:04.031903 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 189/376] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Jun 29 12:08:03 2022] GET /identity/v3/groups/c108973954db4096ae0c3c3a2e903362 => generated 226 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:04.038351 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48badcc9-f023-45ff-b0ac-04576888a060 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:04.068036 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2cbd7e-daa6-4ef7-9d10-412e832b1a14 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:04.071061 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:04.155835 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db06698-f8a0-4a09-9ebe-da5fb0fda424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:04.156727 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db06698-f8a0-4a09-9ebe-da5fb0fda424 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:04.157059 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db06698-f8a0-4a09-9ebe-da5fb0fda424 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:04.157343 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db06698-f8a0-4a09-9ebe-da5fb0fda424 None admin] PATH_INFO: `/v3/projects/06b39178fa6444fba25717312ec5afa2` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:04.162505 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db06698-f8a0-4a09-9ebe-da5fb0fda424 None admin] RBAC: Authorizing `identity:get_project(project_id=06b39178fa6444fba25717312ec5afa2)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:04.164070 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db06698-f8a0-4a09-9ebe-da5fb0fda424 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:04.166234 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 188/377] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jun 29 12:08:03 2022] GET /identity/v3/projects/06b39178fa6444fba25717312ec5afa2 => generated 344 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:04.172347 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db06698-f8a0-4a09-9ebe-da5fb0fda424 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:04.180113 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:04.186460 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48badcc9-f023-45ff-b0ac-04576888a060 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:04.235045 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eea017-d79f-4382-a7b5-c23a05309b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:04.235702 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eea017-d79f-4382-a7b5-c23a05309b95 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:04.235982 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eea017-d79f-4382-a7b5-c23a05309b95 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:04.236302 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eea017-d79f-4382-a7b5-c23a05309b95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:04.237195 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eea017-d79f-4382-a7b5-c23a05309b95 None admin] RBAC: Adding query filter params (group.id=c108973954db4096ae0c3c3a2e903362, role.id=ea54879a52d24a47bada5629b6d8b456, scope.project.id=e6ee9295413244e9b7233dd64100ffb7) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:04.237513 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eea017-d79f-4382-a7b5-c23a05309b95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:04.239228 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eea017-d79f-4382-a7b5-c23a05309b95 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:04.246757 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 190/378] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Jun 29 12:08:04 2022] GET /identity/v3/role_assignments?group.id=c108973954db4096ae0c3c3a2e903362&scope.project.id=e6ee9295413244e9b7233dd64100ffb7&role.id=ea54879a52d24a47bada5629b6d8b456 => generated 260 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:04.248073 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb638e-93fd-441a-8aac-a3178a9e3c8e None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:04.248356 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb638e-93fd-441a-8aac-a3178a9e3c8e None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:04.248634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb638e-93fd-441a-8aac-a3178a9e3c8e None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:04.250259 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 191/379] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:08:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:04.256154 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c120ed-8fec-4a62-bece-a9502880abab None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:04.256500 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c120ed-8fec-4a62-bece-a9502880abab None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:04.256711 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c120ed-8fec-4a62-bece-a9502880abab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:04.279819 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-56c120ed-8fec-4a62-bece-a9502880abab None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:04.280976 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-56c120ed-8fec-4a62-bece-a9502880abab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:04.357763 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db06698-f8a0-4a09-9ebe-da5fb0fda424 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:04.367678 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 192/380] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 12:08:04.391319 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c120ed-8fec-4a62-bece-a9502880abab None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:04.403177 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:04.405807 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbfeaad-9fb7-40ed-9c06-18afe280bfe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:04.407232 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfeaad-9fb7-40ed-9c06-18afe280bfe2 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:04.407655 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfeaad-9fb7-40ed-9c06-18afe280bfe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:04.408198 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfeaad-9fb7-40ed-9c06-18afe280bfe2 None admin] PATH_INFO: `/v3/groups/6e472bb406f646ec8f92ebbe2035f952` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:04.417101 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbfeaad-9fb7-40ed-9c06-18afe280bfe2 None admin] RBAC: Authorizing `identity:get_group(group_id=6e472bb406f646ec8f92ebbe2035f952)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:04.419005 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbfeaad-9fb7-40ed-9c06-18afe280bfe2 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:04.425832 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 189/381] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Jun 29 12:08:04 2022] GET /identity/v3/groups/6e472bb406f646ec8f92ebbe2035f952 => generated 229 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:04.429500 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbfeaad-9fb7-40ed-9c06-18afe280bfe2 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:04.510480 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:04.556015 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbfeaad-9fb7-40ed-9c06-18afe280bfe2 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:04.598596 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fce812b-55c9-4587-98cd-3576ff7410ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:04.600670 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce812b-55c9-4587-98cd-3576ff7410ec None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:04.601847 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce812b-55c9-4587-98cd-3576ff7410ec None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:04.602285 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce812b-55c9-4587-98cd-3576ff7410ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:04.604511 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c120ed-8fec-4a62-bece-a9502880abab None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:04.605975 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fce812b-55c9-4587-98cd-3576ff7410ec None admin] RBAC: Adding query filter params (group.id=6e472bb406f646ec8f92ebbe2035f952, role.id=e0e69ac8a8bf4cc4baa6aa18f2fc9919, scope.project.id=06b39178fa6444fba25717312ec5afa2) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:04.606461 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fce812b-55c9-4587-98cd-3576ff7410ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:04.608099 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fce812b-55c9-4587-98cd-3576ff7410ec None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:04.617381 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 190/382] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Jun 29 12:08:04 2022] GET /identity/v3/role_assignments?group.id=6e472bb406f646ec8f92ebbe2035f952&scope.project.id=06b39178fa6444fba25717312ec5afa2&role.id=e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:04.632716 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15ade8-2b4d-4351-b97a-27fa4bdd2820 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:04.633577 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15ade8-2b4d-4351-b97a-27fa4bdd2820 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:04.634313 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15ade8-2b4d-4351-b97a-27fa4bdd2820 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:04.637160 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 191/383] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:08:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:08:04.645560 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2093f6-f4f5-4b10-b87a-180ffca8d53d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:04.645970 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2093f6-f4f5-4b10-b87a-180ffca8d53d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:04.646121 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2093f6-f4f5-4b10-b87a-180ffca8d53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:04.660038 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b47a45-9031-485f-8778-16944a59e692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:04.660882 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b47a45-9031-485f-8778-16944a59e692 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:04.661162 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b47a45-9031-485f-8778-16944a59e692 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:04.661435 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b47a45-9031-485f-8778-16944a59e692 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:04.674882 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-6d2093f6-f4f5-4b10-b87a-180ffca8d53d None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:04.676497 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6d2093f6-f4f5-4b10-b87a-180ffca8d53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:04.686506 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b47a45-9031-485f-8778-16944a59e692 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:08:04.695082 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-72b47a45-9031-485f-8778-16944a59e692 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:08:04.695082 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:04.695082 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:04.695082 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:04.695082 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:04.695082 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:04.695082 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:04.695082 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:04.695082 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:04.695082 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:04.695082 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:04.695082 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:04.695082 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:08:04.695082 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:08:04.695082 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:08:04.695082 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:08:04.696165 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:08:04.696165 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:08:04.696165 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:08:04.696165 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:08:04.696165 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:04.696165 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:04.696165 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:04.696165 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:04.696165 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:04.696165 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:04.696165 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:04.696165 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:04.696165 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:04.696165 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:04.696165 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:04.696165 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:04.696966 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:04.696966 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:04.696966 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:04.696966 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:04.696966 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:08:04.696966 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:08:04.696966 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:08:04.696966 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:08:04.696966 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:08:04.696966 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:08:04.696966 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:08:04.696966 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:04.696966 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 193/384] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:08:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:08:04.705257 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b47a45-9031-485f-8778-16944a59e692 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:04.760110 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 192/385] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:08:04.790834 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2093f6-f4f5-4b10-b87a-180ffca8d53d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:04.826098 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:04.855194 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b47a45-9031-485f-8778-16944a59e692 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:04.866014 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:04.895336 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9089128d-e886-4768-997d-6348845b4c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:04.896102 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089128d-e886-4768-997d-6348845b4c52 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:04.896451 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089128d-e886-4768-997d-6348845b4c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:04.896766 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089128d-e886-4768-997d-6348845b4c52 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:04.897742 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9089128d-e886-4768-997d-6348845b4c52 None admin] RBAC: Adding query filter params (name=member) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:04.902069 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9089128d-e886-4768-997d-6348845b4c52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:04.903773 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9089128d-e886-4768-997d-6348845b4c52 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:04.909654 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2093f6-f4f5-4b10-b87a-180ffca8d53d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:04.922169 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 194/386] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jun 29 12:08:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:08:04.923300 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9089128d-e886-4768-997d-6348845b4c52 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:04.950661 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0c9f5-123a-409e-929e-265506844882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:04.951849 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0c9f5-123a-409e-929e-265506844882 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:04.952128 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0c9f5-123a-409e-929e-265506844882 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:04.952395 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0c9f5-123a-409e-929e-265506844882 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:04.963751 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a0c9f5-123a-409e-929e-265506844882 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:08:04.973189 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-a0a0c9f5-123a-409e-929e-265506844882 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 12:08:04.973189 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:04.973189 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:04.973189 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:04.973189 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:04.973189 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:04.973189 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:04.973189 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:04.973189 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:04.973189 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:04.973189 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:04.973189 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:04.973189 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:08:04.973189 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:08:04.973189 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:08:04.973189 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:08:04.974138 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:08:04.974138 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:08:04.974138 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:08:04.974138 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:08:04.974138 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:04.974138 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:04.974138 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:04.974138 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:04.974138 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:04.974138 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:04.974138 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:04.974138 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:04.974138 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:04.974138 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:04.974138 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:04.974138 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:04.975202 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:04.975202 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:04.975202 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:04.975202 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:04.975202 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:08:04.975202 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:08:04.975202 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:08:04.975202 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:08:04.975202 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:08:04.975202 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:08:04.975202 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 12:08:04.975202 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:04.975202 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 193/387] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jun 29 12:08:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:08:04.984802 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0c9f5-123a-409e-929e-265506844882 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:05.094409 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0c9f5-123a-409e-929e-265506844882 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:05.111167 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9089128d-e886-4768-997d-6348845b4c52 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:05.119092 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:05.131556 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a186eae-f847-4c21-8a63-0b4c706ea204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:05.132386 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a186eae-f847-4c21-8a63-0b4c706ea204 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:05.132840 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a186eae-f847-4c21-8a63-0b4c706ea204 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:05.133225 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a186eae-f847-4c21-8a63-0b4c706ea204 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:05.134228 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a186eae-f847-4c21-8a63-0b4c706ea204 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:05.134535 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a186eae-f847-4c21-8a63-0b4c706ea204 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:05.135940 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a186eae-f847-4c21-8a63-0b4c706ea204 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:05.146058 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 194/388] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jun 29 12:08:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:05.155288 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a186eae-f847-4c21-8a63-0b4c706ea204 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:05.166080 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:05.176688 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f1c70d-15b5-4ef2-a9ac-1338e49175dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:05.177738 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1c70d-15b5-4ef2-a9ac-1338e49175dd None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:05.178404 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1c70d-15b5-4ef2-a9ac-1338e49175dd None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:05.178800 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1c70d-15b5-4ef2-a9ac-1338e49175dd None admin] PATH_INFO: `/v3/groups/c108973954db4096ae0c3c3a2e903362` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:05.180586 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f1c70d-15b5-4ef2-a9ac-1338e49175dd None admin] RBAC: Authorizing `identity:get_group(group_id=c108973954db4096ae0c3c3a2e903362)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:05.183761 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f1c70d-15b5-4ef2-a9ac-1338e49175dd None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:05.185836 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 195/389] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Jun 29 12:08:04 2022] GET /identity/v3/groups/c108973954db4096ae0c3c3a2e903362 => generated 226 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:05.191155 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f1c70d-15b5-4ef2-a9ac-1338e49175dd None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:05.268566 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a186eae-f847-4c21-8a63-0b4c706ea204 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:05.312440 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac5813-7154-416c-a31c-8f720c1c936a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:05.313473 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac5813-7154-416c-a31c-8f720c1c936a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:05.313786 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac5813-7154-416c-a31c-8f720c1c936a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:05.314413 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac5813-7154-416c-a31c-8f720c1c936a None admin] PATH_INFO: `/v3/groups/c108973954db4096ae0c3c3a2e903362` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:05.315659 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ac5813-7154-416c-a31c-8f720c1c936a None admin] RBAC: Authorizing `identity:get_group(group_id=c108973954db4096ae0c3c3a2e903362)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:05.317545 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ac5813-7154-416c-a31c-8f720c1c936a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:05.320122 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 195/390] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Jun 29 12:08:05 2022] GET /identity/v3/groups/c108973954db4096ae0c3c3a2e903362 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:05.325728 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac5813-7154-416c-a31c-8f720c1c936a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:05.336884 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f1c70d-15b5-4ef2-a9ac-1338e49175dd None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:05.377625 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e8f4c8-26c0-47fb-81dd-191227f6e2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:05.378634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8f4c8-26c0-47fb-81dd-191227f6e2db None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:05.378977 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8f4c8-26c0-47fb-81dd-191227f6e2db None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:05.379341 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8f4c8-26c0-47fb-81dd-191227f6e2db None admin] PATH_INFO: `/v3/projects/dcc3d4b81e0d470bab2492f8eb193665` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:05.380713 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e8f4c8-26c0-47fb-81dd-191227f6e2db None admin] RBAC: Authorizing `identity:get_project(project_id=dcc3d4b81e0d470bab2492f8eb193665)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:05.382493 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e8f4c8-26c0-47fb-81dd-191227f6e2db None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:05.384731 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 196/391] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jun 29 12:08:05 2022] GET /identity/v3/projects/dcc3d4b81e0d470bab2492f8eb193665 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:05.390413 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e8f4c8-26c0-47fb-81dd-191227f6e2db None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:05.393525 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:05.489376 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac5813-7154-416c-a31c-8f720c1c936a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:05.514910 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:05.534774 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1493be-28b8-4f59-b78c-d64bd05e0bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:05.535776 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1493be-28b8-4f59-b78c-d64bd05e0bff None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:05.536122 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1493be-28b8-4f59-b78c-d64bd05e0bff None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:05.536465 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1493be-28b8-4f59-b78c-d64bd05e0bff None admin] PATH_INFO: `/v3/projects/dcc3d4b81e0d470bab2492f8eb193665` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:05.538348 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1493be-28b8-4f59-b78c-d64bd05e0bff None admin] RBAC: Authorizing `identity:get_project(project_id=dcc3d4b81e0d470bab2492f8eb193665)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:05.540283 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1493be-28b8-4f59-b78c-d64bd05e0bff None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:05.542803 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 196/392] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jun 29 12:08:05 2022] GET /identity/v3/projects/dcc3d4b81e0d470bab2492f8eb193665 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:08:05.550620 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1493be-28b8-4f59-b78c-d64bd05e0bff None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:05.586744 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e8f4c8-26c0-47fb-81dd-191227f6e2db None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:05.653490 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d355ff6-5d0e-41d9-9bce-399df9d190e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:05.655122 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d355ff6-5d0e-41d9-9bce-399df9d190e4 None admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:05.655693 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d355ff6-5d0e-41d9-9bce-399df9d190e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:05.657073 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d355ff6-5d0e-41d9-9bce-399df9d190e4 None admin] PATH_INFO: `/v3/projects/dcc3d4b81e0d470bab2492f8eb193665/groups/c108973954db4096ae0c3c3a2e903362/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:05.660403 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d355ff6-5d0e-41d9-9bce-399df9d190e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=dcc3d4b81e0d470bab2492f8eb193665, group_id=c108973954db4096ae0c3c3a2e903362, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:05.663911 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d355ff6-5d0e-41d9-9bce-399df9d190e4 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:05.688857 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 197/393] 10.222.0.27 () {58 vars in 1442 bytes} [Wed Jun 29 12:08:05 2022] PUT /identity/v3/projects/dcc3d4b81e0d470bab2492f8eb193665/groups/c108973954db4096ae0c3c3a2e903362/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:08:05.733295 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1493be-28b8-4f59-b78c-d64bd05e0bff None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:05.758690 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:05.776020 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bcce6b-e842-44c3-a0d8-30617e03cbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:05.777161 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bcce6b-e842-44c3-a0d8-30617e03cbec None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:05.777608 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bcce6b-e842-44c3-a0d8-30617e03cbec None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:05.778062 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bcce6b-e842-44c3-a0d8-30617e03cbec None admin] PATH_INFO: `/v3/projects/dcc3d4b81e0d470bab2492f8eb193665/groups/c108973954db4096ae0c3c3a2e903362/roles/ea54879a52d24a47bada5629b6d8b456` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:05.780550 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bcce6b-e842-44c3-a0d8-30617e03cbec None admin] RBAC: Authorizing `identity:create_grant(project_id=dcc3d4b81e0d470bab2492f8eb193665, group_id=c108973954db4096ae0c3c3a2e903362, role_id=ea54879a52d24a47bada5629b6d8b456)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:05.782271 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bcce6b-e842-44c3-a0d8-30617e03cbec None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:05.800357 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 197/394] 10.222.0.27 () {58 vars in 1442 bytes} [Wed Jun 29 12:08:05 2022] PUT /identity/v3/projects/dcc3d4b81e0d470bab2492f8eb193665/groups/c108973954db4096ae0c3c3a2e903362/roles/ea54879a52d24a47bada5629b6d8b456 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:08:06.159135 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2efb90-38af-40cb-95cc-c8e16a402d2d None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:06.159845 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2efb90-38af-40cb-95cc-c8e16a402d2d None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:06.160347 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2efb90-38af-40cb-95cc-c8e16a402d2d None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:06.162199 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 198/395] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:08:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:06.168605 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d0209-6aba-4a2e-a459-71d35d6cf7ae None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:06.169137 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d0209-6aba-4a2e-a459-71d35d6cf7ae None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:06.169605 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d0209-6aba-4a2e-a459-71d35d6cf7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:06.195468 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-929d0209-6aba-4a2e-a459-71d35d6cf7ae None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:06.197032 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-929d0209-6aba-4a2e-a459-71d35d6cf7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:06.289074 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 198/396] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:08:06.324463 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2efb90-38af-40cb-95cc-c8e16a402d2d None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:06.466090 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2efb90-38af-40cb-95cc-c8e16a402d2d None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:06.502087 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:06.509921 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc94a50d-5c46-4587-b6f0-b72d16525579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:06.510759 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94a50d-5c46-4587-b6f0-b72d16525579 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:06.511188 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94a50d-5c46-4587-b6f0-b72d16525579 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:06.511361 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94a50d-5c46-4587-b6f0-b72d16525579 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:06.526490 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc94a50d-5c46-4587-b6f0-b72d16525579 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:08:06.535999 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-cc94a50d-5c46-4587-b6f0-b72d16525579 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:08:06.535999 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:06.535999 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:06.535999 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:06.535999 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:06.535999 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:06.535999 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:06.535999 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:06.535999 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:06.535999 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:06.535999 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:06.535999 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:06.535999 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:08:06.535999 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:08:06.535999 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:08:06.535999 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:08:06.536919 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:08:06.536919 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:08:06.536919 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:08:06.536919 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:08:06.536919 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:06.536919 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:06.536919 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:06.536919 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:06.536919 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:06.536919 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:06.536919 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:06.536919 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:06.536919 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:06.536919 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:06.536919 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:06.536919 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:06.537947 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:06.537947 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:06.537947 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:06.537947 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:06.537947 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:08:06.537947 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:08:06.537947 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:08:06.537947 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:08:06.537947 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:08:06.537947 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:08:06.537947 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:08:06.537947 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:06.537947 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 199/397] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:08:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:06.545067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d0209-6aba-4a2e-a459-71d35d6cf7ae None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:06.653930 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d0209-6aba-4a2e-a459-71d35d6cf7ae None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:06.666221 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:06.701770 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b1a5fa-a988-4558-aaa4-3ad1c56f060f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:06.702465 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1a5fa-a988-4558-aaa4-3ad1c56f060f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:06.702744 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1a5fa-a988-4558-aaa4-3ad1c56f060f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:06.703014 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1a5fa-a988-4558-aaa4-3ad1c56f060f None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:06.704071 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b1a5fa-a988-4558-aaa4-3ad1c56f060f None admin] RBAC: Adding query filter params (name=member) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:06.704378 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b1a5fa-a988-4558-aaa4-3ad1c56f060f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:06.705790 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b1a5fa-a988-4558-aaa4-3ad1c56f060f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:06.715669 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 199/398] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jun 29 12:08:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:06.722228 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc94a50d-5c46-4587-b6f0-b72d16525579 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:06.861392 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc94a50d-5c46-4587-b6f0-b72d16525579 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:06.901224 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6631458-a59d-4226-914d-31e7be3f6435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:06.902124 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6631458-a59d-4226-914d-31e7be3f6435 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:06.902409 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6631458-a59d-4226-914d-31e7be3f6435 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:06.902691 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6631458-a59d-4226-914d-31e7be3f6435 None admin] PATH_INFO: `/v3/groups/c108973954db4096ae0c3c3a2e903362` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:06.903886 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6631458-a59d-4226-914d-31e7be3f6435 None admin] RBAC: Authorizing `identity:get_group(group_id=c108973954db4096ae0c3c3a2e903362)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:06.905401 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6631458-a59d-4226-914d-31e7be3f6435 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:06.911590 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 200/399] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Jun 29 12:08:06 2022] GET /identity/v3/groups/c108973954db4096ae0c3c3a2e903362 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:06.917725 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b1a5fa-a988-4558-aaa4-3ad1c56f060f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:07.027580 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b1a5fa-a988-4558-aaa4-3ad1c56f060f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:07.078802 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4dccf4-c748-4e6f-ade6-a27a13b6fa60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:07.080143 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4dccf4-c748-4e6f-ade6-a27a13b6fa60 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:07.080579 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4dccf4-c748-4e6f-ade6-a27a13b6fa60 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:07.081011 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4dccf4-c748-4e6f-ade6-a27a13b6fa60 None admin] PATH_INFO: `/v3/projects/e6ee9295413244e9b7233dd64100ffb7` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:07.086771 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4dccf4-c748-4e6f-ade6-a27a13b6fa60 None admin] RBAC: Authorizing `identity:get_project(project_id=e6ee9295413244e9b7233dd64100ffb7)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:07.089021 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4dccf4-c748-4e6f-ade6-a27a13b6fa60 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:07.094322 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f76d2f4-b171-4774-b7e9-2fc87fd7c838 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:07.094744 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f76d2f4-b171-4774-b7e9-2fc87fd7c838 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:07.095149 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f76d2f4-b171-4774-b7e9-2fc87fd7c838 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:07.097215 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 201/401] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:08:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:07.098253 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f76d2f4-b171-4774-b7e9-2fc87fd7c838 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:07.098779 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 200/401] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jun 29 12:08:06 2022] GET /identity/v3/projects/e6ee9295413244e9b7233dd64100ffb7 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:07.105311 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494a95f-3530-4998-abbb-018677afbf72 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:07.105840 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494a95f-3530-4998-abbb-018677afbf72 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:07.106326 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494a95f-3530-4998-abbb-018677afbf72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:07.146982 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f494a95f-3530-4998-abbb-018677afbf72 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:07.148407 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f494a95f-3530-4998-abbb-018677afbf72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:07.196522 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:07.209844 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:07.273187 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 201/402] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:08:07.285564 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f76d2f4-b171-4774-b7e9-2fc87fd7c838 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:07.305035 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f494a95f-3530-4998-abbb-018677afbf72 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:07.363514 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cdc7dc-62ea-4a0d-96d9-4f2a026778b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:07.364479 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cdc7dc-62ea-4a0d-96d9-4f2a026778b1 None admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:07.364769 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cdc7dc-62ea-4a0d-96d9-4f2a026778b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:07.365047 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cdc7dc-62ea-4a0d-96d9-4f2a026778b1 None admin] PATH_INFO: `/v3/projects/e6ee9295413244e9b7233dd64100ffb7/groups/c108973954db4096ae0c3c3a2e903362/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:07.372927 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cdc7dc-62ea-4a0d-96d9-4f2a026778b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=e6ee9295413244e9b7233dd64100ffb7, group_id=c108973954db4096ae0c3c3a2e903362, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:07.374443 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cdc7dc-62ea-4a0d-96d9-4f2a026778b1 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:07.406562 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 202/403] 10.222.0.27 () {58 vars in 1442 bytes} [Wed Jun 29 12:08:07 2022] PUT /identity/v3/projects/e6ee9295413244e9b7233dd64100ffb7/groups/c108973954db4096ae0c3c3a2e903362/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:08:07.455366 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f494a95f-3530-4998-abbb-018677afbf72 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:07.498134 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb55e6-ea39-4d33-8015-12c4e6a68473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:07.499070 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb55e6-ea39-4d33-8015-12c4e6a68473 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:07.499353 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb55e6-ea39-4d33-8015-12c4e6a68473 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:07.499631 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb55e6-ea39-4d33-8015-12c4e6a68473 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:07.512295 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eb55e6-ea39-4d33-8015-12c4e6a68473 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:08:07.520680 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-65eb55e6-ea39-4d33-8015-12c4e6a68473 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 12:08:07.520680 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:07.520680 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:07.520680 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:07.520680 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:07.520680 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:07.520680 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:07.520680 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:07.520680 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:07.520680 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:07.520680 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:07.520680 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:07.520680 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:08:07.520680 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:08:07.520680 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:08:07.520680 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:08:07.521603 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:08:07.521603 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:08:07.521603 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:08:07.521603 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:08:07.521603 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:07.521603 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:07.521603 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:07.521603 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:07.521603 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:07.521603 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:07.521603 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:07.521603 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:07.521603 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:07.521603 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:07.521603 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:07.521603 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:07.522523 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:07.522523 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:07.522523 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:07.522523 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:07.522523 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:08:07.522523 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:08:07.522523 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:08:07.522523 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:08:07.522523 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:08:07.522523 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:08:07.522523 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 12:08:07.522523 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:07.522523 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 202/404] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jun 29 12:08:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:08:07.530639 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656c965-30af-4d2d-aa18-e6a1f8a1bb55 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:07.530926 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656c965-30af-4d2d-aa18-e6a1f8a1bb55 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:07.531201 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656c965-30af-4d2d-aa18-e6a1f8a1bb55 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:07.532868 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 203/405] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:08:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:07.537832 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb55e6-ea39-4d33-8015-12c4e6a68473 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:07.538793 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf0cd4-d2f4-4a88-bcba-b06ddd0c24f3 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:07.539088 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf0cd4-d2f4-4a88-bcba-b06ddd0c24f3 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:07.539365 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf0cd4-d2f4-4a88-bcba-b06ddd0c24f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:07.560550 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-d1bf0cd4-d2f4-4a88-bcba-b06ddd0c24f3 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:07.561837 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-d1bf0cd4-d2f4-4a88-bcba-b06ddd0c24f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:07.590071 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:07.686737 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 204/406] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 12:08:07.715925 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf0cd4-d2f4-4a88-bcba-b06ddd0c24f3 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:07.728001 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb55e6-ea39-4d33-8015-12c4e6a68473 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:07.765953 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef9f3d1-7ec7-4202-a3ab-bed9b01b40af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:07.766674 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9f3d1-7ec7-4202-a3ab-bed9b01b40af None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:07.766952 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9f3d1-7ec7-4202-a3ab-bed9b01b40af None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:07.767474 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:07.768295 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9f3d1-7ec7-4202-a3ab-bed9b01b40af None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:07.768776 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef9f3d1-7ec7-4202-a3ab-bed9b01b40af None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:07.769081 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef9f3d1-7ec7-4202-a3ab-bed9b01b40af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:07.770484 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef9f3d1-7ec7-4202-a3ab-bed9b01b40af None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:07.781672 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 203/407] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jun 29 12:08:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:07.787649 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef9f3d1-7ec7-4202-a3ab-bed9b01b40af None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:07.842555 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf0cd4-d2f4-4a88-bcba-b06ddd0c24f3 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:07.881990 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd5ff12-16f7-4772-848e-3baa390b6801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:07.882838 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5ff12-16f7-4772-848e-3baa390b6801 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:07.883130 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5ff12-16f7-4772-848e-3baa390b6801 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:07.883411 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5ff12-16f7-4772-848e-3baa390b6801 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:07.895005 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd5ff12-16f7-4772-848e-3baa390b6801 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:08:07.903954 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-3dd5ff12-16f7-4772-848e-3baa390b6801 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:08:07.903954 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:07.903954 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:07.903954 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:07.903954 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:07.903954 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:07.903954 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:07.903954 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:07.903954 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:07.903954 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:07.903954 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:07.903954 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:07.903954 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:08:07.903954 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:08:07.903954 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:08:07.903954 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:08:07.904873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:08:07.904873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:08:07.904873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:08:07.904873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:08:07.904873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:07.904873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:07.904873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:07.904873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:07.904873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:07.904873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:07.904873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:07.904873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:07.904873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:07.904873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:07.904873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:07.904873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:07.905678 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:07.905678 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:07.905678 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:07.905678 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:07.905678 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:08:07.905678 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:08:07.905678 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:08:07.905678 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:08:07.905678 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:08:07.905678 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:08:07.905678 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:08:07.905678 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:07.905678 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 205/408] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jun 29 12:08:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:08:07.914744 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd5ff12-16f7-4772-848e-3baa390b6801 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:07.942920 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:07.953423 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef9f3d1-7ec7-4202-a3ab-bed9b01b40af None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:07.989812 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a93ffbe-80f1-4e20-a994-6fa96ac93e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:07.991209 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93ffbe-80f1-4e20-a994-6fa96ac93e14 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:07.991692 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93ffbe-80f1-4e20-a994-6fa96ac93e14 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:07.992172 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93ffbe-80f1-4e20-a994-6fa96ac93e14 None admin] PATH_INFO: `/v3/groups/c108973954db4096ae0c3c3a2e903362` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:07.993612 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a93ffbe-80f1-4e20-a994-6fa96ac93e14 None admin] RBAC: Authorizing `identity:get_group(group_id=c108973954db4096ae0c3c3a2e903362)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:07.995311 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a93ffbe-80f1-4e20-a994-6fa96ac93e14 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:07.997464 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 204/409] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Jun 29 12:08:07 2022] GET /identity/v3/groups/c108973954db4096ae0c3c3a2e903362 => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:08.011805 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a93ffbe-80f1-4e20-a994-6fa96ac93e14 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:08.105550 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd5ff12-16f7-4772-848e-3baa390b6801 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:08.122073 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:08.160070 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09fb767-7c41-4ab7-b991-f48e96cff5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:08.160761 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09fb767-7c41-4ab7-b991-f48e96cff5a1 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:08.161090 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09fb767-7c41-4ab7-b991-f48e96cff5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:08.161374 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09fb767-7c41-4ab7-b991-f48e96cff5a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:08.162162 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09fb767-7c41-4ab7-b991-f48e96cff5a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:08.162590 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09fb767-7c41-4ab7-b991-f48e96cff5a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:08.164166 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09fb767-7c41-4ab7-b991-f48e96cff5a1 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:08.179999 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a93ffbe-80f1-4e20-a994-6fa96ac93e14 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:08.184189 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 206/410] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:08:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:08.189264 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09fb767-7c41-4ab7-b991-f48e96cff5a1 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:08.219766 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f356ea83-df80-419a-b1f1-ef3abdc84aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:08.221792 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356ea83-df80-419a-b1f1-ef3abdc84aea None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:08.222432 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356ea83-df80-419a-b1f1-ef3abdc84aea None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:08.224097 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356ea83-df80-419a-b1f1-ef3abdc84aea None admin] PATH_INFO: `/v3/projects/e6ee9295413244e9b7233dd64100ffb7` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:08.226454 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f356ea83-df80-419a-b1f1-ef3abdc84aea None admin] RBAC: Authorizing `identity:get_project(project_id=e6ee9295413244e9b7233dd64100ffb7)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:08.231001 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f356ea83-df80-419a-b1f1-ef3abdc84aea None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:08.233038 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 205/411] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jun 29 12:08:08 2022] GET /identity/v3/projects/e6ee9295413244e9b7233dd64100ffb7 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:08:08.239643 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f356ea83-df80-419a-b1f1-ef3abdc84aea None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:08.302472 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:08.360790 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09fb767-7c41-4ab7-b991-f48e96cff5a1 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:08.422308 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474411cd-8fe7-4814-9cdf-b642169fc474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:08.423173 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474411cd-8fe7-4814-9cdf-b642169fc474 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:08.423451 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474411cd-8fe7-4814-9cdf-b642169fc474 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:08.423720 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474411cd-8fe7-4814-9cdf-b642169fc474 None admin] PATH_INFO: `/v3/groups/6e472bb406f646ec8f92ebbe2035f952` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:08.426003 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474411cd-8fe7-4814-9cdf-b642169fc474 None admin] RBAC: Authorizing `identity:get_group(group_id=6e472bb406f646ec8f92ebbe2035f952)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:08.427476 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474411cd-8fe7-4814-9cdf-b642169fc474 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:08.432988 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f356ea83-df80-419a-b1f1-ef3abdc84aea None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:08.434569 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 207/412] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Jun 29 12:08:08 2022] GET /identity/v3/groups/6e472bb406f646ec8f92ebbe2035f952 => generated 229 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:08:08.437731 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474411cd-8fe7-4814-9cdf-b642169fc474 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:08.502354 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8683114-23d6-4675-93a1-94454309687b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:08.504122 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8683114-23d6-4675-93a1-94454309687b None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:08.504690 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8683114-23d6-4675-93a1-94454309687b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:08.506286 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8683114-23d6-4675-93a1-94454309687b None admin] PATH_INFO: `/v3/projects/e6ee9295413244e9b7233dd64100ffb7/groups/c108973954db4096ae0c3c3a2e903362/roles/ea54879a52d24a47bada5629b6d8b456` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:08.513729 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8683114-23d6-4675-93a1-94454309687b None admin] RBAC: Authorizing `identity:create_grant(project_id=e6ee9295413244e9b7233dd64100ffb7, group_id=c108973954db4096ae0c3c3a2e903362, role_id=ea54879a52d24a47bada5629b6d8b456)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:08.515133 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:08.516642 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8683114-23d6-4675-93a1-94454309687b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:08.546554 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 206/413] 10.222.0.27 () {58 vars in 1442 bytes} [Wed Jun 29 12:08:08 2022] PUT /identity/v3/projects/e6ee9295413244e9b7233dd64100ffb7/groups/c108973954db4096ae0c3c3a2e903362/roles/ea54879a52d24a47bada5629b6d8b456 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:08:08.606101 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474411cd-8fe7-4814-9cdf-b642169fc474 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:08.627780 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5708d-4071-4f69-a191-6cb9f4da0cac None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:08.628354 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5708d-4071-4f69-a191-6cb9f4da0cac None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:08.628354 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5708d-4071-4f69-a191-6cb9f4da0cac None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:08.630024 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 207/414] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:08:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:08:08.638711 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd450b8-5ad0-47e8-97f9-780a48bfbc65 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:08.639464 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd450b8-5ad0-47e8-97f9-780a48bfbc65 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:08.639980 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd450b8-5ad0-47e8-97f9-780a48bfbc65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:08.652999 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc15176-a0d0-440e-9126-1ba0cd479da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:08.653924 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc15176-a0d0-440e-9126-1ba0cd479da9 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:08.654210 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc15176-a0d0-440e-9126-1ba0cd479da9 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:08.654495 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc15176-a0d0-440e-9126-1ba0cd479da9 None admin] PATH_INFO: `/v3/projects/06b39178fa6444fba25717312ec5afa2` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:08.658604 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc15176-a0d0-440e-9126-1ba0cd479da9 None admin] RBAC: Authorizing `identity:get_project(project_id=06b39178fa6444fba25717312ec5afa2)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:08.660090 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc15176-a0d0-440e-9126-1ba0cd479da9 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:08.662368 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 208/415] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jun 29 12:08:08 2022] GET /identity/v3/projects/06b39178fa6444fba25717312ec5afa2 => generated 344 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:08.662892 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-9fd450b8-5ad0-47e8-97f9-780a48bfbc65 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:08.664679 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9fd450b8-5ad0-47e8-97f9-780a48bfbc65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:08.668272 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc15176-a0d0-440e-9126-1ba0cd479da9 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:08.747173 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 208/416] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:08:08.775807 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696e2e7-5f6d-43a4-bf7e-de0ec4d15d9d None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:08.776134 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696e2e7-5f6d-43a4-bf7e-de0ec4d15d9d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:08.776438 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696e2e7-5f6d-43a4-bf7e-de0ec4d15d9d None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:08.779729 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 209/417] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:08:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:08:08.782128 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9696e2e7-5f6d-43a4-bf7e-de0ec4d15d9d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:08.802504 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:08.868337 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc15176-a0d0-440e-9126-1ba0cd479da9 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:08.870023 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:08.908397 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db266d03-cabb-4b65-8b43-ca064ffde1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:08.909324 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db266d03-cabb-4b65-8b43-ca064ffde1e7 None admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:08.909609 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db266d03-cabb-4b65-8b43-ca064ffde1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:08.909905 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db266d03-cabb-4b65-8b43-ca064ffde1e7 None admin] PATH_INFO: `/v3/projects/06b39178fa6444fba25717312ec5afa2/groups/6e472bb406f646ec8f92ebbe2035f952/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:08.912116 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db266d03-cabb-4b65-8b43-ca064ffde1e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=06b39178fa6444fba25717312ec5afa2, group_id=6e472bb406f646ec8f92ebbe2035f952, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:08.913774 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db266d03-cabb-4b65-8b43-ca064ffde1e7 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:08.916607 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9696e2e7-5f6d-43a4-bf7e-de0ec4d15d9d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:08.928565 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 209/418] 10.222.0.27 () {58 vars in 1442 bytes} [Wed Jun 29 12:08:08 2022] PUT /identity/v3/projects/06b39178fa6444fba25717312ec5afa2/groups/6e472bb406f646ec8f92ebbe2035f952/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:08:08.930159 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab6d2d-eb59-4342-80ba-ea6f36c311ee None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:08.930446 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab6d2d-eb59-4342-80ba-ea6f36c311ee None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:08.930728 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab6d2d-eb59-4342-80ba-ea6f36c311ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:08.950167 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-8fab6d2d-eb59-4342-80ba-ea6f36c311ee None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:08.951748 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-8fab6d2d-eb59-4342-80ba-ea6f36c311ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:08.959817 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8418e0-2efd-4509-9389-6a6791607353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:08.961328 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8418e0-2efd-4509-9389-6a6791607353 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:08.961876 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8418e0-2efd-4509-9389-6a6791607353 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:08.962366 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8418e0-2efd-4509-9389-6a6791607353 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:08.974686 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8418e0-2efd-4509-9389-6a6791607353 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:08:08.983827 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-8d8418e0-2efd-4509-9389-6a6791607353 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:08:08.983827 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:08.983827 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:08.983827 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:08.983827 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:08.983827 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:08.983827 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:08.983827 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:08.983827 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:08.983827 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:08.983827 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:08.983827 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:08.983827 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:08:08.983827 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:08:08.983827 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:08:08.983827 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:08:08.984822 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:08:08.984822 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:08:08.984822 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:08:08.984822 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:08:08.984822 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:08.984822 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:08.984822 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:08.984822 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:08.984822 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:08.984822 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:08.984822 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:08.984822 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:08.984822 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:08.984822 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:08.984822 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:08.984822 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:08.985668 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:08.985668 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:08.985668 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:08.985668 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:08.985668 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:08:08.985668 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:08:08.985668 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:08:08.985668 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:08:08.985668 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:08:08.985668 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:08:08.985668 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:08:08.985668 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:08.988286 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 210/419] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:08:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:08.995006 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8418e0-2efd-4509-9389-6a6791607353 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:09.042113 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 210/420] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:08:09.090432 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab6d2d-eb59-4342-80ba-ea6f36c311ee None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:09.113289 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:09.144781 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8418e0-2efd-4509-9389-6a6791607353 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:09.191215 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e0f1e-dee2-4bfe-8945-65bf648f737f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:09.191888 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e0f1e-dee2-4bfe-8945-65bf648f737f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:09.193047 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e0f1e-dee2-4bfe-8945-65bf648f737f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:09.193331 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e0f1e-dee2-4bfe-8945-65bf648f737f None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:09.194566 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3e0f1e-dee2-4bfe-8945-65bf648f737f None admin] RBAC: Adding query filter params (name=member) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:09.194876 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3e0f1e-dee2-4bfe-8945-65bf648f737f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:09.196345 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3e0f1e-dee2-4bfe-8945-65bf648f737f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:09.210105 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 211/421] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jun 29 12:08:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:09.215311 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e0f1e-dee2-4bfe-8945-65bf648f737f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:09.222936 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:09.243059 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab6d2d-eb59-4342-80ba-ea6f36c311ee None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:09.306459 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e39862-c3ee-4555-95fd-0a59034545a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:09.307750 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e39862-c3ee-4555-95fd-0a59034545a7 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:09.310769 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e39862-c3ee-4555-95fd-0a59034545a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:09.311184 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e39862-c3ee-4555-95fd-0a59034545a7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:09.329420 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e39862-c3ee-4555-95fd-0a59034545a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:08:09.339760 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-b0e39862-c3ee-4555-95fd-0a59034545a7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 12:08:09.339760 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:09.339760 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:09.339760 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:09.339760 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:09.339760 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:09.339760 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:09.339760 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:09.339760 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:09.339760 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:09.339760 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:09.339760 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:09.339760 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:08:09.339760 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:08:09.339760 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:08:09.339760 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:08:09.340832 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:08:09.340832 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:08:09.340832 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:08:09.340832 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:08:09.340832 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:09.340832 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:09.340832 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:09.340832 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:09.340832 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:09.340832 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:09.340832 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:09.340832 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:09.340832 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:09.340832 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:09.340832 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:09.340832 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:09.341897 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:09.341897 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:09.341897 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:09.341897 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:09.341897 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:08:09.341897 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:08:09.341897 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:08:09.341897 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:08:09.341897 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:08:09.341897 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:08:09.341897 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 12:08:09.341897 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:09.344108 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 211/422] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jun 29 12:08:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:08:09.360567 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e39862-c3ee-4555-95fd-0a59034545a7 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:09.386816 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e0f1e-dee2-4bfe-8945-65bf648f737f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:09.425920 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2a466-e3da-406b-954c-669dffcf235e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:09.425920 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2a466-e3da-406b-954c-669dffcf235e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:09.425920 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2a466-e3da-406b-954c-669dffcf235e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:09.425920 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2a466-e3da-406b-954c-669dffcf235e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:09.452015 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:09.512088 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e2a466-e3da-406b-954c-669dffcf235e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:09.513571 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e2a466-e3da-406b-954c-669dffcf235e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:09.619135 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e39862-c3ee-4555-95fd-0a59034545a7 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:09.631677 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 212/423] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:08:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 29 12:08:09.634993 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2a466-e3da-406b-954c-669dffcf235e None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:09.687545 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5139ef-b29c-4a11-adfe-144c274b65be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:09.688171 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5139ef-b29c-4a11-adfe-144c274b65be None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:09.688457 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5139ef-b29c-4a11-adfe-144c274b65be None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:09.688733 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5139ef-b29c-4a11-adfe-144c274b65be None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:09.689498 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5139ef-b29c-4a11-adfe-144c274b65be None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:09.689835 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5139ef-b29c-4a11-adfe-144c274b65be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:09.691432 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5139ef-b29c-4a11-adfe-144c274b65be None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:09.711583 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:09.719616 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 212/424] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jun 29 12:08:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:08:09.720939 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5139ef-b29c-4a11-adfe-144c274b65be None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:09.742950 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:09.841115 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2a466-e3da-406b-954c-669dffcf235e None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:09.873612 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5139ef-b29c-4a11-adfe-144c274b65be None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:09.876540 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48589eaa-576d-4a4b-873b-28186519cb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:09.877473 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48589eaa-576d-4a4b-873b-28186519cb82 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:09.877787 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48589eaa-576d-4a4b-873b-28186519cb82 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:09.878062 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48589eaa-576d-4a4b-873b-28186519cb82 None admin] PATH_INFO: `/v3/projects/dcc3d4b81e0d470bab2492f8eb193665` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:09.879289 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48589eaa-576d-4a4b-873b-28186519cb82 None admin] RBAC: Authorizing `identity:get_project(project_id=dcc3d4b81e0d470bab2492f8eb193665)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:09.880734 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48589eaa-576d-4a4b-873b-28186519cb82 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:09.883041 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 213/425] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jun 29 12:08:09 2022] GET /identity/v3/projects/dcc3d4b81e0d470bab2492f8eb193665 => generated 298 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:09.889657 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48589eaa-576d-4a4b-873b-28186519cb82 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:10.000418 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1e976-f265-4ee9-a3d1-be8157a1bb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:10.002775 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1e976-f265-4ee9-a3d1-be8157a1bb3d None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:10.003252 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1e976-f265-4ee9-a3d1-be8157a1bb3d None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:10.003862 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1e976-f265-4ee9-a3d1-be8157a1bb3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:10.005883 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48589eaa-576d-4a4b-873b-28186519cb82 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:10.025265 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:10.075853 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e9194-8a7d-4e97-a97b-d53519df32f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:10.076715 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e9194-8a7d-4e97-a97b-d53519df32f4 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:10.076999 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e9194-8a7d-4e97-a97b-d53519df32f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:10.077271 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e9194-8a7d-4e97-a97b-d53519df32f4 None admin] PATH_INFO: `/v3/groups/c108973954db4096ae0c3c3a2e903362` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:10.078513 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e9194-8a7d-4e97-a97b-d53519df32f4 None admin] RBAC: Authorizing `identity:get_group(group_id=c108973954db4096ae0c3c3a2e903362)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:10.079950 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e9194-8a7d-4e97-a97b-d53519df32f4 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:10.081854 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 214/426] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Jun 29 12:08:09 2022] GET /identity/v3/groups/c108973954db4096ae0c3c3a2e903362 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:08:10.083126 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38b298-aba3-41c9-9891-4e4605f3e8d5 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:10.083405 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38b298-aba3-41c9-9891-4e4605f3e8d5 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:10.083675 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38b298-aba3-41c9-9891-4e4605f3e8d5 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:10.094166 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 215/427] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:08:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:10.094166 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38b298-aba3-41c9-9891-4e4605f3e8d5 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:10.118344 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a1e976-f265-4ee9-a3d1-be8157a1bb3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:10.119854 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a1e976-f265-4ee9-a3d1-be8157a1bb3d None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:10.135030 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:10.210976 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38b298-aba3-41c9-9891-4e4605f3e8d5 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:10.232006 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 213/428] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:08:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:08:10.233545 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf977c8-2dc3-428a-bbf0-b26f7b7036e1 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:10.233726 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf977c8-2dc3-428a-bbf0-b26f7b7036e1 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:10.234117 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf977c8-2dc3-428a-bbf0-b26f7b7036e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:10.248977 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e341b97-1e27-47e6-b7c1-f86166fecabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:10.249979 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e341b97-1e27-47e6-b7c1-f86166fecabd None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:10.250496 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e341b97-1e27-47e6-b7c1-f86166fecabd None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:10.250944 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e341b97-1e27-47e6-b7c1-f86166fecabd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:10.251600 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-fdf977c8-2dc3-428a-bbf0-b26f7b7036e1 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:10.252382 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e341b97-1e27-47e6-b7c1-f86166fecabd None admin] RBAC: Adding query filter params (group.id=c108973954db4096ae0c3c3a2e903362, role.id=c49accbc6f81447cb221ef720db04ced, scope.project.id=dcc3d4b81e0d470bab2492f8eb193665) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:10.252878 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e341b97-1e27-47e6-b7c1-f86166fecabd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:10.252977 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-fdf977c8-2dc3-428a-bbf0-b26f7b7036e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:10.254624 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e341b97-1e27-47e6-b7c1-f86166fecabd None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:10.265849 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 216/429] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Jun 29 12:08:10 2022] GET /identity/v3/role_assignments?group.id=c108973954db4096ae0c3c3a2e903362&scope.project.id=dcc3d4b81e0d470bab2492f8eb193665&role.id=c49accbc6f81447cb221ef720db04ced => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:10.267111 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e341b97-1e27-47e6-b7c1-f86166fecabd None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:10.329720 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 214/430] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:08:10.350209 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:10.363783 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf977c8-2dc3-428a-bbf0-b26f7b7036e1 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:10.422440 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:10.471587 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e341b97-1e27-47e6-b7c1-f86166fecabd None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:10.498950 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf977c8-2dc3-428a-bbf0-b26f7b7036e1 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:10.516067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c1b19-24d0-4b29-8822-e34879b748eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:10.516875 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c1b19-24d0-4b29-8822-e34879b748eb None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:10.517155 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c1b19-24d0-4b29-8822-e34879b748eb None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:10.517430 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c1b19-24d0-4b29-8822-e34879b748eb None admin] PATH_INFO: `/v3/projects/dcc3d4b81e0d470bab2492f8eb193665` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:10.518925 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6c1b19-24d0-4b29-8822-e34879b748eb None admin] RBAC: Authorizing `identity:get_project(project_id=dcc3d4b81e0d470bab2492f8eb193665)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:10.521044 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6c1b19-24d0-4b29-8822-e34879b748eb None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:10.523229 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 217/431] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jun 29 12:08:10 2022] GET /identity/v3/projects/dcc3d4b81e0d470bab2492f8eb193665 => generated 298 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:10.530672 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c1b19-24d0-4b29-8822-e34879b748eb None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:10.547221 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcdd5d3-05bc-4bb4-b8dd-9bc77d34815f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:10.548430 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcdd5d3-05bc-4bb4-b8dd-9bc77d34815f None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:10.548859 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcdd5d3-05bc-4bb4-b8dd-9bc77d34815f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:10.549267 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcdd5d3-05bc-4bb4-b8dd-9bc77d34815f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:10.562608 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcdd5d3-05bc-4bb4-b8dd-9bc77d34815f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:08:10.572838 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-1bcdd5d3-05bc-4bb4-b8dd-9bc77d34815f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:08:10.572838 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:10.572838 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:10.572838 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:10.572838 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:10.572838 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:10.572838 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:10.572838 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:10.572838 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:10.572838 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:10.572838 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:10.572838 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:10.572838 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:08:10.572838 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:08:10.572838 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:08:10.572838 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:08:10.573888 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:08:10.573888 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:08:10.573888 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:08:10.573888 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:08:10.573888 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:10.573888 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:10.573888 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:10.573888 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:10.573888 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:10.573888 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:10.573888 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:10.573888 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:10.573888 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:10.573888 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:10.573888 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:10.573888 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:10.574726 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:10.574726 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:10.574726 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:10.574726 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:10.574726 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:08:10.574726 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:08:10.574726 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:08:10.574726 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:08:10.574726 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:08:10.574726 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:08:10.574726 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 12:08:10.574726 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:10.575334 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 215/432] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:08:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:08:10.582105 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcdd5d3-05bc-4bb4-b8dd-9bc77d34815f None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:10.663200 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c1b19-24d0-4b29-8822-e34879b748eb None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:10.678060 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:10.703420 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01377ce1-0877-47ce-8d6a-d06cfab37621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:10.704286 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01377ce1-0877-47ce-8d6a-d06cfab37621 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:10.704566 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01377ce1-0877-47ce-8d6a-d06cfab37621 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:10.704836 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01377ce1-0877-47ce-8d6a-d06cfab37621 None admin] PATH_INFO: `/v3/groups/c108973954db4096ae0c3c3a2e903362` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:10.706201 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01377ce1-0877-47ce-8d6a-d06cfab37621 None admin] RBAC: Authorizing `identity:get_group(group_id=c108973954db4096ae0c3c3a2e903362)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:10.707707 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01377ce1-0877-47ce-8d6a-d06cfab37621 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:10.709931 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 218/433] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Jun 29 12:08:10 2022] GET /identity/v3/groups/c108973954db4096ae0c3c3a2e903362 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:10.716719 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01377ce1-0877-47ce-8d6a-d06cfab37621 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:10.720059 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcdd5d3-05bc-4bb4-b8dd-9bc77d34815f None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:10.725289 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:10.769557 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f4ad4-249c-4f8a-944c-c826d8c76bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:10.770611 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f4ad4-249c-4f8a-944c-c826d8c76bd4 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:10.771101 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f4ad4-249c-4f8a-944c-c826d8c76bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:10.771383 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f4ad4-249c-4f8a-944c-c826d8c76bd4 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:10.772187 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7f4ad4-249c-4f8a-944c-c826d8c76bd4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:10.772496 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7f4ad4-249c-4f8a-944c-c826d8c76bd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:10.774711 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7f4ad4-249c-4f8a-944c-c826d8c76bd4 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:10.787588 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 216/434] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jun 29 12:08:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:08:10.794948 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f4ad4-249c-4f8a-944c-c826d8c76bd4 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:10.886801 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01377ce1-0877-47ce-8d6a-d06cfab37621 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:10.923069 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f4ad4-249c-4f8a-944c-c826d8c76bd4 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:10.938239 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b9bfdb-fa0e-4bce-bb5f-91a5e4ec3089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:10.939245 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9bfdb-fa0e-4bce-bb5f-91a5e4ec3089 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:10.939758 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9bfdb-fa0e-4bce-bb5f-91a5e4ec3089 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:10.940251 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9bfdb-fa0e-4bce-bb5f-91a5e4ec3089 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:10.941351 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b9bfdb-fa0e-4bce-bb5f-91a5e4ec3089 None admin] RBAC: Adding query filter params (group.id=c108973954db4096ae0c3c3a2e903362, role.id=ea54879a52d24a47bada5629b6d8b456, scope.project.id=dcc3d4b81e0d470bab2492f8eb193665) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:10.941872 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b9bfdb-fa0e-4bce-bb5f-91a5e4ec3089 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:10.944115 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b9bfdb-fa0e-4bce-bb5f-91a5e4ec3089 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:10.951758 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 219/435] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Jun 29 12:08:10 2022] GET /identity/v3/role_assignments?group.id=c108973954db4096ae0c3c3a2e903362&scope.project.id=dcc3d4b81e0d470bab2492f8eb193665&role.id=ea54879a52d24a47bada5629b6d8b456 => generated 611 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:10.965016 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076a9c46-8455-431a-a77b-a6791cdbeba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:10.966135 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a9c46-8455-431a-a77b-a6791cdbeba3 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:10.966605 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a9c46-8455-431a-a77b-a6791cdbeba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:10.967052 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a9c46-8455-431a-a77b-a6791cdbeba3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:10.984157 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe998e7-43f8-45db-9171-345ed0675dcb None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:10.984466 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe998e7-43f8-45db-9171-345ed0675dcb None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:10.984884 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe998e7-43f8-45db-9171-345ed0675dcb None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:10.986708 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 220/436] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:08:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:10.992537 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f2120-e1f3-485c-bc85-f898eb5b2475 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:10.992885 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f2120-e1f3-485c-bc85-f898eb5b2475 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:10.993234 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f2120-e1f3-485c-bc85-f898eb5b2475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:11.010212 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:11.016569 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-947f2120-e1f3-485c-bc85-f898eb5b2475 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:11.018832 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-947f2120-e1f3-485c-bc85-f898eb5b2475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:11.062854 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076a9c46-8455-431a-a77b-a6791cdbeba3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:11.064356 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076a9c46-8455-431a-a77b-a6791cdbeba3 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:11.080642 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:11.131045 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 221/437] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 12:08:11.163772 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f2120-e1f3-485c-bc85-f898eb5b2475 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:11.189751 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 217/438] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:08:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:08:11.191514 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076a9c46-8455-431a-a77b-a6791cdbeba3 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:11.279416 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:11.294913 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f2120-e1f3-485c-bc85-f898eb5b2475 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:11.322009 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076a9c46-8455-431a-a77b-a6791cdbeba3 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:11.335768 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f0eb6d-ecf8-4e59-861a-b4e907ea6589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:11.336529 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0eb6d-ecf8-4e59-861a-b4e907ea6589 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:11.336817 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0eb6d-ecf8-4e59-861a-b4e907ea6589 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:11.337090 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0eb6d-ecf8-4e59-861a-b4e907ea6589 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:11.352430 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f0eb6d-ecf8-4e59-861a-b4e907ea6589 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:08:11.361113 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-03f0eb6d-ecf8-4e59-861a-b4e907ea6589 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 12:08:11.361113 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:11.361113 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:11.361113 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:11.361113 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:11.361113 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:11.361113 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:11.361113 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:11.361113 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:11.361113 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:11.361113 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:11.361113 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:11.361113 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:08:11.361113 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:08:11.361113 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:08:11.361113 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:08:11.362200 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:08:11.362200 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:08:11.362200 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:08:11.362200 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:08:11.362200 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:11.362200 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:11.362200 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:11.362200 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:11.362200 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:11.362200 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:11.362200 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:11.362200 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:11.362200 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:11.362200 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:11.362200 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:11.362200 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:11.363014 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:11.363014 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:11.363014 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:11.363014 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:11.363014 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:08:11.363014 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:08:11.363014 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:08:11.363014 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:08:11.363014 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:08:11.363014 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:08:11.363014 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 12:08:11.363014 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:11.363622 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 222/439] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jun 29 12:08:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:08:11.364278 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569482b-44b6-4ecc-9bf9-9ab1f7bc09f5 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:11.364556 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569482b-44b6-4ecc-9bf9-9ab1f7bc09f5 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:11.364826 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569482b-44b6-4ecc-9bf9-9ab1f7bc09f5 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:11.366405 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 223/440] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:08:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:11.366511 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee8a59-6ec5-4398-87c8-d8b67d985908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:11.367434 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee8a59-6ec5-4398-87c8-d8b67d985908 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:11.367718 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee8a59-6ec5-4398-87c8-d8b67d985908 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:11.367991 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee8a59-6ec5-4398-87c8-d8b67d985908 None admin] PATH_INFO: `/v3/projects/e6ee9295413244e9b7233dd64100ffb7` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:11.369295 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fee8a59-6ec5-4398-87c8-d8b67d985908 None admin] RBAC: Authorizing `identity:get_project(project_id=e6ee9295413244e9b7233dd64100ffb7)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:11.370794 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fee8a59-6ec5-4398-87c8-d8b67d985908 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:11.371824 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2569482b-44b6-4ecc-9bf9-9ab1f7bc09f5 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:11.372500 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 218/441] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jun 29 12:08:11 2022] GET /identity/v3/projects/e6ee9295413244e9b7233dd64100ffb7 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:11.373675 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18133f2-5f88-4058-969a-4f14ba6bc8b5 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:11.374990 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18133f2-5f88-4058-969a-4f14ba6bc8b5 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:11.375268 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18133f2-5f88-4058-969a-4f14ba6bc8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:11.392449 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-d18133f2-5f88-4058-969a-4f14ba6bc8b5 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:11.393631 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-d18133f2-5f88-4058-969a-4f14ba6bc8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:11.406025 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:11.466507 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 219/442] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:08:11.467354 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18133f2-5f88-4058-969a-4f14ba6bc8b5 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:11.485187 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2569482b-44b6-4ecc-9bf9-9ab1f7bc09f5 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:11.522259 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10922409-b9da-4fdc-a4b7-9ca4e0efc4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:11.522936 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10922409-b9da-4fdc-a4b7-9ca4e0efc4a5 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:11.523220 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10922409-b9da-4fdc-a4b7-9ca4e0efc4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:11.523496 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10922409-b9da-4fdc-a4b7-9ca4e0efc4a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:11.524256 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10922409-b9da-4fdc-a4b7-9ca4e0efc4a5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:11.524564 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10922409-b9da-4fdc-a4b7-9ca4e0efc4a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:11.525994 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10922409-b9da-4fdc-a4b7-9ca4e0efc4a5 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:11.531652 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:11.534872 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 224/443] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jun 29 12:08:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:11.535666 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10922409-b9da-4fdc-a4b7-9ca4e0efc4a5 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:11.575747 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18133f2-5f88-4058-969a-4f14ba6bc8b5 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:11.610213 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b94ffc-fd6b-4dd2-b8b0-46d935d9b4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:11.611083 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b94ffc-fd6b-4dd2-b8b0-46d935d9b4d1 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:11.611368 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b94ffc-fd6b-4dd2-b8b0-46d935d9b4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:11.611646 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b94ffc-fd6b-4dd2-b8b0-46d935d9b4d1 None admin] PATH_INFO: `/v3/groups/c108973954db4096ae0c3c3a2e903362` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:11.612857 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b94ffc-fd6b-4dd2-b8b0-46d935d9b4d1 None admin] RBAC: Authorizing `identity:get_group(group_id=c108973954db4096ae0c3c3a2e903362)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:11.614356 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b94ffc-fd6b-4dd2-b8b0-46d935d9b4d1 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:11.616303 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 220/444] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Jun 29 12:08:11 2022] GET /identity/v3/groups/c108973954db4096ae0c3c3a2e903362 => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:11.616762 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b94ffc-fd6b-4dd2-b8b0-46d935d9b4d1 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:11.632700 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:11.641797 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10922409-b9da-4fdc-a4b7-9ca4e0efc4a5 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:11.681645 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf761b-8f41-44b1-867d-8790927b2e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:11.682479 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf761b-8f41-44b1-867d-8790927b2e04 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:11.682781 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf761b-8f41-44b1-867d-8790927b2e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:11.683040 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf761b-8f41-44b1-867d-8790927b2e04 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:11.693467 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bf761b-8f41-44b1-867d-8790927b2e04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:08:11.701006 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-20bf761b-8f41-44b1-867d-8790927b2e04 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:08:11.701006 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:11.701006 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:11.701006 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:11.701006 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:11.701006 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:11.701006 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:11.701006 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:11.701006 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:11.701006 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:11.701006 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:11.701006 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:11.701006 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:08:11.701006 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:08:11.701006 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:08:11.701006 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:08:11.702440 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:08:11.702440 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:08:11.702440 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:08:11.702440 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:08:11.702440 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:11.702440 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:11.702440 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:11.702440 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:11.702440 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:11.702440 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:11.702440 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:11.702440 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:11.702440 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:11.702440 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:11.702440 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:11.702440 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:11.703482 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:11.703482 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:11.703482 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:11.703482 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:11.703482 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:08:11.703482 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:08:11.703482 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:08:11.703482 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:08:11.703482 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:08:11.703482 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:08:11.703482 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:08:11.703482 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:11.703482 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 225/445] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jun 29 12:08:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:11.704644 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf761b-8f41-44b1-867d-8790927b2e04 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:11.727771 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b94ffc-fd6b-4dd2-b8b0-46d935d9b4d1 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:11.757303 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:11.763275 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff41a1-b095-4913-a297-61d9524d6444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:11.763933 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff41a1-b095-4913-a297-61d9524d6444 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:11.764221 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff41a1-b095-4913-a297-61d9524d6444 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:11.764497 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff41a1-b095-4913-a297-61d9524d6444 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:11.801888 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf761b-8f41-44b1-867d-8790927b2e04 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:11.837866 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf6f19-9011-4ea9-89e2-ad71bf7ae10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:11.838448 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf6f19-9011-4ea9-89e2-ad71bf7ae10a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:11.838733 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf6f19-9011-4ea9-89e2-ad71bf7ae10a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:11.839005 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf6f19-9011-4ea9-89e2-ad71bf7ae10a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:11.839639 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff41a1-b095-4913-a297-61d9524d6444 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:11.839839 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebf6f19-9011-4ea9-89e2-ad71bf7ae10a None admin] RBAC: Adding query filter params (group.id=c108973954db4096ae0c3c3a2e903362, role.id=c49accbc6f81447cb221ef720db04ced, scope.project.id=e6ee9295413244e9b7233dd64100ffb7) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:11.840152 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebf6f19-9011-4ea9-89e2-ad71bf7ae10a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:11.841151 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff41a1-b095-4913-a297-61d9524d6444 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:11.841638 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebf6f19-9011-4ea9-89e2-ad71bf7ae10a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:11.848697 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 226/446] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Jun 29 12:08:11 2022] GET /identity/v3/role_assignments?group.id=c108973954db4096ae0c3c3a2e903362&scope.project.id=e6ee9295413244e9b7233dd64100ffb7&role.id=c49accbc6f81447cb221ef720db04ced => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:11.849577 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf6f19-9011-4ea9-89e2-ad71bf7ae10a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:11.870683 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:11.968068 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf6f19-9011-4ea9-89e2-ad71bf7ae10a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:11.971848 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 221/447] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:08:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:08:11.978233 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff41a1-b095-4913-a297-61d9524d6444 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:12.009492 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c3896d-3682-4b02-80e0-ef76ffb9e43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:12.010232 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c3896d-3682-4b02-80e0-ef76ffb9e43f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:12.011355 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c3896d-3682-4b02-80e0-ef76ffb9e43f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:12.011355 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c3896d-3682-4b02-80e0-ef76ffb9e43f None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:12.012216 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c3896d-3682-4b02-80e0-ef76ffb9e43f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:12.012216 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c3896d-3682-4b02-80e0-ef76ffb9e43f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:12.014501 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c3896d-3682-4b02-80e0-ef76ffb9e43f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:12.015725 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:12.022995 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 227/448] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:08:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:12.028809 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c3896d-3682-4b02-80e0-ef76ffb9e43f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:12.110310 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff41a1-b095-4913-a297-61d9524d6444 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:12.120852 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:12.144914 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c3896d-3682-4b02-80e0-ef76ffb9e43f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:12.149598 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d33cec9-7555-4df1-9628-bc1f0d5b74a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:12.149953 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33cec9-7555-4df1-9628-bc1f0d5b74a6 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:12.150230 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33cec9-7555-4df1-9628-bc1f0d5b74a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:12.150500 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33cec9-7555-4df1-9628-bc1f0d5b74a6 None admin] PATH_INFO: `/v3/projects/e6ee9295413244e9b7233dd64100ffb7` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:12.151697 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d33cec9-7555-4df1-9628-bc1f0d5b74a6 None admin] RBAC: Authorizing `identity:get_project(project_id=e6ee9295413244e9b7233dd64100ffb7)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:12.153150 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d33cec9-7555-4df1-9628-bc1f0d5b74a6 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:12.157727 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 222/449] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jun 29 12:08:11 2022] GET /identity/v3/projects/e6ee9295413244e9b7233dd64100ffb7 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:12.160719 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d33cec9-7555-4df1-9628-bc1f0d5b74a6 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:12.187184 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbbf85c-f97c-4662-84a0-0ffcafd3432a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:12.187850 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbf85c-f97c-4662-84a0-0ffcafd3432a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:12.188135 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbf85c-f97c-4662-84a0-0ffcafd3432a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:12.188410 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbf85c-f97c-4662-84a0-0ffcafd3432a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:12.264418 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbbf85c-f97c-4662-84a0-0ffcafd3432a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:12.265923 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbbf85c-f97c-4662-84a0-0ffcafd3432a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:12.269819 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:12.272989 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d33cec9-7555-4df1-9628-bc1f0d5b74a6 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:12.308099 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee203ab-087a-49ac-b819-e199cd8c370c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:12.308955 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee203ab-087a-49ac-b819-e199cd8c370c None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:12.309233 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee203ab-087a-49ac-b819-e199cd8c370c None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:12.309504 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee203ab-087a-49ac-b819-e199cd8c370c None admin] PATH_INFO: `/v3/groups/c108973954db4096ae0c3c3a2e903362` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:12.310731 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee203ab-087a-49ac-b819-e199cd8c370c None admin] RBAC: Authorizing `identity:get_group(group_id=c108973954db4096ae0c3c3a2e903362)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:12.312188 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee203ab-087a-49ac-b819-e199cd8c370c None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:12.313853 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 223/450] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Jun 29 12:08:12 2022] GET /identity/v3/groups/c108973954db4096ae0c3c3a2e903362 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:08:12.319812 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee203ab-087a-49ac-b819-e199cd8c370c None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:12.343984 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:12.367256 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 228/451] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:08:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 29 12:08:12.372761 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbbf85c-f97c-4662-84a0-0ffcafd3432a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:12.421038 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee203ab-087a-49ac-b819-e199cd8c370c None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:12.454803 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f4d101-97bd-452e-b02d-83ddb1cd43f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:12.455460 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4d101-97bd-452e-b02d-83ddb1cd43f6 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:12.455741 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4d101-97bd-452e-b02d-83ddb1cd43f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:12.456012 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4d101-97bd-452e-b02d-83ddb1cd43f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:12.456842 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f4d101-97bd-452e-b02d-83ddb1cd43f6 None admin] RBAC: Adding query filter params (group.id=c108973954db4096ae0c3c3a2e903362, role.id=ea54879a52d24a47bada5629b6d8b456, scope.project.id=e6ee9295413244e9b7233dd64100ffb7) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:12.457148 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f4d101-97bd-452e-b02d-83ddb1cd43f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:12.458622 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f4d101-97bd-452e-b02d-83ddb1cd43f6 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:12.464863 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 224/452] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Jun 29 12:08:12 2022] GET /identity/v3/role_assignments?group.id=c108973954db4096ae0c3c3a2e903362&scope.project.id=e6ee9295413244e9b7233dd64100ffb7&role.id=ea54879a52d24a47bada5629b6d8b456 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:08:12.470893 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbbf85c-f97c-4662-84a0-0ffcafd3432a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:12.509325 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c6e55f-4df8-4ac4-8d5b-0e0039b686a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:12.510262 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6e55f-4df8-4ac4-8d5b-0e0039b686a9 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:12.510546 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6e55f-4df8-4ac4-8d5b-0e0039b686a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:12.510819 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6e55f-4df8-4ac4-8d5b-0e0039b686a9 None admin] PATH_INFO: `/v3/projects/06b39178fa6444fba25717312ec5afa2` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:12.512135 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c6e55f-4df8-4ac4-8d5b-0e0039b686a9 None admin] RBAC: Authorizing `identity:get_project(project_id=06b39178fa6444fba25717312ec5afa2)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:12.513622 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c6e55f-4df8-4ac4-8d5b-0e0039b686a9 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:12.515462 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 229/453] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jun 29 12:08:12 2022] GET /identity/v3/projects/06b39178fa6444fba25717312ec5afa2 => generated 344 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:08:12.521467 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f4d101-97bd-452e-b02d-83ddb1cd43f6 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:12.557977 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:12.635010 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f4d101-97bd-452e-b02d-83ddb1cd43f6 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:12.670689 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f943d4-c23f-4df6-a123-f71753f54a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:12.671564 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f943d4-c23f-4df6-a123-f71753f54a49 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:12.671846 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f943d4-c23f-4df6-a123-f71753f54a49 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:12.672148 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f943d4-c23f-4df6-a123-f71753f54a49 None admin] PATH_INFO: `/v3/groups/6e472bb406f646ec8f92ebbe2035f952` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:12.673345 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f943d4-c23f-4df6-a123-f71753f54a49 None admin] RBAC: Authorizing `identity:get_group(group_id=6e472bb406f646ec8f92ebbe2035f952)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:12.674848 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f943d4-c23f-4df6-a123-f71753f54a49 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:12.676493 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 225/454] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Jun 29 12:08:12 2022] GET /identity/v3/groups/6e472bb406f646ec8f92ebbe2035f952 => generated 229 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:12.682786 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c6e55f-4df8-4ac4-8d5b-0e0039b686a9 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:12.730263 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:12.784712 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c6e55f-4df8-4ac4-8d5b-0e0039b686a9 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:12.819409 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b28b102-9791-4fa7-9ec7-12d07f1e2bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:12.820534 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b28b102-9791-4fa7-9ec7-12d07f1e2bd8 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:12.821019 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b28b102-9791-4fa7-9ec7-12d07f1e2bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:12.821514 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b28b102-9791-4fa7-9ec7-12d07f1e2bd8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:12.822968 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b28b102-9791-4fa7-9ec7-12d07f1e2bd8 None admin] RBAC: Adding query filter params (group.id=6e472bb406f646ec8f92ebbe2035f952, role.id=e0e69ac8a8bf4cc4baa6aa18f2fc9919, scope.project.id=06b39178fa6444fba25717312ec5afa2) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:12.823363 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b28b102-9791-4fa7-9ec7-12d07f1e2bd8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:12.824820 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b28b102-9791-4fa7-9ec7-12d07f1e2bd8 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:12.831239 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 230/455] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Jun 29 12:08:12 2022] GET /identity/v3/role_assignments?group.id=6e472bb406f646ec8f92ebbe2035f952&scope.project.id=06b39178fa6444fba25717312ec5afa2&role.id=e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:15.311636 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d96094-d09a-41c5-8008-f6db795ef667 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:15.312140 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d96094-d09a-41c5-8008-f6db795ef667 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:15.312236 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d96094-d09a-41c5-8008-f6db795ef667 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:15.313859 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 226/456] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:08:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:15.320115 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896b5e2-fff4-44e0-8a32-a68a1cf4747a None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:15.320551 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896b5e2-fff4-44e0-8a32-a68a1cf4747a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:15.320655 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896b5e2-fff4-44e0-8a32-a68a1cf4747a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:15.356898 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-a896b5e2-fff4-44e0-8a32-a68a1cf4747a None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:15.358683 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a896b5e2-fff4-44e0-8a32-a68a1cf4747a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:15.457066 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 231/457] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:08:15.498120 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d96094-d09a-41c5-8008-f6db795ef667 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:15.652208 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:15.661732 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d96094-d09a-41c5-8008-f6db795ef667 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:15.683609 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ea093-6a41-4bf2-9bfd-4daca2f78e27 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:15.684238 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ea093-6a41-4bf2-9bfd-4daca2f78e27 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:15.684708 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ea093-6a41-4bf2-9bfd-4daca2f78e27 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:15.686622 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 232/458] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:08:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:08:15.692274 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ce25b-d2c0-427d-b665-6229ca8ce48b None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:15.692669 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ce25b-d2c0-427d-b665-6229ca8ce48b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:15.693149 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ce25b-d2c0-427d-b665-6229ca8ce48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:15.710849 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c6f0e2-c42e-435f-abcf-d0594a00ca7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:15.711665 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6f0e2-c42e-435f-abcf-d0594a00ca7e None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:15.711946 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6f0e2-c42e-435f-abcf-d0594a00ca7e None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:15.712222 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6f0e2-c42e-435f-abcf-d0594a00ca7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:15.722798 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-609ce25b-d2c0-427d-b665-6229ca8ce48b None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:15.724006 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-609ce25b-d2c0-427d-b665-6229ca8ce48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:15.724868 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c6f0e2-c42e-435f-abcf-d0594a00ca7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:15.728387 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c6f0e2-c42e-435f-abcf-d0594a00ca7e None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:15.747658 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-45c6f0e2-c42e-435f-abcf-d0594a00ca7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:15.747658 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:15.747658 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:15.747658 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:15.747658 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:15.747658 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:15.747658 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:15.747658 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:15.747658 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:15.747658 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:15.747658 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:15.747658 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:15.747658 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:15.747658 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:15.747658 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:15.748570 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:15.748570 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:15.748570 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:15.748570 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:15.748570 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:15.748570 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:15.748570 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:15.748570 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:15.748570 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:15.748570 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:15.748570 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:15.748570 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:15.748570 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:15.748570 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:15.748570 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:15.748570 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:15.748570 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:15.749658 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:15.749658 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:15.749658 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:15.749658 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:15.752138 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 227/459] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:15.758220 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c6f0e2-c42e-435f-abcf-d0594a00ca7e None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:15.786762 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:15.823871 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 233/460] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 12:08:15.825451 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cb1a8-4540-4738-bc52-fac48ad3e0ad None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:15.825836 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cb1a8-4540-4738-bc52-fac48ad3e0ad None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:15.826182 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cb1a8-4540-4738-bc52-fac48ad3e0ad None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:15.828234 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 234/461] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:08:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:15.833976 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be757fef-fb05-480f-bdcf-87799cc32ab2 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:15.834297 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be757fef-fb05-480f-bdcf-87799cc32ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:15.834536 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be757fef-fb05-480f-bdcf-87799cc32ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:15.860157 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-be757fef-fb05-480f-bdcf-87799cc32ab2 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:15.861446 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-be757fef-fb05-480f-bdcf-87799cc32ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:15.887074 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c6f0e2-c42e-435f-abcf-d0594a00ca7e None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:15.924674 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f3799-7a9e-40da-84a9-021117a3d626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:15.925536 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f3799-7a9e-40da-84a9-021117a3d626 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:15.925867 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f3799-7a9e-40da-84a9-021117a3d626 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:15.926398 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f3799-7a9e-40da-84a9-021117a3d626 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:15.927576 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f3799-7a9e-40da-84a9-021117a3d626 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:15.928020 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f3799-7a9e-40da-84a9-021117a3d626 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:15.929602 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f3799-7a9e-40da-84a9-021117a3d626 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:15.936670 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 235/462] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:08:15.937544 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be757fef-fb05-480f-bdcf-87799cc32ab2 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:15.944535 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 228/463] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:15.950063 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f3799-7a9e-40da-84a9-021117a3d626 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:15.966485 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:16.063669 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:16.066076 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f3799-7a9e-40da-84a9-021117a3d626 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:16.067722 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be757fef-fb05-480f-bdcf-87799cc32ab2 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:16.103013 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac42b21-93e7-4080-93ca-4514e74468f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:16.103618 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b891903-48b6-447a-a078-00616b7ec123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:16.104085 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac42b21-93e7-4080-93ca-4514e74468f4 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:16.104294 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b891903-48b6-447a-a078-00616b7ec123 None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:16.104408 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac42b21-93e7-4080-93ca-4514e74468f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:16.104579 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b891903-48b6-447a-a078-00616b7ec123 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:16.104672 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac42b21-93e7-4080-93ca-4514e74468f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:16.104862 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b891903-48b6-447a-a078-00616b7ec123 None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:16.105574 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b891903-48b6-447a-a078-00616b7ec123 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:16.107277 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b891903-48b6-447a-a078-00616b7ec123 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:16.115060 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac42b21-93e7-4080-93ca-4514e74468f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:16.116663 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac42b21-93e7-4080-93ca-4514e74468f4 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:16.137175 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-2ac42b21-93e7-4080-93ca-4514e74468f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:16.137175 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:16.137175 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:16.137175 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:16.137175 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:16.137175 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:16.137175 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:16.137175 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:16.137175 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:16.137175 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:16.137175 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:16.137175 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:16.137175 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:16.137175 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:16.137175 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:16.138262 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:16.138262 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:16.138262 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:16.138262 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:16.138262 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:16.138262 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:16.138262 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:16.138262 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:16.138262 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:16.138262 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:16.138262 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:16.138262 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:16.138262 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:16.138262 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:16.138262 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:16.138262 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:16.138262 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:16.139139 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:16.139139 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:16.139139 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:16.139139 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:16.139353 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 229/464] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Jun 29 12:08:15 2022] POST /identity/v3/users => generated 246 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:08:16.139424 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 236/465] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:16.139489 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b891903-48b6-447a-a078-00616b7ec123 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:16.145014 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d30f4-225e-4cf6-987e-642bc27dd8a8 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:16.145014 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d30f4-225e-4cf6-987e-642bc27dd8a8 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:16.145014 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d30f4-225e-4cf6-987e-642bc27dd8a8 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:16.146630 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 237/466] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:08:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:16.147705 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d30f4-225e-4cf6-987e-642bc27dd8a8 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:16.228098 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:16.277464 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b891903-48b6-447a-a078-00616b7ec123 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:16.288108 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d30f4-225e-4cf6-987e-642bc27dd8a8 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:16.322106 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a17da74-6e98-492e-97a4-590de67da73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:16.323404 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17da74-6e98-492e-97a4-590de67da73b None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:16.323693 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17da74-6e98-492e-97a4-590de67da73b None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:16.324106 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17da74-6e98-492e-97a4-590de67da73b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:16.331546 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b15b0bc-35b0-4d50-901b-ac4485a45ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:16.332738 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15b0bc-35b0-4d50-901b-ac4485a45ca3 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:16.333014 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15b0bc-35b0-4d50-901b-ac4485a45ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:16.333442 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15b0bc-35b0-4d50-901b-ac4485a45ca3 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:16.334222 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b15b0bc-35b0-4d50-901b-ac4485a45ca3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:16.334681 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b15b0bc-35b0-4d50-901b-ac4485a45ca3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:16.336148 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b15b0bc-35b0-4d50-901b-ac4485a45ca3 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:16.337158 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a17da74-6e98-492e-97a4-590de67da73b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:16.338823 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a17da74-6e98-492e-97a4-590de67da73b None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:16.351449 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 238/467] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:16.353053 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21e37a-079a-46c4-8926-df32c0e7574b None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:16.353567 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21e37a-079a-46c4-8926-df32c0e7574b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:16.354106 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21e37a-079a-46c4-8926-df32c0e7574b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:16.359075 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-9a17da74-6e98-492e-97a4-590de67da73b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:16.359075 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:16.359075 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:16.359075 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:16.359075 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:16.359075 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:16.359075 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:16.359075 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:16.359075 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:16.359075 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:16.359075 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:16.359075 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:16.359075 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:16.359075 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:16.359075 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:16.359938 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:16.359938 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:16.359938 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:16.359938 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:16.359938 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:16.359938 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:16.359938 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:16.359938 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:16.359938 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:16.359938 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:16.359938 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:16.359938 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:16.359938 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:16.359938 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:16.359938 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:16.359938 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:16.359938 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:16.360800 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:16.360800 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:16.360800 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:16.360800 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:16.360800 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 230/468] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:16.361505 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a17da74-6e98-492e-97a4-590de67da73b None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:16.377802 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-9e21e37a-079a-46c4-8926-df32c0e7574b None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:16.379392 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9e21e37a-079a-46c4-8926-df32c0e7574b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:16.390160 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:16.460821 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 239/469] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:08:16.462117 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21e37a-079a-46c4-8926-df32c0e7574b None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:16.498784 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a17da74-6e98-492e-97a4-590de67da73b None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:16.529045 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:16.549943 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdfd7a0-29b2-4053-b744-e7a525a6ae6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:16.550776 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdfd7a0-29b2-4053-b744-e7a525a6ae6e None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:16.551432 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdfd7a0-29b2-4053-b744-e7a525a6ae6e None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:16.551820 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdfd7a0-29b2-4053-b744-e7a525a6ae6e None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:16.552654 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdfd7a0-29b2-4053-b744-e7a525a6ae6e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:16.555033 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdfd7a0-29b2-4053-b744-e7a525a6ae6e None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:16.574858 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21e37a-079a-46c4-8926-df32c0e7574b None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:16.584476 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 231/470] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Jun 29 12:08:16 2022] POST /identity/v3/users => generated 248 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:08:16.586189 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdfd7a0-29b2-4053-b744-e7a525a6ae6e None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:16.621443 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0782ce-c42f-4a53-98a1-b278256ea39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:16.622508 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0782ce-c42f-4a53-98a1-b278256ea39f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:16.622926 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0782ce-c42f-4a53-98a1-b278256ea39f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:16.623721 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0782ce-c42f-4a53-98a1-b278256ea39f None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:16.624760 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0782ce-c42f-4a53-98a1-b278256ea39f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:16.625230 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0782ce-c42f-4a53-98a1-b278256ea39f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:16.627036 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0782ce-c42f-4a53-98a1-b278256ea39f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:16.642959 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 240/471] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:16.651189 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0782ce-c42f-4a53-98a1-b278256ea39f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:16.655898 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:16.783810 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdfd7a0-29b2-4053-b744-e7a525a6ae6e None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:16.837993 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e0b76a-8720-47ca-982d-b7da70bc0caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:16.839181 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0b76a-8720-47ca-982d-b7da70bc0caf None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:16.839300 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0b76a-8720-47ca-982d-b7da70bc0caf None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:16.839518 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0b76a-8720-47ca-982d-b7da70bc0caf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:16.846278 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0782ce-c42f-4a53-98a1-b278256ea39f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:16.856868 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e0b76a-8720-47ca-982d-b7da70bc0caf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:16.858767 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e0b76a-8720-47ca-982d-b7da70bc0caf None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:16.885726 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-06e0b76a-8720-47ca-982d-b7da70bc0caf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:16.885726 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:16.885726 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:16.885726 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:16.885726 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:16.885726 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:16.885726 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:16.885726 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:16.885726 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:16.885726 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:16.885726 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:16.885726 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:16.885726 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:16.885726 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:16.885726 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:16.886676 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:16.886676 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:16.886676 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:16.886676 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:16.886676 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:16.886676 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:16.886676 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:16.886676 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:16.886676 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:16.886676 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:16.886676 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:16.886676 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:16.886676 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:16.886676 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:16.886676 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:16.886676 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:16.886676 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:16.887559 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:16.887559 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:16.887559 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:16.887559 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:16.887559 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 232/472] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:16.888370 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83a76f-3f39-4e8e-bef1-94e06ab902be None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:16.888569 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83a76f-3f39-4e8e-bef1-94e06ab902be None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:16.889409 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83a76f-3f39-4e8e-bef1-94e06ab902be None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:16.893456 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a1a84-6d49-48be-806d-19653cdd53ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:16.893832 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 233/473] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:08:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:16.894314 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a1a84-6d49-48be-806d-19653cdd53ea None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:16.894601 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a1a84-6d49-48be-806d-19653cdd53ea None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:16.894817 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd83a76f-3f39-4e8e-bef1-94e06ab902be None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:16.894929 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a1a84-6d49-48be-806d-19653cdd53ea None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:16.895634 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252a1a84-6d49-48be-806d-19653cdd53ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:16.897111 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252a1a84-6d49-48be-806d-19653cdd53ea None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:16.933187 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 241/474] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Jun 29 12:08:16 2022] POST /identity/v3/users => generated 248 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:08:16.934306 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:16.934527 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27e391-4b0c-4f31-9310-a604bde701ed None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:16.935483 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27e391-4b0c-4f31-9310-a604bde701ed None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:16.935764 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27e391-4b0c-4f31-9310-a604bde701ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:16.958398 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-1f27e391-4b0c-4f31-9310-a604bde701ed None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:16.960314 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1f27e391-4b0c-4f31-9310-a604bde701ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:17.029093 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd83a76f-3f39-4e8e-bef1-94e06ab902be None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:17.029919 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:17.073736 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 242/475] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:08:17.099435 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd54221-1266-43b4-b731-e9a32ab1f03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:17.100179 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd54221-1266-43b4-b731-e9a32ab1f03a None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:17.100609 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd54221-1266-43b4-b731-e9a32ab1f03a None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:17.100951 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd54221-1266-43b4-b731-e9a32ab1f03a None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:17.101943 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd54221-1266-43b4-b731-e9a32ab1f03a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:17.102298 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd54221-1266-43b4-b731-e9a32ab1f03a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:17.103876 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd54221-1266-43b4-b731-e9a32ab1f03a None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:17.123324 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 234/476] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:17.128411 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f27e391-4b0c-4f31-9310-a604bde701ed None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:17.138160 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd54221-1266-43b4-b731-e9a32ab1f03a None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:17.255908 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:17.259934 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f27e391-4b0c-4f31-9310-a604bde701ed None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:17.270156 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd54221-1266-43b4-b731-e9a32ab1f03a None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:17.297486 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec30e025-77fa-4d96-9502-221f06e83174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:17.298549 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30e025-77fa-4d96-9502-221f06e83174 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:17.299022 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30e025-77fa-4d96-9502-221f06e83174 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:17.299499 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30e025-77fa-4d96-9502-221f06e83174 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:17.301141 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec30e025-77fa-4d96-9502-221f06e83174 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:17.302776 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec30e025-77fa-4d96-9502-221f06e83174 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:17.309929 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.sql.core [None req-ec30e025-77fa-4d96-9502-221f06e83174 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 29 12:08:17.309929 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 29 12:08:17.309929 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [parameters: {'id': '766705a5eca64e4cbd87210a883065c2', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 29 12:08:17.309929 dv-cinder-797608-38-smb devstack@keystone.service[80135]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80135) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 29 12:08:17.313925 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614c53c-7ece-4729-92fd-86174e6b5283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:17.314699 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614c53c-7ece-4729-92fd-86174e6b5283 None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:17.315025 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614c53c-7ece-4729-92fd-86174e6b5283 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:17.315340 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614c53c-7ece-4729-92fd-86174e6b5283 None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:17.316100 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b614c53c-7ece-4729-92fd-86174e6b5283 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:17.317584 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b614c53c-7ece-4729-92fd-86174e6b5283 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:17.331714 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-ec30e025-77fa-4d96-9502-221f06e83174 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 29 12:08:17.331714 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:17.331714 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 29 12:08:17.331714 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 29 12:08:17.331714 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 29 12:08:17.331714 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 29 12:08:17.331714 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 29 12:08:17.331714 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application result = self._query(query) Jun 29 12:08:17.331714 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 29 12:08:17.331714 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application conn.query(q) Jun 29 12:08:17.331714 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 29 12:08:17.331714 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 29 12:08:17.331714 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 29 12:08:17.331714 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application result.read() Jun 29 12:08:17.331714 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 29 12:08:17.333402 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 29 12:08:17.333402 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 29 12:08:17.333402 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 29 12:08:17.333402 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 29 12:08:17.333402 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 29 12:08:17.333402 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 29 12:08:17.333402 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 29 12:08:17.333402 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 29 12:08:17.333402 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:17.333402 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 29 12:08:17.333402 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:17.333402 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:17.333402 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 29 12:08:17.333402 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 29 12:08:17.333402 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 29 12:08:17.333402 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return ref.to_dict() Jun 29 12:08:17.333402 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 29 12:08:17.333402 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application next(self.gen) Jun 29 12:08:17.334681 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 29 12:08:17.334681 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application yield resource Jun 29 12:08:17.334681 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 29 12:08:17.334681 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application next(self.gen) Jun 29 12:08:17.334681 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 29 12:08:17.334681 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self.session.rollback() Jun 29 12:08:17.334681 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 29 12:08:17.334681 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self.force_reraise() Jun 29 12:08:17.334681 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 29 12:08:17.334681 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise self.value Jun 29 12:08:17.334681 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 29 12:08:17.334681 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 29 12:08:17.334681 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 29 12:08:17.334681 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application session.commit() Jun 29 12:08:17.334681 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 29 12:08:17.334681 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 29 12:08:17.334681 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 29 12:08:17.335686 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._prepare_impl() Jun 29 12:08:17.335686 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 29 12:08:17.335686 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self.session.flush() Jun 29 12:08:17.335686 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 29 12:08:17.335686 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._flush(objects) Jun 29 12:08:17.335686 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 29 12:08:17.335686 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 29 12:08:17.335686 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 29 12:08:17.335686 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application compat.raise_( Jun 29 12:08:17.335686 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 29 12:08:17.335686 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception Jun 29 12:08:17.335686 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 29 12:08:17.335686 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application flush_context.execute() Jun 29 12:08:17.335686 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 29 12:08:17.335686 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rec.execute(self) Jun 29 12:08:17.335686 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 29 12:08:17.335686 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 29 12:08:17.336540 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 29 12:08:17.336540 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 29 12:08:17.336540 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 29 12:08:17.336540 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 29 12:08:17.336540 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 29 12:08:17.336540 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 29 12:08:17.336540 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jun 29 12:08:17.336540 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 29 12:08:17.336540 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 29 12:08:17.336540 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 29 12:08:17.336540 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 29 12:08:17.336540 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 29 12:08:17.336540 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 29 12:08:17.336540 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 29 12:08:17.336540 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 29 12:08:17.336540 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception Jun 29 12:08:17.338918 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 29 12:08:17.338918 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 29 12:08:17.338918 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 29 12:08:17.338918 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 29 12:08:17.338918 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 29 12:08:17.338918 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application result = self._query(query) Jun 29 12:08:17.338918 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 29 12:08:17.338918 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application conn.query(q) Jun 29 12:08:17.338918 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 29 12:08:17.338918 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 29 12:08:17.338918 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 29 12:08:17.338918 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application result.read() Jun 29 12:08:17.338918 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 29 12:08:17.338918 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 29 12:08:17.338918 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 29 12:08:17.338918 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 29 12:08:17.341036 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 29 12:08:17.341036 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 29 12:08:17.341036 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 29 12:08:17.341036 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 29 12:08:17.341036 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 29 12:08:17.341036 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 29 12:08:17.341036 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [parameters: {'id': '766705a5eca64e4cbd87210a883065c2', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 29 12:08:17.341036 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 29 12:08:17.341036 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:17.341036 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 12:08:17.341036 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:17.341036 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:17.341036 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:17.341036 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:17.341036 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:17.341036 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:17.343155 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:17.343155 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:17.343155 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:17.343155 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:17.343155 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:17.343155 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:17.343155 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 29 12:08:17.343155 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 29 12:08:17.343155 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:17.343155 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:17.343155 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 29 12:08:17.343155 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 29 12:08:17.343155 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 29 12:08:17.343155 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 29 12:08:17.343155 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 29 12:08:17.343155 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:17.347794 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 243/477] 10.222.0.27 () {60 vars in 1131 bytes} [Wed Jun 29 12:08:17 2022] POST /identity/v3/roles => generated 144 bytes in 211 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:17.347961 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 235/478] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Jun 29 12:08:17 2022] POST /identity/v3/users => generated 249 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:08:17.348460 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec30e025-77fa-4d96-9502-221f06e83174 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:17.410935 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:17.462649 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec30e025-77fa-4d96-9502-221f06e83174 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:17.500250 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f1be8-2ea5-48d3-9934-56e74c9ec1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:17.501130 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f1be8-2ea5-48d3-9934-56e74c9ec1c0 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:17.501418 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f1be8-2ea5-48d3-9934-56e74c9ec1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:17.501717 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f1be8-2ea5-48d3-9934-56e74c9ec1c0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:17.514200 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f1be8-2ea5-48d3-9934-56e74c9ec1c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:08:17.522744 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-d80f1be8-2ea5-48d3-9934-56e74c9ec1c0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 12:08:17.522744 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:17.522744 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:17.522744 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:17.522744 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:17.522744 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:17.522744 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:17.522744 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:17.522744 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:17.522744 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:17.522744 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:17.522744 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:17.522744 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:08:17.522744 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:08:17.522744 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:08:17.522744 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:08:17.524420 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:08:17.524420 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:08:17.524420 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:08:17.524420 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:08:17.524420 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:17.524420 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:17.524420 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:17.524420 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:17.524420 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:17.524420 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:17.524420 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:17.524420 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:17.524420 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:17.524420 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:17.524420 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:17.524420 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:17.525423 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:17.525423 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:17.525423 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:17.525423 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:17.525423 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:08:17.525423 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:08:17.525423 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:08:17.525423 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:08:17.525423 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:08:17.525423 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:08:17.525423 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 12:08:17.525423 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:17.525423 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 244/479] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jun 29 12:08:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:17.529982 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614c53c-7ece-4729-92fd-86174e6b5283 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:17.648395 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614c53c-7ece-4729-92fd-86174e6b5283 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:17.688742 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d009b-a2ec-496c-ac2a-374db016874e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:17.689718 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d009b-a2ec-496c-ac2a-374db016874e None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:17.690245 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d009b-a2ec-496c-ac2a-374db016874e None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:17.690716 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d009b-a2ec-496c-ac2a-374db016874e None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:17.691639 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25d009b-a2ec-496c-ac2a-374db016874e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:17.692204 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25d009b-a2ec-496c-ac2a-374db016874e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:17.693795 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25d009b-a2ec-496c-ac2a-374db016874e None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:17.703538 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 236/480] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jun 29 12:08:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:18.792652 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d947f-d4fe-406c-82f2-da0d56303fb1 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:18.793505 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d947f-d4fe-406c-82f2-da0d56303fb1 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:18.793940 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d947f-d4fe-406c-82f2-da0d56303fb1 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:18.795672 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 245/481] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:08:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:18.801146 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220c233-d398-4905-89c3-5b494d08efcd None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:18.801933 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220c233-d398-4905-89c3-5b494d08efcd None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:18.802353 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220c233-d398-4905-89c3-5b494d08efcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:18.818964 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:18.830396 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-5220c233-d398-4905-89c3-5b494d08efcd None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:18.831769 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-5220c233-d398-4905-89c3-5b494d08efcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:18.921532 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 237/482] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:08:18.947643 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382d947f-d4fe-406c-82f2-da0d56303fb1 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:19.087358 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382d947f-d4fe-406c-82f2-da0d56303fb1 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:19.102092 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:19.127838 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4057189-d8ca-47ec-b001-e9d86955cb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:19.128656 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4057189-d8ca-47ec-b001-e9d86955cb3c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:19.128926 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4057189-d8ca-47ec-b001-e9d86955cb3c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:19.129211 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4057189-d8ca-47ec-b001-e9d86955cb3c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:19.146614 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4057189-d8ca-47ec-b001-e9d86955cb3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:08:19.155018 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-e4057189-d8ca-47ec-b001-e9d86955cb3c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:08:19.155018 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:19.155018 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:19.155018 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:19.155018 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:19.155018 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:19.155018 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:19.155018 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:19.155018 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:19.155018 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:19.155018 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:19.155018 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:19.155018 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:08:19.155018 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:08:19.155018 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:08:19.155018 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:08:19.155987 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:08:19.155987 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:08:19.155987 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:08:19.155987 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:08:19.155987 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:19.155987 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:19.155987 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:19.155987 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:19.155987 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:19.155987 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:19.155987 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:19.155987 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:19.155987 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:19.155987 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:19.155987 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:19.155987 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:19.156799 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:19.156799 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:19.156799 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:19.156799 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:19.156799 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:08:19.156799 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:08:19.156799 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:08:19.156799 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:08:19.156799 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:08:19.156799 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:08:19.156799 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:08:19.156799 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:19.156799 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 246/483] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jun 29 12:08:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:19.164673 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5220c233-d398-4905-89c3-5b494d08efcd None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:19.300380 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5870c89-de30-48a1-8bd9-9cc9c391ff39 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:19.300800 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5870c89-de30-48a1-8bd9-9cc9c391ff39 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:19.300994 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5870c89-de30-48a1-8bd9-9cc9c391ff39 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:19.305745 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 247/484] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:08:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:19.308118 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b3aa6-cd86-409e-8734-345dce47134f None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:19.308408 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b3aa6-cd86-409e-8734-345dce47134f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:19.308691 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b3aa6-cd86-409e-8734-345dce47134f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:19.341781 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5220c233-d398-4905-89c3-5b494d08efcd None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:19.344084 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-591b3aa6-cd86-409e-8734-345dce47134f None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:19.346157 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-591b3aa6-cd86-409e-8734-345dce47134f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:19.408430 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0171c-e88c-4227-8ff6-fec0fce38a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:19.409511 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0171c-e88c-4227-8ff6-fec0fce38a01 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:19.410066 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0171c-e88c-4227-8ff6-fec0fce38a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:19.410560 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0171c-e88c-4227-8ff6-fec0fce38a01 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:19.411555 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b0171c-e88c-4227-8ff6-fec0fce38a01 None admin] RBAC: Adding query filter params (name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:19.412081 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b0171c-e88c-4227-8ff6-fec0fce38a01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:19.414426 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b0171c-e88c-4227-8ff6-fec0fce38a01 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:19.417174 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:19.436027 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 238/485] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jun 29 12:08:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:19.439379 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0171c-e88c-4227-8ff6-fec0fce38a01 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:19.485411 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 248/486] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 12:08:19.555882 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b3aa6-cd86-409e-8734-345dce47134f None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:19.588963 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0171c-e88c-4227-8ff6-fec0fce38a01 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:19.630789 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d79e0-7d19-473e-a9b1-4d50a72bf9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:19.631679 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d79e0-7d19-473e-a9b1-4d50a72bf9ff None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:19.632143 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d79e0-7d19-473e-a9b1-4d50a72bf9ff None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:19.632334 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d79e0-7d19-473e-a9b1-4d50a72bf9ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:19.654190 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7d79e0-7d19-473e-a9b1-4d50a72bf9ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:19.655705 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7d79e0-7d19-473e-a9b1-4d50a72bf9ff None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:19.689453 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-bc7d79e0-7d19-473e-a9b1-4d50a72bf9ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:19.689453 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:19.689453 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:19.689453 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:19.689453 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:19.689453 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:19.689453 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:19.689453 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:19.689453 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:19.689453 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:19.689453 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:19.689453 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:19.689453 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:19.689453 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:19.689453 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:19.690439 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:19.690439 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:19.690439 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:19.690439 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:19.690439 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:19.690439 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:19.690439 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:19.690439 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:19.690439 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:19.690439 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:19.690439 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:19.690439 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:19.690439 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:19.690439 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:19.690439 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:19.690439 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:19.690439 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:19.691324 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:19.691324 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:19.691324 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:19.691324 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:19.691324 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 239/487] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:19.706331 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d79e0-7d19-473e-a9b1-4d50a72bf9ff None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:19.755523 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b3aa6-cd86-409e-8734-345dce47134f None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:19.757234 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:19.804481 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:19.840536 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1029dd-df52-4d2a-9d0b-58854e7eb6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:19.841349 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1029dd-df52-4d2a-9d0b-58854e7eb6b3 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:19.841623 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1029dd-df52-4d2a-9d0b-58854e7eb6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:19.842002 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1029dd-df52-4d2a-9d0b-58854e7eb6b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:19.859432 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1029dd-df52-4d2a-9d0b-58854e7eb6b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:08:19.870233 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-3d1029dd-df52-4d2a-9d0b-58854e7eb6b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:08:19.870233 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:19.870233 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:19.870233 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:19.870233 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:19.870233 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:19.870233 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:19.870233 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:19.870233 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:19.870233 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:19.870233 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:19.870233 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:19.870233 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:08:19.870233 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:08:19.870233 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:08:19.870233 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:08:19.871183 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:08:19.871183 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:08:19.871183 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:08:19.871183 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:08:19.871183 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:19.871183 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:19.871183 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:19.871183 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:19.871183 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:19.871183 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:19.871183 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:19.871183 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:19.871183 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:19.871183 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:19.871183 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:19.871183 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:19.872333 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:19.872333 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:19.872333 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:19.872333 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:19.872333 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:08:19.872333 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:08:19.872333 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:08:19.872333 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:08:19.872333 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:08:19.872333 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:08:19.872333 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:08:19.872333 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:19.873135 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d79e0-7d19-473e-a9b1-4d50a72bf9ff None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:19.873209 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 249/488] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jun 29 12:08:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:19.873209 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c45cc-5648-4534-8fff-4283e85dbe91 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:19.873328 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c45cc-5648-4534-8fff-4283e85dbe91 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:19.875081 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c45cc-5648-4534-8fff-4283e85dbe91 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:19.875081 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 250/489] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:08:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:19.877147 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c45cc-5648-4534-8fff-4283e85dbe91 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:19.918952 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8b13f-c0c1-48a6-9340-81a54fd5a82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:19.919779 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8b13f-c0c1-48a6-9340-81a54fd5a82a None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:19.920123 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8b13f-c0c1-48a6-9340-81a54fd5a82a None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:19.920482 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8b13f-c0c1-48a6-9340-81a54fd5a82a None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:19.921277 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf8b13f-c0c1-48a6-9340-81a54fd5a82a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:19.921645 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf8b13f-c0c1-48a6-9340-81a54fd5a82a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:19.923400 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf8b13f-c0c1-48a6-9340-81a54fd5a82a None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:19.939738 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 240/490] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:08:19.941129 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f9cf9-c202-4a3e-a62c-b016434f6b31 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:19.941531 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f9cf9-c202-4a3e-a62c-b016434f6b31 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:19.941929 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f9cf9-c202-4a3e-a62c-b016434f6b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:19.959660 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-e52f9cf9-c202-4a3e-a62c-b016434f6b31 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:19.961130 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e52f9cf9-c202-4a3e-a62c-b016434f6b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:20.003951 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c45cc-5648-4534-8fff-4283e85dbe91 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:20.038574 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 241/491] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:08:20.041333 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f9cf9-c202-4a3e-a62c-b016434f6b31 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:20.046198 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377c6c86-37fc-4d9d-ae3c-2c0e51c32240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:20.051307 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c6c86-37fc-4d9d-ae3c-2c0e51c32240 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:20.051669 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c6c86-37fc-4d9d-ae3c-2c0e51c32240 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:20.052348 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c6c86-37fc-4d9d-ae3c-2c0e51c32240 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:20.053068 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377c6c86-37fc-4d9d-ae3c-2c0e51c32240 None admin] RBAC: Adding query filter params (name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:20.053387 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377c6c86-37fc-4d9d-ae3c-2c0e51c32240 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:20.055077 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377c6c86-37fc-4d9d-ae3c-2c0e51c32240 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:20.063789 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 251/492] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jun 29 12:08:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:08:20.065046 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00d83d-df65-42f5-8c2a-e95ad027abbf None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:20.065339 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00d83d-df65-42f5-8c2a-e95ad027abbf None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:20.065615 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00d83d-df65-42f5-8c2a-e95ad027abbf None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:20.066881 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 252/493] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:08:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:20.071291 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c00d83d-df65-42f5-8c2a-e95ad027abbf None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:20.095932 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:20.096413 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:20.157152 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f9cf9-c202-4a3e-a62c-b016434f6b31 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:20.177661 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c00d83d-df65-42f5-8c2a-e95ad027abbf None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:20.192361 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e185db-8f36-4bf7-af2f-634ec80c526b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:20.193169 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e185db-8f36-4bf7-af2f-634ec80c526b None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:20.193454 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e185db-8f36-4bf7-af2f-634ec80c526b None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:20.193756 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e185db-8f36-4bf7-af2f-634ec80c526b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:20.202018 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e185db-8f36-4bf7-af2f-634ec80c526b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:20.203506 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e185db-8f36-4bf7-af2f-634ec80c526b None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:20.213514 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fea987-fe6e-4a98-9fdc-51fe33a27f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:20.214358 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fea987-fe6e-4a98-9fdc-51fe33a27f77 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:20.214640 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fea987-fe6e-4a98-9fdc-51fe33a27f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:20.214917 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fea987-fe6e-4a98-9fdc-51fe33a27f77 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:20.220176 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-41e185db-8f36-4bf7-af2f-634ec80c526b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 12:08:20.220176 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:20.220176 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:20.220176 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:20.220176 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:20.220176 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:20.220176 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:20.220176 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:20.220176 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:20.220176 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:20.220176 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:20.220176 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:20.220176 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:08:20.220176 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:08:20.220176 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:08:20.220176 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:08:20.221101 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:20.221101 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:20.221101 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:08:20.221101 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:20.221101 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:08:20.221101 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:20.221101 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:20.221101 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:20.221101 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:20.221101 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:20.221101 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:20.221101 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:20.221101 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:20.221101 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:20.221101 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:20.221101 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:20.221101 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:20.221101 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:20.222161 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:20.222161 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:20.222161 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:08:20.222161 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:08:20.222161 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:08:20.222161 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:08:20.222161 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:08:20.222161 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:08:20.222161 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 12:08:20.222161 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:20.222161 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 242/494] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Jun 29 12:08:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:20.222161 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e185db-8f36-4bf7-af2f-634ec80c526b None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:20.228722 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fea987-fe6e-4a98-9fdc-51fe33a27f77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:08:20.236487 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-92fea987-fe6e-4a98-9fdc-51fe33a27f77 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:08:20.236487 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:20.236487 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:20.236487 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:20.236487 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:20.236487 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:20.236487 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:20.236487 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:20.236487 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:20.236487 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:20.236487 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:20.236487 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:20.236487 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:08:20.236487 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:08:20.236487 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:08:20.236487 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:08:20.237461 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:08:20.237461 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:08:20.237461 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:08:20.237461 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:08:20.237461 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:20.237461 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:20.237461 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:20.237461 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:20.237461 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:20.237461 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:20.237461 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:20.237461 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:20.237461 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:20.237461 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:20.237461 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:20.237461 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:20.238315 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:20.238315 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:20.238315 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:20.238315 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:20.238315 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:08:20.238315 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:08:20.238315 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:08:20.238315 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:08:20.238315 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:08:20.238315 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:08:20.238315 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:08:20.238315 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:20.238315 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 253/495] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jun 29 12:08:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:20.238984 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ceebd-7db2-4e17-a3bc-02732b5e031b None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:20.239267 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ceebd-7db2-4e17-a3bc-02732b5e031b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:20.239267 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ceebd-7db2-4e17-a3bc-02732b5e031b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:20.255807 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-052ceebd-7db2-4e17-a3bc-02732b5e031b None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:20.257185 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-052ceebd-7db2-4e17-a3bc-02732b5e031b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:20.323291 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 254/496] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:08:20.324592 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae8c10-c6b9-470a-9d66-fd04db0114f7 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:20.324868 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae8c10-c6b9-470a-9d66-fd04db0114f7 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:20.325135 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae8c10-c6b9-470a-9d66-fd04db0114f7 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:20.326423 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 255/497] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:08:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:20.327468 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae8c10-c6b9-470a-9d66-fd04db0114f7 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:20.333791 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:20.337748 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e185db-8f36-4bf7-af2f-634ec80c526b None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:20.351740 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:20.373455 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5173f8-58aa-4edf-a938-6c227bcb9eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:20.374286 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5173f8-58aa-4edf-a938-6c227bcb9eb8 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:20.374567 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5173f8-58aa-4edf-a938-6c227bcb9eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:20.374836 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5173f8-58aa-4edf-a938-6c227bcb9eb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:20.386086 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5173f8-58aa-4edf-a938-6c227bcb9eb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:20.387578 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5173f8-58aa-4edf-a938-6c227bcb9eb8 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:20.405839 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-9b5173f8-58aa-4edf-a938-6c227bcb9eb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:20.405839 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:20.405839 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:20.405839 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:20.405839 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:20.405839 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:20.405839 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:20.405839 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:20.405839 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:20.405839 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:20.405839 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:20.405839 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:20.405839 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:20.405839 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:20.405839 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:20.406873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:20.406873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:20.406873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:20.406873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:20.406873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:20.406873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:20.406873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:20.406873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:20.406873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:20.406873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:20.406873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:20.406873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:20.406873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:20.406873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:20.406873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:20.406873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:20.406873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:20.407774 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:20.407774 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:20.407774 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:20.407774 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:20.407774 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 243/498] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:20.407774 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5173f8-58aa-4edf-a938-6c227bcb9eb8 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:20.442729 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae8c10-c6b9-470a-9d66-fd04db0114f7 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:20.478574 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d669eef9-c9ea-4ffe-ac4c-c0090270caad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:20.479271 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669eef9-c9ea-4ffe-ac4c-c0090270caad None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:20.479556 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669eef9-c9ea-4ffe-ac4c-c0090270caad None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:20.479832 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669eef9-c9ea-4ffe-ac4c-c0090270caad None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:20.480681 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d669eef9-c9ea-4ffe-ac4c-c0090270caad None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:20.480992 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d669eef9-c9ea-4ffe-ac4c-c0090270caad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:20.482472 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d669eef9-c9ea-4ffe-ac4c-c0090270caad None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:20.509525 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5173f8-58aa-4edf-a938-6c227bcb9eb8 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:20.519711 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 256/499] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Jun 29 12:08:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:20.521491 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee668d4-40f9-4887-8a99-4e6920c8fd48 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:20.521805 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee668d4-40f9-4887-8a99-4e6920c8fd48 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:20.522085 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee668d4-40f9-4887-8a99-4e6920c8fd48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:20.539455 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-0ee668d4-40f9-4887-8a99-4e6920c8fd48 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:20.540686 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0ee668d4-40f9-4887-8a99-4e6920c8fd48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:20.544365 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e254e-65da-4594-bb93-bc880d917805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:20.545046 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e254e-65da-4594-bb93-bc880d917805 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:20.545329 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e254e-65da-4594-bb93-bc880d917805 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:20.545604 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e254e-65da-4594-bb93-bc880d917805 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:20.546398 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02e254e-65da-4594-bb93-bc880d917805 None admin] RBAC: Adding query filter params (name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:20.546702 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02e254e-65da-4594-bb93-bc880d917805 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:20.548085 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02e254e-65da-4594-bb93-bc880d917805 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:20.556639 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 244/500] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jun 29 12:08:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:20.557437 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e254e-65da-4594-bb93-bc880d917805 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:20.573297 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:20.613197 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 257/501] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:08:20.614007 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee668d4-40f9-4887-8a99-4e6920c8fd48 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:20.616475 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:20.668552 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e254e-65da-4594-bb93-bc880d917805 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:20.703190 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e216481-6e4f-41c4-af71-26b867d02326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:20.703979 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e216481-6e4f-41c4-af71-26b867d02326 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:20.704257 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e216481-6e4f-41c4-af71-26b867d02326 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:20.704523 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e216481-6e4f-41c4-af71-26b867d02326 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:20.714471 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e216481-6e4f-41c4-af71-26b867d02326 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:08:20.715011 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee668d4-40f9-4887-8a99-4e6920c8fd48 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:20.722054 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-5e216481-6e4f-41c4-af71-26b867d02326 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:08:20.722054 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:20.722054 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:20.722054 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:20.722054 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:20.722054 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:20.722054 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:20.722054 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:20.722054 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:20.722054 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:20.722054 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:20.722054 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:20.722054 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:08:20.722054 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:08:20.722054 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:08:20.722054 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:08:20.723044 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:08:20.723044 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:08:20.723044 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:08:20.723044 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:08:20.723044 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:20.723044 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:20.723044 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:20.723044 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:20.723044 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:20.723044 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:20.723044 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:20.723044 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:20.723044 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:20.723044 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:20.723044 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:20.723044 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:20.723885 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:20.723885 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:20.723885 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:20.723885 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:20.723885 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:08:20.723885 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:08:20.723885 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:08:20.723885 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:08:20.723885 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:08:20.723885 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:08:20.723885 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:08:20.723885 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:20.723885 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 245/502] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jun 29 12:08:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:20.724554 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e216481-6e4f-41c4-af71-26b867d02326 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:20.754000 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c3a92-126c-40ec-a277-502c0684f41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:20.754656 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c3a92-126c-40ec-a277-502c0684f41d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:20.754936 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c3a92-126c-40ec-a277-502c0684f41d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:20.755212 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c3a92-126c-40ec-a277-502c0684f41d None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:20.755937 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06c3a92-126c-40ec-a277-502c0684f41d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:20.756242 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06c3a92-126c-40ec-a277-502c0684f41d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:20.758485 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06c3a92-126c-40ec-a277-502c0684f41d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:20.769092 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 258/503] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:20.769938 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c3a92-126c-40ec-a277-502c0684f41d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:20.806729 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:20.831567 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:20.832356 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e216481-6e4f-41c4-af71-26b867d02326 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:20.866293 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d26f90a-bd18-4497-89ff-5322df489bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:20.866838 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26f90a-bd18-4497-89ff-5322df489bad None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:20.867111 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26f90a-bd18-4497-89ff-5322df489bad None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:20.867389 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26f90a-bd18-4497-89ff-5322df489bad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:20.872491 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c3a92-126c-40ec-a277-502c0684f41d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:20.908595 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675a06f-0ab1-4f55-bad8-0d5c95003f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:20.909391 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675a06f-0ab1-4f55-bad8-0d5c95003f42 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:20.909673 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675a06f-0ab1-4f55-bad8-0d5c95003f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:20.910183 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675a06f-0ab1-4f55-bad8-0d5c95003f42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:20.920808 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e675a06f-0ab1-4f55-bad8-0d5c95003f42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:20.922341 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e675a06f-0ab1-4f55-bad8-0d5c95003f42 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:20.935245 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d26f90a-bd18-4497-89ff-5322df489bad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:20.936731 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d26f90a-bd18-4497-89ff-5322df489bad None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:20.939230 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-e675a06f-0ab1-4f55-bad8-0d5c95003f42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:20.939230 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:20.939230 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:20.939230 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:20.939230 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:20.939230 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:20.939230 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:20.939230 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:20.939230 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:20.939230 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:20.939230 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:20.939230 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:20.939230 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:20.939230 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:20.939230 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:20.940200 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:20.940200 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:20.940200 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:20.940200 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:20.940200 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:20.940200 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:20.940200 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:20.940200 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:20.940200 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:20.940200 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:20.940200 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:20.940200 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:20.940200 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:20.940200 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:20.940200 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:20.940200 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:20.940200 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:20.942082 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:20.942082 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:20.942082 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:20.942082 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:20.942082 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 259/504] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:20.942082 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675a06f-0ab1-4f55-bad8-0d5c95003f42 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:21.011996 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:21.037927 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 246/505] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:08:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:08:21.039348 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d26f90a-bd18-4497-89ff-5322df489bad None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:21.044118 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675a06f-0ab1-4f55-bad8-0d5c95003f42 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:21.058423 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:21.079404 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d6ae3-b956-4cc7-ba84-f7e78179347f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:21.080193 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d6ae3-b956-4cc7-ba84-f7e78179347f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:21.080508 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d6ae3-b956-4cc7-ba84-f7e78179347f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:21.080782 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d6ae3-b956-4cc7-ba84-f7e78179347f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:21.091584 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45d6ae3-b956-4cc7-ba84-f7e78179347f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:21.093068 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45d6ae3-b956-4cc7-ba84-f7e78179347f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:21.109867 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-d45d6ae3-b956-4cc7-ba84-f7e78179347f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:21.109867 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:21.109867 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:21.109867 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:21.109867 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:21.109867 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:21.109867 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:21.109867 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:21.109867 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:21.109867 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:21.109867 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:21.109867 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:21.109867 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:21.109867 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:21.109867 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:21.110727 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:21.110727 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:21.110727 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:21.110727 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:21.110727 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:21.110727 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:21.110727 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:21.110727 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:21.110727 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:21.110727 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:21.110727 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:21.110727 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:21.110727 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:21.110727 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:21.110727 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:21.110727 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:21.110727 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:21.111595 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:21.111595 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:21.111595 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:21.111595 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:21.111595 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 260/506] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:21.112278 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d6ae3-b956-4cc7-ba84-f7e78179347f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:21.141384 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d26f90a-bd18-4497-89ff-5322df489bad None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:21.176846 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00470ab2-ff6e-4c0b-a630-ecde5039244e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:21.177504 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00470ab2-ff6e-4c0b-a630-ecde5039244e None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:21.177815 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00470ab2-ff6e-4c0b-a630-ecde5039244e None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:21.178092 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00470ab2-ff6e-4c0b-a630-ecde5039244e None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:21.179009 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00470ab2-ff6e-4c0b-a630-ecde5039244e None admin] RBAC: Adding query filter params (name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:21.179324 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00470ab2-ff6e-4c0b-a630-ecde5039244e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:21.180715 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00470ab2-ff6e-4c0b-a630-ecde5039244e None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:21.188937 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 247/507] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jun 29 12:08:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:21.189777 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00470ab2-ff6e-4c0b-a630-ecde5039244e None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:21.212538 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d6ae3-b956-4cc7-ba84-f7e78179347f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:21.228894 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:21.247139 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef8652-6df9-491a-b243-94964aa2c4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:21.247940 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef8652-6df9-491a-b243-94964aa2c4d2 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:21.248220 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef8652-6df9-491a-b243-94964aa2c4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:21.248493 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef8652-6df9-491a-b243-94964aa2c4d2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:21.255627 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ef8652-6df9-491a-b243-94964aa2c4d2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:21.257094 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ef8652-6df9-491a-b243-94964aa2c4d2 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:21.272865 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-f3ef8652-6df9-491a-b243-94964aa2c4d2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 29 12:08:21.272865 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:21.272865 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:21.272865 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:21.272865 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:21.272865 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:21.272865 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:21.272865 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:21.272865 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:21.272865 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:21.272865 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:21.272865 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:21.272865 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:08:21.272865 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:08:21.272865 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:08:21.272865 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:08:21.273852 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:21.273852 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:21.273852 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:08:21.273852 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:21.273852 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:08:21.273852 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:21.273852 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:21.273852 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:21.273852 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:21.273852 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:21.273852 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:21.273852 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:21.273852 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:21.273852 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:21.273852 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:21.273852 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:21.273852 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:21.273852 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:21.274781 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:21.274781 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:21.274781 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:08:21.274781 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:08:21.274781 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:08:21.274781 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:08:21.274781 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:08:21.274781 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:08:21.274781 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 29 12:08:21.274781 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:21.274781 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 261/508] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:08:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:21.275358 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef8652-6df9-491a-b243-94964aa2c4d2 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:21.298443 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00470ab2-ff6e-4c0b-a630-ecde5039244e None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:21.304076 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:21.334255 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7383c8-6dc4-41f2-9e5e-2cd548272e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:21.334937 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7383c8-6dc4-41f2-9e5e-2cd548272e94 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:21.335197 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7383c8-6dc4-41f2-9e5e-2cd548272e94 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:21.335475 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7383c8-6dc4-41f2-9e5e-2cd548272e94 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:21.336208 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7383c8-6dc4-41f2-9e5e-2cd548272e94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:21.336519 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7383c8-6dc4-41f2-9e5e-2cd548272e94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:21.337937 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7383c8-6dc4-41f2-9e5e-2cd548272e94 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:21.350006 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 248/509] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:21.350849 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7383c8-6dc4-41f2-9e5e-2cd548272e94 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:21.379135 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef8652-6df9-491a-b243-94964aa2c4d2 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:21.413676 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3cd1e-886f-43ed-8030-2a86c76afb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:21.414435 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3cd1e-886f-43ed-8030-2a86c76afb67 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:21.414719 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3cd1e-886f-43ed-8030-2a86c76afb67 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:21.414997 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3cd1e-886f-43ed-8030-2a86c76afb67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:21.425435 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc3cd1e-886f-43ed-8030-2a86c76afb67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:21.426938 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc3cd1e-886f-43ed-8030-2a86c76afb67 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:21.442457 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:21.443689 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-2dc3cd1e-886f-43ed-8030-2a86c76afb67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:21.443689 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:21.443689 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:21.443689 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:21.443689 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:21.443689 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:21.443689 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:21.443689 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:21.443689 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:21.443689 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:21.443689 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:21.443689 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:21.443689 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:21.443689 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:21.443689 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:21.444634 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:21.444634 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:21.444634 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:21.444634 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:21.444634 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:21.444634 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:21.444634 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:21.444634 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:21.444634 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:21.444634 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:21.444634 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:21.444634 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:21.444634 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:21.444634 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:21.444634 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:21.444634 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:21.444634 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:21.445601 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:21.445601 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:21.445601 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:21.445601 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:21.445601 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 262/510] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:21.446329 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3cd1e-886f-43ed-8030-2a86c76afb67 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:21.451051 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7383c8-6dc4-41f2-9e5e-2cd548272e94 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:21.486927 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8eb673-6e34-4aaf-91be-b2605b0c99de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:21.487594 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8eb673-6e34-4aaf-91be-b2605b0c99de None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:21.487899 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8eb673-6e34-4aaf-91be-b2605b0c99de None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:21.488176 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8eb673-6e34-4aaf-91be-b2605b0c99de None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:21.488906 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8eb673-6e34-4aaf-91be-b2605b0c99de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:21.489232 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8eb673-6e34-4aaf-91be-b2605b0c99de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:21.490643 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8eb673-6e34-4aaf-91be-b2605b0c99de None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:21.501956 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 249/511] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:21.502766 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8eb673-6e34-4aaf-91be-b2605b0c99de None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:21.526180 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:21.548120 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3cd1e-886f-43ed-8030-2a86c76afb67 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:21.581704 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b99b5-b79d-438d-a9bc-3ab0de23d951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:21.582518 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b99b5-b79d-438d-a9bc-3ab0de23d951 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:21.582789 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b99b5-b79d-438d-a9bc-3ab0de23d951 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:21.583062 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b99b5-b79d-438d-a9bc-3ab0de23d951 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:21.593577 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023b99b5-b79d-438d-a9bc-3ab0de23d951 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:21.595075 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023b99b5-b79d-438d-a9bc-3ab0de23d951 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:21.605402 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8eb673-6e34-4aaf-91be-b2605b0c99de None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:21.613197 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-023b99b5-b79d-438d-a9bc-3ab0de23d951 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:21.613197 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:21.613197 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:21.613197 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:21.613197 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:21.613197 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:21.613197 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:21.613197 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:21.613197 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:21.613197 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:21.613197 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:21.613197 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:21.613197 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:21.613197 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:21.613197 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:21.614228 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:21.614228 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:21.614228 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:21.614228 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:21.614228 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:21.614228 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:21.614228 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:21.614228 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:21.614228 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:21.614228 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:21.614228 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:21.614228 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:21.614228 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:21.614228 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:21.614228 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:21.614228 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:21.614228 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:21.615430 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:21.615430 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:21.615430 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:21.615430 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:21.615430 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 263/512] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:21.615430 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b99b5-b79d-438d-a9bc-3ab0de23d951 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:21.639843 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67974bb-d3bd-4b8f-9dfc-15470a58b568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:21.640520 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67974bb-d3bd-4b8f-9dfc-15470a58b568 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:21.640804 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67974bb-d3bd-4b8f-9dfc-15470a58b568 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:21.641086 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67974bb-d3bd-4b8f-9dfc-15470a58b568 None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:21.641958 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67974bb-d3bd-4b8f-9dfc-15470a58b568 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:21.642271 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67974bb-d3bd-4b8f-9dfc-15470a58b568 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:21.643740 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67974bb-d3bd-4b8f-9dfc-15470a58b568 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:21.682267 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 250/513] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Jun 29 12:08:21 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:21.683031 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67974bb-d3bd-4b8f-9dfc-15470a58b568 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:21.699654 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:21.718246 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b99b5-b79d-438d-a9bc-3ab0de23d951 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:21.746386 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:21.752870 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0de912-1846-4113-93a4-750a2a5ea047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:21.753677 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0de912-1846-4113-93a4-750a2a5ea047 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:21.753988 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0de912-1846-4113-93a4-750a2a5ea047 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:21.754252 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0de912-1846-4113-93a4-750a2a5ea047 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:21.762261 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0de912-1846-4113-93a4-750a2a5ea047 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:21.763722 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0de912-1846-4113-93a4-750a2a5ea047 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:21.777851 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-0b0de912-1846-4113-93a4-750a2a5ea047 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 12:08:21.777851 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:21.777851 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:21.777851 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:21.777851 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:21.777851 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:21.777851 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:21.777851 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:21.777851 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:21.777851 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:21.777851 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:21.777851 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:21.777851 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:08:21.777851 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:08:21.777851 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:08:21.777851 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:08:21.778963 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:21.778963 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:21.778963 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:08:21.778963 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:21.778963 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:08:21.778963 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:21.778963 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:21.778963 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:21.778963 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:21.778963 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:21.778963 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:21.778963 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:21.778963 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:21.778963 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:21.778963 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:21.778963 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:21.778963 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:21.778963 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:21.780074 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:21.780074 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:21.780074 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:08:21.780074 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:08:21.780074 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:08:21.780074 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:08:21.780074 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:08:21.780074 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:08:21.780074 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 12:08:21.780074 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:21.780074 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 264/514] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:08:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:21.780074 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0de912-1846-4113-93a4-750a2a5ea047 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:21.787210 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67974bb-d3bd-4b8f-9dfc-15470a58b568 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:21.821071 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f326f15d-0151-49c0-b6a4-3974289d521f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:21.821755 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326f15d-0151-49c0-b6a4-3974289d521f None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:21.822047 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326f15d-0151-49c0-b6a4-3974289d521f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:21.822318 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326f15d-0151-49c0-b6a4-3974289d521f None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:21.823041 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f326f15d-0151-49c0-b6a4-3974289d521f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:21.823339 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f326f15d-0151-49c0-b6a4-3974289d521f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:21.824730 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f326f15d-0151-49c0-b6a4-3974289d521f None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:21.836379 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 251/515] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:21.837164 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f326f15d-0151-49c0-b6a4-3974289d521f None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:21.884968 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0de912-1846-4113-93a4-750a2a5ea047 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:21.913470 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:21.917993 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e9740-0667-4f3c-b2e7-a237675bb2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:21.918663 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e9740-0667-4f3c-b2e7-a237675bb2a6 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:21.918945 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e9740-0667-4f3c-b2e7-a237675bb2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:21.919218 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e9740-0667-4f3c-b2e7-a237675bb2a6 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:21.919926 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951e9740-0667-4f3c-b2e7-a237675bb2a6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:21.921393 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951e9740-0667-4f3c-b2e7-a237675bb2a6 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:21.939222 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f326f15d-0151-49c0-b6a4-3974289d521f None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:21.942060 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 265/516] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Jun 29 12:08:21 2022] POST /identity/v3/users => generated 247 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:08:21.942654 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e9740-0667-4f3c-b2e7-a237675bb2a6 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:21.993452 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac2b74-a608-4ec7-80da-744b3050c949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:21.994181 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac2b74-a608-4ec7-80da-744b3050c949 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:21.994469 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac2b74-a608-4ec7-80da-744b3050c949 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:21.994749 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac2b74-a608-4ec7-80da-744b3050c949 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:21.995503 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ac2b74-a608-4ec7-80da-744b3050c949 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:21.995813 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ac2b74-a608-4ec7-80da-744b3050c949 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:21.996967 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:21.997282 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ac2b74-a608-4ec7-80da-744b3050c949 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:22.011808 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 252/517] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:22.012692 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac2b74-a608-4ec7-80da-744b3050c949 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:22.069572 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e9740-0667-4f3c-b2e7-a237675bb2a6 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:22.112415 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708d9823-58c6-4753-a0a2-4cf069dbc16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:22.113076 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d9823-58c6-4753-a0a2-4cf069dbc16c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:22.113366 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d9823-58c6-4753-a0a2-4cf069dbc16c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:22.113645 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d9823-58c6-4753-a0a2-4cf069dbc16c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:22.140376 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac2b74-a608-4ec7-80da-744b3050c949 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:22.182140 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61656a1b-d8aa-4fe6-93c5-269709ea148f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:22.183088 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61656a1b-d8aa-4fe6-93c5-269709ea148f None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:22.183655 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61656a1b-d8aa-4fe6-93c5-269709ea148f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:22.184079 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61656a1b-d8aa-4fe6-93c5-269709ea148f None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:22.185561 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61656a1b-d8aa-4fe6-93c5-269709ea148f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:22.186262 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61656a1b-d8aa-4fe6-93c5-269709ea148f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:22.186736 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708d9823-58c6-4753-a0a2-4cf069dbc16c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:22.188076 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61656a1b-d8aa-4fe6-93c5-269709ea148f None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:22.188201 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708d9823-58c6-4753-a0a2-4cf069dbc16c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:22.190228 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:22.215630 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 253/518] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Jun 29 12:08:22 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:22.215630 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61656a1b-d8aa-4fe6-93c5-269709ea148f None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:22.237840 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:22.301568 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 266/519] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:08:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:08:22.301568 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708d9823-58c6-4753-a0a2-4cf069dbc16c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:22.328856 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61656a1b-d8aa-4fe6-93c5-269709ea148f None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:22.364859 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a28d6-1bdb-49d1-8e1e-52476b6fdbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:22.365657 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a28d6-1bdb-49d1-8e1e-52476b6fdbd1 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:22.365965 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a28d6-1bdb-49d1-8e1e-52476b6fdbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:22.366280 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a28d6-1bdb-49d1-8e1e-52476b6fdbd1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:22.373343 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11a28d6-1bdb-49d1-8e1e-52476b6fdbd1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:22.374863 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11a28d6-1bdb-49d1-8e1e-52476b6fdbd1 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:22.389488 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-f11a28d6-1bdb-49d1-8e1e-52476b6fdbd1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:22.389488 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:22.389488 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:22.389488 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:22.389488 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:22.389488 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:22.389488 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:22.389488 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:22.389488 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:22.389488 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:22.389488 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:22.389488 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:22.389488 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:08:22.389488 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:08:22.389488 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:08:22.390584 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:08:22.390584 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:22.390584 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:22.390584 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:22.390584 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:22.390584 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:22.390584 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:22.390584 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:22.390584 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:22.390584 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:22.390584 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:22.390584 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:22.390584 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:22.390584 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:22.390584 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:22.390584 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:22.390584 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:22.391744 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:08:22.391744 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:08:22.391744 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:08:22.391744 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:08:22.391744 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:08:22.391744 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:08:22.391744 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:22.391744 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:22.395690 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 254/520] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jun 29 12:08:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:22.396167 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a28d6-1bdb-49d1-8e1e-52476b6fdbd1 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:22.411842 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708d9823-58c6-4753-a0a2-4cf069dbc16c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:22.450439 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d2263e-f043-499c-9404-6cd27f016bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:22.451876 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2263e-f043-499c-9404-6cd27f016bee None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:22.452175 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2263e-f043-499c-9404-6cd27f016bee None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:22.452446 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2263e-f043-499c-9404-6cd27f016bee None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:22.457872 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:22.460268 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d2263e-f043-499c-9404-6cd27f016bee None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:22.461982 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d2263e-f043-499c-9404-6cd27f016bee None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:22.477205 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-e9d2263e-f043-499c-9404-6cd27f016bee None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 29 12:08:22.477205 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:22.477205 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:22.477205 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:22.477205 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:22.477205 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:22.477205 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:22.477205 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:22.477205 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:22.477205 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:22.477205 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:22.477205 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:22.477205 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:08:22.477205 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:08:22.477205 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:08:22.477205 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:08:22.478376 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:22.478376 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:22.478376 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:08:22.478376 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:22.478376 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:08:22.478376 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:22.478376 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:22.478376 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:22.478376 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:22.478376 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:22.478376 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:22.478376 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:22.478376 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:22.478376 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:22.478376 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:22.478376 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:22.478376 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:22.478376 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:22.479637 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:22.479637 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:22.479637 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:08:22.479637 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:08:22.479637 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:08:22.479637 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:08:22.479637 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:08:22.479637 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:08:22.479637 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 29 12:08:22.479637 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:22.479637 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 267/521] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jun 29 12:08:22 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:22.479637 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d2263e-f043-499c-9404-6cd27f016bee None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:22.488538 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:22.517503 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a28d6-1bdb-49d1-8e1e-52476b6fdbd1 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:22.565974 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd8378d-75d2-48d3-8de4-7dc36a0161a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:22.566793 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8378d-75d2-48d3-8de4-7dc36a0161a6 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:22.567177 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8378d-75d2-48d3-8de4-7dc36a0161a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:22.567549 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8378d-75d2-48d3-8de4-7dc36a0161a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:22.605705 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d2263e-f043-499c-9404-6cd27f016bee None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:22.646544 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd8378d-75d2-48d3-8de4-7dc36a0161a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:22.648690 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd8378d-75d2-48d3-8de4-7dc36a0161a6 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:22.651004 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6b44e-3c29-4b13-b15b-d85dbeb600f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:22.653250 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6b44e-3c29-4b13-b15b-d85dbeb600f2 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:22.653679 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6b44e-3c29-4b13-b15b-d85dbeb600f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:22.654148 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6b44e-3c29-4b13-b15b-d85dbeb600f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:22.670397 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d6b44e-3c29-4b13-b15b-d85dbeb600f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:22.674923 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d6b44e-3c29-4b13-b15b-d85dbeb600f2 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:22.693429 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-44d6b44e-3c29-4b13-b15b-d85dbeb600f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:22.693429 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:22.693429 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:22.693429 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:22.693429 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:22.693429 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:22.693429 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:22.693429 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:22.693429 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:22.693429 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:22.693429 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:22.693429 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:22.693429 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:22.693429 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:22.693429 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:22.694521 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:22.694521 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:22.694521 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:22.694521 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:22.694521 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:22.694521 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:22.694521 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:22.694521 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:22.694521 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:22.694521 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:22.694521 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:22.694521 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:22.694521 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:22.694521 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:22.694521 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:22.694521 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:22.694521 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:22.695907 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:22.695907 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:22.695907 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:22.695907 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:22.703289 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 268/522] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:22.703289 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6b44e-3c29-4b13-b15b-d85dbeb600f2 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:22.728257 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:22.764370 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:22.812654 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 255/523] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:08:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:08:22.813355 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd8378d-75d2-48d3-8de4-7dc36a0161a6 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:22.828679 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6b44e-3c29-4b13-b15b-d85dbeb600f2 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:22.878528 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2880e529-d94c-42e4-af8f-47b90e6c4839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:22.880133 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880e529-d94c-42e4-af8f-47b90e6c4839 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:22.880645 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880e529-d94c-42e4-af8f-47b90e6c4839 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:22.881350 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880e529-d94c-42e4-af8f-47b90e6c4839 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:22.882860 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2880e529-d94c-42e4-af8f-47b90e6c4839 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:22.883840 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2880e529-d94c-42e4-af8f-47b90e6c4839 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:22.886069 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2880e529-d94c-42e4-af8f-47b90e6c4839 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:22.916275 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 269/524] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jun 29 12:08:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:22.917561 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2880e529-d94c-42e4-af8f-47b90e6c4839 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:22.950226 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd8378d-75d2-48d3-8de4-7dc36a0161a6 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:23.004518 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe23d3-d013-4243-ad59-b882307e7d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:23.005631 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe23d3-d013-4243-ad59-b882307e7d99 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:23.006250 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe23d3-d013-4243-ad59-b882307e7d99 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:23.006929 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe23d3-d013-4243-ad59-b882307e7d99 None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:23.008830 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbe23d3-d013-4243-ad59-b882307e7d99 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:23.009243 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbe23d3-d013-4243-ad59-b882307e7d99 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:23.011561 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbe23d3-d013-4243-ad59-b882307e7d99 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:23.042749 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 256/525] 10.222.0.27 () {56 vars in 1139 bytes} [Wed Jun 29 12:08:22 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:23.042749 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe23d3-d013-4243-ad59-b882307e7d99 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:23.055102 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:23.062092 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2880e529-d94c-42e4-af8f-47b90e6c4839 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:23.080702 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:23.103459 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f9b7b-b4f6-42ae-b0f2-971d1379f325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:23.104380 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f9b7b-b4f6-42ae-b0f2-971d1379f325 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:23.104646 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f9b7b-b4f6-42ae-b0f2-971d1379f325 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:23.104919 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f9b7b-b4f6-42ae-b0f2-971d1379f325 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:23.106309 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50f9b7b-b4f6-42ae-b0f2-971d1379f325 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:23.106813 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50f9b7b-b4f6-42ae-b0f2-971d1379f325 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:23.109300 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50f9b7b-b4f6-42ae-b0f2-971d1379f325 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:23.127627 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 270/526] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:23.127627 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f9b7b-b4f6-42ae-b0f2-971d1379f325 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:23.170156 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe23d3-d013-4243-ad59-b882307e7d99 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:23.211106 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e998675-200e-4e8f-b4d6-f89b73333b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:23.211971 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e998675-200e-4e8f-b4d6-f89b73333b13 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:23.212252 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e998675-200e-4e8f-b4d6-f89b73333b13 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:23.212516 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e998675-200e-4e8f-b4d6-f89b73333b13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:23.224441 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e998675-200e-4e8f-b4d6-f89b73333b13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:23.226164 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e998675-200e-4e8f-b4d6-f89b73333b13 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:23.245292 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f9b7b-b4f6-42ae-b0f2-971d1379f325 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:23.247672 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-3e998675-200e-4e8f-b4d6-f89b73333b13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:23.247672 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:23.247672 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:23.247672 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:23.247672 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:23.247672 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:23.247672 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:23.247672 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:23.247672 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:23.247672 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:23.247672 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:23.247672 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:23.247672 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:23.247672 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:23.247672 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:23.248564 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:23.248564 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:23.248564 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:23.248564 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:23.248564 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:23.248564 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:23.248564 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:23.248564 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:23.248564 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:23.248564 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:23.248564 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:23.248564 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:23.248564 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:23.248564 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:23.248564 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:23.248564 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:23.248564 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:23.249449 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:23.249449 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:23.249449 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:23.249449 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:23.249449 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 257/527] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:23.249866 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e998675-200e-4e8f-b4d6-f89b73333b13 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:23.288822 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef12cc7-e690-4b37-b3f6-250b116d05a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:23.290498 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef12cc7-e690-4b37-b3f6-250b116d05a6 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:23.291038 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef12cc7-e690-4b37-b3f6-250b116d05a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:23.291325 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef12cc7-e690-4b37-b3f6-250b116d05a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:23.292183 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef12cc7-e690-4b37-b3f6-250b116d05a6 None admin] RBAC: Adding query filter params (role.id=6f63a9619c7b40ebb5b73bde026d606b, scope.project.id=996db30845f84e57865fa40b9a730a05, user.id=7adaa2ef440941aa8214f2b2fd49b54e) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:23.292496 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef12cc7-e690-4b37-b3f6-250b116d05a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:23.293966 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef12cc7-e690-4b37-b3f6-250b116d05a6 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:23.309733 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 271/528] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jun 29 12:08:23 2022] GET /identity/v3/role_assignments?user.id=7adaa2ef440941aa8214f2b2fd49b54e&scope.project.id=996db30845f84e57865fa40b9a730a05&role.id=6f63a9619c7b40ebb5b73bde026d606b => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:23.309733 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef12cc7-e690-4b37-b3f6-250b116d05a6 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:23.338030 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:23.369905 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:23.390332 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e998675-200e-4e8f-b4d6-f89b73333b13 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:23.430338 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a9e11b-c376-4267-a3cb-86bf359e6871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:23.431125 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9e11b-c376-4267-a3cb-86bf359e6871 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:23.431471 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9e11b-c376-4267-a3cb-86bf359e6871 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:23.431851 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9e11b-c376-4267-a3cb-86bf359e6871 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:23.469981 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef12cc7-e690-4b37-b3f6-250b116d05a6 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:23.518639 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a9e11b-c376-4267-a3cb-86bf359e6871 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:23.519742 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555539db-f8c1-4d59-a1ad-ae9eca710c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:23.520317 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a9e11b-c376-4267-a3cb-86bf359e6871 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:23.520549 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555539db-f8c1-4d59-a1ad-ae9eca710c1c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:23.520832 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555539db-f8c1-4d59-a1ad-ae9eca710c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:23.521109 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555539db-f8c1-4d59-a1ad-ae9eca710c1c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:23.529769 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555539db-f8c1-4d59-a1ad-ae9eca710c1c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:23.532041 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555539db-f8c1-4d59-a1ad-ae9eca710c1c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:23.551959 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-555539db-f8c1-4d59-a1ad-ae9eca710c1c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:23.551959 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:23.551959 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:23.551959 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:23.551959 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:23.551959 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:23.551959 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:23.551959 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:23.551959 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:23.551959 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:23.551959 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:23.551959 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:23.551959 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:08:23.551959 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:08:23.551959 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:08:23.553377 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:08:23.553377 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:23.553377 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:23.553377 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:23.553377 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:23.553377 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:23.553377 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:23.553377 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:23.553377 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:23.553377 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:23.553377 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:23.553377 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:23.553377 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:23.553377 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:23.553377 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:23.553377 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:23.553377 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:23.554514 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:08:23.554514 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:08:23.554514 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:08:23.554514 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:08:23.554514 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:08:23.554514 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:08:23.554514 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:23.554514 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:23.557783 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 272/529] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jun 29 12:08:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:23.558778 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555539db-f8c1-4d59-a1ad-ae9eca710c1c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:23.593933 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:23.649189 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 258/530] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:08:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:08:23.650323 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a9e11b-c376-4267-a3cb-86bf359e6871 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:23.727056 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555539db-f8c1-4d59-a1ad-ae9eca710c1c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:23.729979 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:23.772429 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a9e11b-c376-4267-a3cb-86bf359e6871 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:23.789724 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf3b7e-f2fd-4741-8f87-156ca83c2c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:23.790573 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf3b7e-f2fd-4741-8f87-156ca83c2c31 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:23.790974 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf3b7e-f2fd-4741-8f87-156ca83c2c31 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:23.791344 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf3b7e-f2fd-4741-8f87-156ca83c2c31 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:23.792182 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cf3b7e-f2fd-4741-8f87-156ca83c2c31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:23.792586 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cf3b7e-f2fd-4741-8f87-156ca83c2c31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:23.794143 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cf3b7e-f2fd-4741-8f87-156ca83c2c31 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:23.813844 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 273/531] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:23.813844 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf3b7e-f2fd-4741-8f87-156ca83c2c31 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:23.829445 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372d7ec-2749-4138-aae8-22095b9c2697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:23.830297 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372d7ec-2749-4138-aae8-22095b9c2697 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:23.830696 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372d7ec-2749-4138-aae8-22095b9c2697 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:23.831069 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372d7ec-2749-4138-aae8-22095b9c2697 None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:23.832073 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a372d7ec-2749-4138-aae8-22095b9c2697 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:23.832480 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a372d7ec-2749-4138-aae8-22095b9c2697 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:23.834235 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a372d7ec-2749-4138-aae8-22095b9c2697 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:23.853667 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 259/532] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jun 29 12:08:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:23.854713 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372d7ec-2749-4138-aae8-22095b9c2697 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:23.883036 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:23.957912 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf3b7e-f2fd-4741-8f87-156ca83c2c31 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:23.992339 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372d7ec-2749-4138-aae8-22095b9c2697 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:23.994676 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f91ae-cd0f-4708-8a4b-6b8715c92072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:23.996338 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f91ae-cd0f-4708-8a4b-6b8715c92072 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:23.996338 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f91ae-cd0f-4708-8a4b-6b8715c92072 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:23.996338 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f91ae-cd0f-4708-8a4b-6b8715c92072 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:24.007808 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f91ae-cd0f-4708-8a4b-6b8715c92072 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:24.009398 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f91ae-cd0f-4708-8a4b-6b8715c92072 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:24.028361 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-af1f91ae-cd0f-4708-8a4b-6b8715c92072 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:24.028361 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:24.028361 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:24.028361 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:24.028361 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:24.028361 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:24.028361 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:24.028361 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:24.028361 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:24.028361 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:24.028361 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:24.028361 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:24.028361 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:24.028361 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:24.028361 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:24.029294 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:24.029294 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:24.029294 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:24.029294 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:24.029294 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:24.029294 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:24.029294 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:24.029294 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:24.029294 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:24.029294 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:24.029294 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:24.029294 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:24.029294 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:24.029294 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:24.029294 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:24.029294 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:24.029294 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:24.030189 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:24.030189 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:24.030189 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:24.030189 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:24.033497 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 274/533] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:24.034956 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f91ae-cd0f-4708-8a4b-6b8715c92072 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:24.043058 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b22d15-95b1-4b2f-8e28-eb706f23e578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:24.044177 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b22d15-95b1-4b2f-8e28-eb706f23e578 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:24.044627 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b22d15-95b1-4b2f-8e28-eb706f23e578 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:24.045066 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b22d15-95b1-4b2f-8e28-eb706f23e578 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:24.057765 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b22d15-95b1-4b2f-8e28-eb706f23e578 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:24.058262 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:24.060154 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b22d15-95b1-4b2f-8e28-eb706f23e578 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:24.080105 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-11b22d15-95b1-4b2f-8e28-eb706f23e578 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:24.080105 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:24.080105 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:24.080105 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:24.080105 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:24.080105 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:24.080105 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:24.080105 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:24.080105 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:24.080105 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:24.080105 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:24.080105 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:24.080105 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:08:24.080105 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:08:24.080105 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:08:24.081005 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:08:24.081005 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:24.081005 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:24.081005 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:24.081005 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:24.081005 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:24.081005 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:24.081005 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:24.081005 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:24.081005 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:24.081005 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:24.081005 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:24.081005 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:24.081005 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:24.081005 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:24.081005 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:24.081005 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:24.081932 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:08:24.081932 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:08:24.081932 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:08:24.081932 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:08:24.081932 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:08:24.081932 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:08:24.081932 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:24.081932 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:24.083650 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 260/534] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jun 29 12:08:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:24.083840 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b22d15-95b1-4b2f-8e28-eb706f23e578 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:24.154882 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f91ae-cd0f-4708-8a4b-6b8715c92072 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:24.190474 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:24.192562 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc0ca5-aa26-4047-88d5-abdd8e76fd31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:24.193442 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc0ca5-aa26-4047-88d5-abdd8e76fd31 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:24.193635 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc0ca5-aa26-4047-88d5-abdd8e76fd31 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:24.193925 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc0ca5-aa26-4047-88d5-abdd8e76fd31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:24.194790 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bc0ca5-aa26-4047-88d5-abdd8e76fd31 None admin] RBAC: Adding query filter params (role.id=6f63a9619c7b40ebb5b73bde026d606b, scope.project.id=996db30845f84e57865fa40b9a730a05, user.id=d865d1b935a54ca2b44beda5b0277336) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:24.195098 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bc0ca5-aa26-4047-88d5-abdd8e76fd31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:24.196545 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bc0ca5-aa26-4047-88d5-abdd8e76fd31 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:24.202631 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 275/535] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jun 29 12:08:24 2022] GET /identity/v3/role_assignments?user.id=d865d1b935a54ca2b44beda5b0277336&scope.project.id=996db30845f84e57865fa40b9a730a05&role.id=6f63a9619c7b40ebb5b73bde026d606b => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:24.210807 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b22d15-95b1-4b2f-8e28-eb706f23e578 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:24.214791 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc0ca5-aa26-4047-88d5-abdd8e76fd31 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:24.254221 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c66991-b7bd-4288-94a5-872c7f7a9156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:24.254897 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c66991-b7bd-4288-94a5-872c7f7a9156 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:24.255180 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c66991-b7bd-4288-94a5-872c7f7a9156 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:24.255456 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c66991-b7bd-4288-94a5-872c7f7a9156 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:24.256222 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c66991-b7bd-4288-94a5-872c7f7a9156 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:24.256532 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c66991-b7bd-4288-94a5-872c7f7a9156 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:24.258462 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c66991-b7bd-4288-94a5-872c7f7a9156 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:24.275780 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 261/536] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:24.275780 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9813c24f-1d98-4c00-95cb-67edf55d76c4 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:24.275780 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9813c24f-1d98-4c00-95cb-67edf55d76c4 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:24.275780 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9813c24f-1d98-4c00-95cb-67edf55d76c4 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:24.279456 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 262/537] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:08:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:24.280341 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9813c24f-1d98-4c00-95cb-67edf55d76c4 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:24.342211 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:24.374915 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc0ca5-aa26-4047-88d5-abdd8e76fd31 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:24.401257 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9813c24f-1d98-4c00-95cb-67edf55d76c4 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:24.413859 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1fac08-b165-4048-9d82-5fa55707ae59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:24.414986 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1fac08-b165-4048-9d82-5fa55707ae59 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:24.415569 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1fac08-b165-4048-9d82-5fa55707ae59 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:24.416052 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1fac08-b165-4048-9d82-5fa55707ae59 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:24.417051 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1fac08-b165-4048-9d82-5fa55707ae59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:24.417723 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1fac08-b165-4048-9d82-5fa55707ae59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:24.419525 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1fac08-b165-4048-9d82-5fa55707ae59 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:24.438058 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 276/538] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jun 29 12:08:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:24.439462 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6902547-5a32-42d4-b1bb-eabb5fe16834 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:24.439756 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6902547-5a32-42d4-b1bb-eabb5fe16834 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:24.440037 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6902547-5a32-42d4-b1bb-eabb5fe16834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:24.446667 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5efe873-b761-4b71-9893-eea7d78c931b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:24.447476 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5efe873-b761-4b71-9893-eea7d78c931b None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:24.447761 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5efe873-b761-4b71-9893-eea7d78c931b None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:24.448039 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5efe873-b761-4b71-9893-eea7d78c931b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:24.460283 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5efe873-b761-4b71-9893-eea7d78c931b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:24.461737 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5efe873-b761-4b71-9893-eea7d78c931b None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:24.462566 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f6902547-5a32-42d4-b1bb-eabb5fe16834 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:24.464005 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f6902547-5a32-42d4-b1bb-eabb5fe16834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:24.480169 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-e5efe873-b761-4b71-9893-eea7d78c931b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:24.480169 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:24.480169 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:24.480169 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:24.480169 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:24.480169 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:24.480169 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:24.480169 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:24.480169 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:24.480169 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:24.480169 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:24.480169 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:24.480169 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:08:24.480169 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:08:24.480169 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:08:24.481092 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:08:24.481092 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:24.481092 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:24.481092 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:24.481092 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:24.481092 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:24.481092 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:24.481092 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:24.481092 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:24.481092 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:24.481092 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:24.481092 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:24.481092 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:24.481092 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:24.481092 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:24.481092 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:24.481092 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:24.481981 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:08:24.481981 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:08:24.481981 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:08:24.481981 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:08:24.481981 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:08:24.481981 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:08:24.481981 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:24.481981 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:24.481981 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 263/539] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jun 29 12:08:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:24.482461 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5efe873-b761-4b71-9893-eea7d78c931b None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:24.485964 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:24.553771 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 277/540] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:08:24.555048 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6902547-5a32-42d4-b1bb-eabb5fe16834 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:24.627800 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5efe873-b761-4b71-9893-eea7d78c931b None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:24.637606 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:24.671607 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49edcb4-3565-4b7a-8530-55f6ef5c7e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:24.672882 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49edcb4-3565-4b7a-8530-55f6ef5c7e0b None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:24.673373 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49edcb4-3565-4b7a-8530-55f6ef5c7e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:24.673840 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49edcb4-3565-4b7a-8530-55f6ef5c7e0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:24.674950 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49edcb4-3565-4b7a-8530-55f6ef5c7e0b None admin] RBAC: Adding query filter params (role.id=6f63a9619c7b40ebb5b73bde026d606b, scope.project.id=996db30845f84e57865fa40b9a730a05, user.id=f72f0602e17f4ab4a48e3aaa7022d28d) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:24.675472 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49edcb4-3565-4b7a-8530-55f6ef5c7e0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:24.677132 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49edcb4-3565-4b7a-8530-55f6ef5c7e0b None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:24.682702 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6902547-5a32-42d4-b1bb-eabb5fe16834 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:24.683992 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 264/541] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jun 29 12:08:24 2022] GET /identity/v3/role_assignments?user.id=f72f0602e17f4ab4a48e3aaa7022d28d&scope.project.id=996db30845f84e57865fa40b9a730a05&role.id=6f63a9619c7b40ebb5b73bde026d606b => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:24.690800 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49edcb4-3565-4b7a-8530-55f6ef5c7e0b None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:24.729498 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8472755-75e1-4921-baad-e600b1e9638f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:24.730221 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8472755-75e1-4921-baad-e600b1e9638f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:24.730506 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8472755-75e1-4921-baad-e600b1e9638f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:24.730784 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8472755-75e1-4921-baad-e600b1e9638f None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:24.731605 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8472755-75e1-4921-baad-e600b1e9638f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:24.731917 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8472755-75e1-4921-baad-e600b1e9638f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:24.733412 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8472755-75e1-4921-baad-e600b1e9638f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:24.768518 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 278/542] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jun 29 12:08:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:24.774545 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8472755-75e1-4921-baad-e600b1e9638f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:24.835108 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:24.907147 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49edcb4-3565-4b7a-8530-55f6ef5c7e0b None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:24.915807 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8472755-75e1-4921-baad-e600b1e9638f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:24.942590 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe25c8-b490-4e93-82df-4008ae4886fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:24.943400 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe25c8-b490-4e93-82df-4008ae4886fc None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:24.943685 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe25c8-b490-4e93-82df-4008ae4886fc None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:24.943956 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe25c8-b490-4e93-82df-4008ae4886fc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:24.955854 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfe25c8-b490-4e93-82df-4008ae4886fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:08:24.964445 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-bcfe25c8-b490-4e93-82df-4008ae4886fc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:08:24.964445 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:24.964445 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:24.964445 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:24.964445 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:24.964445 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:24.964445 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:24.964445 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:24.964445 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:24.964445 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:24.964445 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:24.964445 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:24.964445 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:08:24.964445 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:08:24.964445 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:08:24.964445 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:08:24.965551 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:08:24.965551 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:08:24.965551 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:08:24.965551 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:08:24.965551 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:24.965551 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:24.965551 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:24.965551 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:24.965551 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:24.965551 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:24.965551 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:24.965551 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:24.965551 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:24.965551 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:24.965551 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:24.965551 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:24.966622 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:24.966622 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:24.966622 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:24.966622 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:24.966622 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:08:24.966622 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:08:24.966622 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:08:24.966622 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:08:24.966622 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:08:24.966622 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:08:24.966622 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:08:24.966622 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:24.966622 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 265/543] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jun 29 12:08:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:24.975408 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe25c8-b490-4e93-82df-4008ae4886fc None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:24.992921 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:24.998688 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0b169-2f34-4484-8322-bdd73948e2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:24.999626 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0b169-2f34-4484-8322-bdd73948e2b8 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:25.000083 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0b169-2f34-4484-8322-bdd73948e2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:25.000529 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0b169-2f34-4484-8322-bdd73948e2b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:25.001549 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d0b169-2f34-4484-8322-bdd73948e2b8 None admin] RBAC: Adding query filter params (role.id=6f63a9619c7b40ebb5b73bde026d606b, scope.project.id=996db30845f84e57865fa40b9a730a05, user.id=e94618bb382d46f7aaa2ef8f5d690bf2) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:25.002067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d0b169-2f34-4484-8322-bdd73948e2b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:25.003701 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d0b169-2f34-4484-8322-bdd73948e2b8 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:25.010261 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 279/544] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jun 29 12:08:24 2022] GET /identity/v3/role_assignments?user.id=e94618bb382d46f7aaa2ef8f5d690bf2&scope.project.id=996db30845f84e57865fa40b9a730a05&role.id=6f63a9619c7b40ebb5b73bde026d606b => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:08:25.171112 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe25c8-b490-4e93-82df-4008ae4886fc None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:25.216392 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:25.227501 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a483b5d-4703-4aef-86b3-ce293a3fbb20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:25.234604 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a483b5d-4703-4aef-86b3-ce293a3fbb20 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:25.235144 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a483b5d-4703-4aef-86b3-ce293a3fbb20 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:25.235591 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a483b5d-4703-4aef-86b3-ce293a3fbb20 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:25.236561 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a483b5d-4703-4aef-86b3-ce293a3fbb20 None admin] RBAC: Adding query filter params (name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:25.237074 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a483b5d-4703-4aef-86b3-ce293a3fbb20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:25.238715 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a483b5d-4703-4aef-86b3-ce293a3fbb20 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:25.248945 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 266/545] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jun 29 12:08:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:25.254313 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0b169-2f34-4484-8322-bdd73948e2b8 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:25.409980 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0b169-2f34-4484-8322-bdd73948e2b8 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:25.453773 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed51a5d-03f2-46eb-89ab-17e9c03609cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:25.454525 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed51a5d-03f2-46eb-89ab-17e9c03609cd None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:25.454808 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed51a5d-03f2-46eb-89ab-17e9c03609cd None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:25.455082 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed51a5d-03f2-46eb-89ab-17e9c03609cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:25.466959 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed51a5d-03f2-46eb-89ab-17e9c03609cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:25.468427 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed51a5d-03f2-46eb-89ab-17e9c03609cd None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:25.495963 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-4ed51a5d-03f2-46eb-89ab-17e9c03609cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:25.495963 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:25.495963 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:25.495963 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:25.495963 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:25.495963 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:25.495963 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:25.495963 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:25.495963 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:25.495963 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:25.495963 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:25.495963 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:25.495963 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:25.495963 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:25.495963 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:25.496860 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:25.496860 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:25.496860 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:25.496860 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:25.496860 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:25.496860 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:25.496860 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:25.496860 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:25.496860 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:25.496860 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:25.496860 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:25.496860 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:25.496860 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:25.496860 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:25.496860 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:25.496860 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:25.496860 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:25.497737 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:25.497737 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:25.497737 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:25.497737 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:25.497737 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 280/546] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:25.505736 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a483b5d-4703-4aef-86b3-ce293a3fbb20 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:25.559989 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defecd6e-f900-4021-b259-2f4be14641fa None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:25.560791 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defecd6e-f900-4021-b259-2f4be14641fa None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:25.562483 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defecd6e-f900-4021-b259-2f4be14641fa None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:25.564858 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 281/547] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:08:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:08:25.570642 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee95b4-e21c-4748-919d-ee8df269bf1a None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:25.571181 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee95b4-e21c-4748-919d-ee8df269bf1a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:25.571639 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee95b4-e21c-4748-919d-ee8df269bf1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:25.602230 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-dcee95b4-e21c-4748-919d-ee8df269bf1a None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:25.604519 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-dcee95b4-e21c-4748-919d-ee8df269bf1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:25.646781 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a483b5d-4703-4aef-86b3-ce293a3fbb20 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:25.702297 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:25.725245 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fffce00-b022-46ae-b949-549ebc896108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:25.726205 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fffce00-b022-46ae-b949-549ebc896108 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:25.726205 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fffce00-b022-46ae-b949-549ebc896108 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:25.726523 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fffce00-b022-46ae-b949-549ebc896108 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:25.727210 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fffce00-b022-46ae-b949-549ebc896108 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:25.727518 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fffce00-b022-46ae-b949-549ebc896108 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:25.728919 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fffce00-b022-46ae-b949-549ebc896108 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:25.751477 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 282/548] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:08:25.755440 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 267/549] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:25.761608 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee95b4-e21c-4748-919d-ee8df269bf1a None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:25.786149 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fffce00-b022-46ae-b949-549ebc896108 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:25.879490 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:25.910030 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee95b4-e21c-4748-919d-ee8df269bf1a None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:25.950195 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba699f77-2d47-444d-9e19-52b17434c621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:25.951367 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba699f77-2d47-444d-9e19-52b17434c621 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:25.952684 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba699f77-2d47-444d-9e19-52b17434c621 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:25.953141 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba699f77-2d47-444d-9e19-52b17434c621 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:25.962567 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba699f77-2d47-444d-9e19-52b17434c621 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:25.964314 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba699f77-2d47-444d-9e19-52b17434c621 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:25.981903 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-ba699f77-2d47-444d-9e19-52b17434c621 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 29 12:08:25.981903 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:25.981903 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:25.981903 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:25.981903 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:25.981903 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:25.981903 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:25.981903 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:25.981903 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:25.981903 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:25.981903 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:25.981903 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:25.981903 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:08:25.981903 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:08:25.981903 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:08:25.981903 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:08:25.983379 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:25.983379 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:25.983379 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:08:25.983379 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:25.983379 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:08:25.983379 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:25.983379 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:25.983379 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:25.983379 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:25.983379 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:25.983379 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:25.983379 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:25.983379 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:25.983379 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:25.983379 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:25.983379 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:25.983379 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:25.983379 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:25.984496 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:25.984496 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:25.984496 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:08:25.984496 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:08:25.984496 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:08:25.984496 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:08:25.984496 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:08:25.984496 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:08:25.984496 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 29 12:08:25.984496 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:25.987517 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 283/550] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jun 29 12:08:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:08:25.993654 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba699f77-2d47-444d-9e19-52b17434c621 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:26.010150 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fffce00-b022-46ae-b949-549ebc896108 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:26.033309 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:26.077403 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7679b708-7101-4ee5-b669-a3aade8c9f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:26.078238 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679b708-7101-4ee5-b669-a3aade8c9f97 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:26.078517 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679b708-7101-4ee5-b669-a3aade8c9f97 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:26.078785 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679b708-7101-4ee5-b669-a3aade8c9f97 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:26.090963 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7679b708-7101-4ee5-b669-a3aade8c9f97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:08:26.100110 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-7679b708-7101-4ee5-b669-a3aade8c9f97 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:08:26.100110 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:26.100110 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:26.100110 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:26.100110 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:26.100110 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:26.100110 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:26.100110 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:26.100110 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:26.100110 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:26.100110 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:26.100110 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:26.100110 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:08:26.100110 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:08:26.100110 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:08:26.100110 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:08:26.101161 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:08:26.101161 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:08:26.101161 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:08:26.101161 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:08:26.101161 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:26.101161 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:26.101161 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:26.101161 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:26.101161 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:26.101161 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:26.101161 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:26.101161 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:26.101161 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:26.101161 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:26.101161 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:26.101161 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:26.102142 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:26.102142 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:26.102142 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:26.102142 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:26.102142 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:08:26.102142 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:08:26.102142 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:08:26.102142 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:08:26.102142 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:08:26.102142 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:08:26.102142 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:08:26.102142 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:26.102888 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 268/551] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jun 29 12:08:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:08:26.110247 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7679b708-7101-4ee5-b669-a3aade8c9f97 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:26.181865 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba699f77-2d47-444d-9e19-52b17434c621 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:26.251148 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b056e01-f258-4ad2-a571-c9315c866e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:26.251746 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b056e01-f258-4ad2-a571-c9315c866e10 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:26.252027 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b056e01-f258-4ad2-a571-c9315c866e10 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:26.252310 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b056e01-f258-4ad2-a571-c9315c866e10 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:26.253156 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b056e01-f258-4ad2-a571-c9315c866e10 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:26.253464 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b056e01-f258-4ad2-a571-c9315c866e10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:26.254953 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b056e01-f258-4ad2-a571-c9315c866e10 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:26.287895 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7679b708-7101-4ee5-b669-a3aade8c9f97 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:26.301676 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 284/552] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Jun 29 12:08:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:26.308451 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b056e01-f258-4ad2-a571-c9315c866e10 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:26.313001 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:26.362183 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e4265a-b3e4-4ca6-8348-4e549eab0987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:26.363235 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4265a-b3e4-4ca6-8348-4e549eab0987 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:26.363517 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4265a-b3e4-4ca6-8348-4e549eab0987 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:26.363789 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4265a-b3e4-4ca6-8348-4e549eab0987 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:26.364556 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e4265a-b3e4-4ca6-8348-4e549eab0987 None admin] RBAC: Adding query filter params (name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:26.364863 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e4265a-b3e4-4ca6-8348-4e549eab0987 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:26.366388 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e4265a-b3e4-4ca6-8348-4e549eab0987 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:26.388746 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 269/553] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jun 29 12:08:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:26.407319 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e4265a-b3e4-4ca6-8348-4e549eab0987 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:26.463119 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:26.472278 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b056e01-f258-4ad2-a571-c9315c866e10 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:26.509620 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f8f4a-2df9-48f2-bc47-e8ecd607a5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:26.509874 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f8f4a-2df9-48f2-bc47-e8ecd607a5c4 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:26.510180 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f8f4a-2df9-48f2-bc47-e8ecd607a5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:26.510451 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f8f4a-2df9-48f2-bc47-e8ecd607a5c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:26.522441 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e4265a-b3e4-4ca6-8348-4e549eab0987 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:26.557040 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cac912-0b26-43d2-b517-18b774019e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:26.558340 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cac912-0b26-43d2-b517-18b774019e5d None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:26.558829 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cac912-0b26-43d2-b517-18b774019e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:26.559301 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cac912-0b26-43d2-b517-18b774019e5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:26.570719 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cac912-0b26-43d2-b517-18b774019e5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:26.572477 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cac912-0b26-43d2-b517-18b774019e5d None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:26.587478 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416f8f4a-2df9-48f2-bc47-e8ecd607a5c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:26.588952 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416f8f4a-2df9-48f2-bc47-e8ecd607a5c4 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:26.592036 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-e0cac912-0b26-43d2-b517-18b774019e5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:26.592036 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:26.592036 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:26.592036 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:26.592036 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:26.592036 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:26.592036 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:26.592036 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:26.592036 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:26.592036 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:26.592036 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:26.592036 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:26.592036 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:26.592036 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:26.592036 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:26.592912 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:26.592912 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:26.592912 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:26.592912 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:26.592912 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:26.592912 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:26.592912 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:26.592912 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:26.592912 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:26.592912 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:26.592912 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:26.592912 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:26.592912 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:26.592912 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:26.592912 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:26.592912 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:26.592912 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:26.593827 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:26.593827 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:26.593827 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:26.593827 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:26.596062 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 270/554] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:08:26.597609 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0c751-2e28-4f01-bc6b-bdd08e0e45cc None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:26.598126 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0c751-2e28-4f01-bc6b-bdd08e0e45cc None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:26.598602 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0c751-2e28-4f01-bc6b-bdd08e0e45cc None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:26.604515 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 271/555] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:08:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:26.606043 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7a340-2e14-43e4-942e-be06b069708b None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:26.606535 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7a340-2e14-43e4-942e-be06b069708b None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:26.607029 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7a340-2e14-43e4-942e-be06b069708b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:26.624569 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-38a7a340-2e14-43e4-942e-be06b069708b None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:26.626127 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-38a7a340-2e14-43e4-942e-be06b069708b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:26.670074 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:26.685478 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:26.700771 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 285/556] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:08:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 29 12:08:26.701373 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 272/557] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:08:26.702094 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f8f4a-2df9-48f2-bc47-e8ecd607a5c4 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:26.703064 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a7a340-2e14-43e4-942e-be06b069708b None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:26.806582 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f8f4a-2df9-48f2-bc47-e8ecd607a5c4 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:26.831844 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a7a340-2e14-43e4-942e-be06b069708b None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:26.841495 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89843586-8fcd-485a-ba99-337efd8ab3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:26.842193 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89843586-8fcd-485a-ba99-337efd8ab3ed None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:26.842472 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89843586-8fcd-485a-ba99-337efd8ab3ed None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:26.842746 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89843586-8fcd-485a-ba99-337efd8ab3ed None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:26.843481 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89843586-8fcd-485a-ba99-337efd8ab3ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:26.843788 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89843586-8fcd-485a-ba99-337efd8ab3ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:26.845165 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89843586-8fcd-485a-ba99-337efd8ab3ed None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:26.857754 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 286/558] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:26.858631 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89843586-8fcd-485a-ba99-337efd8ab3ed None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:26.871514 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a70329-d9e1-4f8b-b82d-0f8be4a85afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:26.872408 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a70329-d9e1-4f8b-b82d-0f8be4a85afe None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:26.872693 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a70329-d9e1-4f8b-b82d-0f8be4a85afe None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:26.872963 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a70329-d9e1-4f8b-b82d-0f8be4a85afe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:26.885010 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a70329-d9e1-4f8b-b82d-0f8be4a85afe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:26.886766 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a70329-d9e1-4f8b-b82d-0f8be4a85afe None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:26.907234 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-38a70329-d9e1-4f8b-b82d-0f8be4a85afe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:26.907234 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:26.907234 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:26.907234 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:26.907234 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:26.907234 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:26.907234 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:26.907234 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:26.907234 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:26.907234 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:26.907234 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:26.907234 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:26.907234 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:26.907234 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:26.907234 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:26.908634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:26.908634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:26.908634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:26.908634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:26.908634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:26.908634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:26.908634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:26.908634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:26.908634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:26.908634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:26.908634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:26.908634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:26.908634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:26.908634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:26.908634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:26.908634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:26.908634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:26.909527 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:26.909527 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:26.909527 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:26.909527 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:26.909527 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 273/559] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:26.909527 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a70329-d9e1-4f8b-b82d-0f8be4a85afe None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:26.917490 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:26.919778 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:26.972201 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89843586-8fcd-485a-ba99-337efd8ab3ed None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:27.008006 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9cfdee-1209-4453-b368-0276ce8549fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:27.008798 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9cfdee-1209-4453-b368-0276ce8549fc None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:27.009085 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9cfdee-1209-4453-b368-0276ce8549fc None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:27.009355 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9cfdee-1209-4453-b368-0276ce8549fc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:27.020467 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9cfdee-1209-4453-b368-0276ce8549fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:08:27.032111 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-ac9cfdee-1209-4453-b368-0276ce8549fc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:08:27.032111 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:27.032111 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:27.032111 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:27.032111 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:27.032111 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:27.032111 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:27.032111 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:27.032111 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:27.032111 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:27.032111 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:27.032111 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:27.032111 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:08:27.032111 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:08:27.032111 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:08:27.032111 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:08:27.034323 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:08:27.034323 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:08:27.034323 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:08:27.034323 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:08:27.034323 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:27.034323 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:27.034323 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:27.034323 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:27.034323 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:27.034323 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:27.034323 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:27.034323 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:27.034323 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:27.034323 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:27.034323 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:27.034323 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:27.038643 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:27.038643 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:27.038643 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:27.038643 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:27.038643 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:08:27.038643 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:08:27.038643 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:08:27.038643 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:08:27.038643 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:08:27.038643 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:08:27.038643 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:08:27.038643 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:27.040131 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a70329-d9e1-4f8b-b82d-0f8be4a85afe None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:27.040286 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 287/560] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jun 29 12:08:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:27.040286 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9cfdee-1209-4453-b368-0276ce8549fc None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:27.077525 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d304e-a8c9-4e53-b79f-1770a45c8087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:27.078364 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d304e-a8c9-4e53-b79f-1770a45c8087 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:27.078700 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d304e-a8c9-4e53-b79f-1770a45c8087 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:27.078971 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d304e-a8c9-4e53-b79f-1770a45c8087 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:27.088926 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201d304e-a8c9-4e53-b79f-1770a45c8087 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:27.091135 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201d304e-a8c9-4e53-b79f-1770a45c8087 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:27.109527 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-201d304e-a8c9-4e53-b79f-1770a45c8087 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 12:08:27.109527 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:27.109527 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:27.109527 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:27.109527 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:27.109527 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:27.109527 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:27.109527 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:27.109527 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:27.109527 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:27.109527 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:27.109527 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:27.109527 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:08:27.109527 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:08:27.109527 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:08:27.109527 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:08:27.110729 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:27.110729 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:27.110729 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:08:27.110729 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:27.110729 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:08:27.110729 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:27.110729 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:27.110729 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:27.110729 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:27.110729 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:27.110729 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:27.110729 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:27.110729 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:27.110729 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:27.110729 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:27.110729 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:27.110729 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:27.110729 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:27.111821 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:27.111821 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:27.111821 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:08:27.111821 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:08:27.111821 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:08:27.111821 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:08:27.111821 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:08:27.111821 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:08:27.111821 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 12:08:27.111821 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:27.111821 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 274/561] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Jun 29 12:08:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:27.112575 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d304e-a8c9-4e53-b79f-1770a45c8087 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:27.156463 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9cfdee-1209-4453-b368-0276ce8549fc None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:27.170416 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:27.186572 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:27.193556 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c6b8d-4a74-466d-9194-479077748cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:27.194554 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c6b8d-4a74-466d-9194-479077748cdf None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:27.194761 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c6b8d-4a74-466d-9194-479077748cdf None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:27.195473 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c6b8d-4a74-466d-9194-479077748cdf None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:27.195959 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c6b8d-4a74-466d-9194-479077748cdf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:27.196288 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c6b8d-4a74-466d-9194-479077748cdf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:27.197758 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c6b8d-4a74-466d-9194-479077748cdf None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:27.211307 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 288/562] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:27.211959 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c6b8d-4a74-466d-9194-479077748cdf None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:27.232134 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d304e-a8c9-4e53-b79f-1770a45c8087 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:27.268387 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff279f1-8019-43e3-9476-54c9531bab63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:27.269068 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff279f1-8019-43e3-9476-54c9531bab63 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:27.269348 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff279f1-8019-43e3-9476-54c9531bab63 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:27.269626 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff279f1-8019-43e3-9476-54c9531bab63 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:27.270451 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff279f1-8019-43e3-9476-54c9531bab63 None admin] RBAC: Adding query filter params (name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:27.270733 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff279f1-8019-43e3-9476-54c9531bab63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:27.272125 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff279f1-8019-43e3-9476-54c9531bab63 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:27.282200 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 275/563] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jun 29 12:08:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:27.283400 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc609b-3e2d-4dea-b6f6-95528ca862cc None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:27.283689 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc609b-3e2d-4dea-b6f6-95528ca862cc None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:27.283959 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc609b-3e2d-4dea-b6f6-95528ca862cc None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:27.285311 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 276/564] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:08:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:27.289742 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc609b-3e2d-4dea-b6f6-95528ca862cc None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:27.327194 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c6b8d-4a74-466d-9194-479077748cdf None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:27.364742 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920e990-b339-4f85-a497-6047f8896277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:27.365394 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920e990-b339-4f85-a497-6047f8896277 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:27.365677 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920e990-b339-4f85-a497-6047f8896277 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:27.365989 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920e990-b339-4f85-a497-6047f8896277 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:27.366889 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6920e990-b339-4f85-a497-6047f8896277 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:27.367198 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6920e990-b339-4f85-a497-6047f8896277 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:27.368656 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6920e990-b339-4f85-a497-6047f8896277 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:27.386014 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 289/565] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Jun 29 12:08:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:27.386847 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920e990-b339-4f85-a497-6047f8896277 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:27.402612 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc609b-3e2d-4dea-b6f6-95528ca862cc None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:27.418922 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:27.428782 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:27.438140 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda5fe36-1a13-4211-b31b-b840542856c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:27.438945 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5fe36-1a13-4211-b31b-b840542856c1 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:27.439242 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5fe36-1a13-4211-b31b-b840542856c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:27.439517 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5fe36-1a13-4211-b31b-b840542856c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:27.446464 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda5fe36-1a13-4211-b31b-b840542856c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:27.448413 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda5fe36-1a13-4211-b31b-b840542856c1 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:27.462475 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-cda5fe36-1a13-4211-b31b-b840542856c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:27.462475 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:27.462475 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:27.462475 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:27.462475 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:27.462475 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:27.462475 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:27.462475 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:27.462475 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:27.462475 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:27.462475 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:27.462475 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:27.462475 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:08:27.462475 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:08:27.462475 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:08:27.463411 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:08:27.463411 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:27.463411 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:27.463411 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:27.463411 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:27.463411 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:27.463411 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:27.463411 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:27.463411 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:27.463411 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:27.463411 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:27.463411 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:27.463411 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:27.463411 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:27.463411 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:27.463411 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:27.463411 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:27.464315 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:08:27.464315 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:08:27.464315 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:08:27.464315 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:08:27.464315 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:08:27.464315 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:08:27.464315 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:27.464315 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:27.464315 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 277/566] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jun 29 12:08:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:27.464792 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0daa8d-ac66-4432-9f78-d14c274b13cb None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:27.465324 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0daa8d-ac66-4432-9f78-d14c274b13cb None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:27.465324 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0daa8d-ac66-4432-9f78-d14c274b13cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:27.482035 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-cf0daa8d-ac66-4432-9f78-d14c274b13cb None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:27.483259 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-cf0daa8d-ac66-4432-9f78-d14c274b13cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:27.494529 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920e990-b339-4f85-a497-6047f8896277 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:27.529920 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c0e8f-dd73-41ba-83b9-db43a12ea442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:27.530721 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c0e8f-dd73-41ba-83b9-db43a12ea442 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:27.530995 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c0e8f-dd73-41ba-83b9-db43a12ea442 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:27.531263 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c0e8f-dd73-41ba-83b9-db43a12ea442 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:27.541612 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c0e8f-dd73-41ba-83b9-db43a12ea442 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:27.543140 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c0e8f-dd73-41ba-83b9-db43a12ea442 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:27.550813 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 278/567] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:08:27.552131 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf42d96-4df9-4bd2-b8ce-9ce81336a0e9 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:27.552419 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf42d96-4df9-4bd2-b8ce-9ce81336a0e9 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:27.552692 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf42d96-4df9-4bd2-b8ce-9ce81336a0e9 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:27.554209 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 279/568] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:08:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:27.554797 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf42d96-4df9-4bd2-b8ce-9ce81336a0e9 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:27.567402 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-853c0e8f-dd73-41ba-83b9-db43a12ea442 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:27.567402 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:27.567402 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:27.567402 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:27.567402 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:27.567402 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:27.567402 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:27.567402 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:27.567402 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:27.567402 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:27.567402 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:27.567402 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:27.567402 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:27.567402 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:27.567402 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:27.568460 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:27.568460 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:27.568460 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:27.568460 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:27.568460 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:27.568460 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:27.568460 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:27.568460 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:27.568460 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:27.568460 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:27.568460 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:27.568460 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:27.568460 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:27.568460 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:27.568460 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:27.568460 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:27.568460 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:27.569951 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:27.569951 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:27.569951 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:27.569951 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:27.569951 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 290/569] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:27.569951 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c0e8f-dd73-41ba-83b9-db43a12ea442 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:27.653513 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:27.673583 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c0e8f-dd73-41ba-83b9-db43a12ea442 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:27.674568 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf42d96-4df9-4bd2-b8ce-9ce81336a0e9 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:27.692150 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:27.708196 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7915c1db-452e-4b04-81e1-7e33710263ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:27.708853 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915c1db-452e-4b04-81e1-7e33710263ce None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:27.709130 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915c1db-452e-4b04-81e1-7e33710263ce None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:27.709396 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915c1db-452e-4b04-81e1-7e33710263ce None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:27.710776 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7915c1db-452e-4b04-81e1-7e33710263ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:27.711087 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7915c1db-452e-4b04-81e1-7e33710263ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:27.711316 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b6949f-fa62-4256-9629-198eb94b934c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:27.712111 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6949f-fa62-4256-9629-198eb94b934c None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:27.712387 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6949f-fa62-4256-9629-198eb94b934c None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:27.712528 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7915c1db-452e-4b04-81e1-7e33710263ce None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:27.712652 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6949f-fa62-4256-9629-198eb94b934c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:27.722886 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b6949f-fa62-4256-9629-198eb94b934c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:27.724275 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 291/570] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jun 29 12:08:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:27.724399 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b6949f-fa62-4256-9629-198eb94b934c None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:27.725672 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa6e90-64ba-42c4-baca-433b36500474 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:27.726531 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa6e90-64ba-42c4-baca-433b36500474 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:27.726807 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa6e90-64ba-42c4-baca-433b36500474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:27.742818 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-b1b6949f-fa62-4256-9629-198eb94b934c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:27.742818 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:27.742818 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:27.742818 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:27.742818 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:27.742818 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:27.742818 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:27.742818 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:27.742818 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:27.742818 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:27.742818 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:27.742818 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:27.742818 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:27.742818 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:27.742818 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:27.743754 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:27.743754 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:27.743754 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:27.743754 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:27.743754 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:27.743754 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:27.743754 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:27.743754 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:27.743754 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:27.743754 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:27.743754 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:27.743754 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:27.743754 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:27.743754 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:27.743754 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:27.743754 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:27.743754 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:27.744650 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:27.744650 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:27.744650 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:27.744650 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:27.744871 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e0fa6e90-64ba-42c4-baca-433b36500474 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:27.744942 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 280/571] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:27.745017 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e0fa6e90-64ba-42c4-baca-433b36500474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:27.745100 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b6949f-fa62-4256-9629-198eb94b934c None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:27.816922 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 292/572] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:08:27.817784 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa6e90-64ba-42c4-baca-433b36500474 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:27.858168 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b6949f-fa62-4256-9629-198eb94b934c None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:27.891321 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:27.892776 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c9ff7-418e-4a07-ba72-1e556e443d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:27.893411 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c9ff7-418e-4a07-ba72-1e556e443d98 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:27.893708 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c9ff7-418e-4a07-ba72-1e556e443d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:27.893991 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c9ff7-418e-4a07-ba72-1e556e443d98 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:27.894716 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252c9ff7-418e-4a07-ba72-1e556e443d98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:27.895019 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252c9ff7-418e-4a07-ba72-1e556e443d98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:27.896423 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252c9ff7-418e-4a07-ba72-1e556e443d98 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:27.907841 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 281/573] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:27.908578 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c9ff7-418e-4a07-ba72-1e556e443d98 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:27.923764 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa6e90-64ba-42c4-baca-433b36500474 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:27.936254 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:27.959085 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7472c-3b11-43b5-8bb1-9d2987db409c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:27.959929 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7472c-3b11-43b5-8bb1-9d2987db409c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:27.960209 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7472c-3b11-43b5-8bb1-9d2987db409c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:27.960541 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7472c-3b11-43b5-8bb1-9d2987db409c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:27.970396 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe7472c-3b11-43b5-8bb1-9d2987db409c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:08:27.978220 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-5fe7472c-3b11-43b5-8bb1-9d2987db409c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:08:27.978220 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:27.978220 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:27.978220 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:27.978220 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:27.978220 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:27.978220 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:27.978220 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:27.978220 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:27.978220 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:27.978220 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:27.978220 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:27.978220 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:08:27.978220 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:08:27.978220 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:08:27.978220 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:08:27.979157 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:08:27.979157 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:08:27.979157 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:08:27.979157 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:08:27.979157 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:27.979157 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:27.979157 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:27.979157 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:27.979157 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:27.979157 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:27.979157 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:27.979157 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:27.979157 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:27.979157 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:27.979157 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:27.979157 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:27.980018 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:27.980018 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:27.980018 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:27.980018 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:27.980018 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:08:27.980018 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:08:27.980018 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:08:27.980018 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:08:27.980018 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:08:27.980018 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:08:27.980018 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:08:27.980018 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:27.980018 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 293/574] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jun 29 12:08:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:27.980737 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7472c-3b11-43b5-8bb1-9d2987db409c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:28.014509 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c9ff7-418e-4a07-ba72-1e556e443d98 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:28.051007 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bb4c2f-87c2-4871-9176-b9cdfbbc0e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:28.052161 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb4c2f-87c2-4871-9176-b9cdfbbc0e01 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:28.052161 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb4c2f-87c2-4871-9176-b9cdfbbc0e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:28.052161 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb4c2f-87c2-4871-9176-b9cdfbbc0e01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:28.053012 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bb4c2f-87c2-4871-9176-b9cdfbbc0e01 None admin] RBAC: Adding query filter params (role.id=6f63a9619c7b40ebb5b73bde026d606b, scope.project.id=996db30845f84e57865fa40b9a730a05, user.id=cc92f8232bda407c84365eb10ede737f) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:28.053311 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bb4c2f-87c2-4871-9176-b9cdfbbc0e01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:28.054867 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bb4c2f-87c2-4871-9176-b9cdfbbc0e01 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:28.060515 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 282/575] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jun 29 12:08:27 2022] GET /identity/v3/role_assignments?user.id=cc92f8232bda407c84365eb10ede737f&scope.project.id=996db30845f84e57865fa40b9a730a05&role.id=6f63a9619c7b40ebb5b73bde026d606b => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:28.061299 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bb4c2f-87c2-4871-9176-b9cdfbbc0e01 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:28.089092 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7472c-3b11-43b5-8bb1-9d2987db409c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:28.124269 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:28.130986 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c76d99f-1b6c-444b-80c9-499d81022c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:28.131717 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76d99f-1b6c-444b-80c9-499d81022c2a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:28.131978 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76d99f-1b6c-444b-80c9-499d81022c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:28.132695 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76d99f-1b6c-444b-80c9-499d81022c2a None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:28.133345 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c76d99f-1b6c-444b-80c9-499d81022c2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:28.133646 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c76d99f-1b6c-444b-80c9-499d81022c2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:28.135238 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c76d99f-1b6c-444b-80c9-499d81022c2a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:28.155421 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 294/576] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:28.156814 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c76d99f-1b6c-444b-80c9-499d81022c2a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:28.180581 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:28.191282 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bb4c2f-87c2-4871-9176-b9cdfbbc0e01 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:28.230526 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf977e-0e82-4072-8bcc-a03ebecc65cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:28.231414 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf977e-0e82-4072-8bcc-a03ebecc65cd None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:28.231614 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf977e-0e82-4072-8bcc-a03ebecc65cd None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:28.231881 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf977e-0e82-4072-8bcc-a03ebecc65cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:28.243598 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acf977e-0e82-4072-8bcc-a03ebecc65cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:08:28.251332 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-7acf977e-0e82-4072-8bcc-a03ebecc65cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:08:28.251332 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:28.251332 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:28.251332 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:28.251332 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:28.251332 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:28.251332 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:28.251332 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:28.251332 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:28.251332 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:28.251332 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:28.251332 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:28.251332 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:08:28.251332 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:08:28.251332 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:08:28.251332 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:08:28.252270 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:08:28.252270 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:08:28.252270 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:08:28.252270 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:08:28.252270 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:28.252270 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:28.252270 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:28.252270 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:28.252270 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:28.252270 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:28.252270 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:28.252270 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:28.252270 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:28.252270 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:28.252270 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:28.252270 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:28.253108 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:28.253108 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:28.253108 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:28.253108 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:28.253108 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:08:28.253108 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:08:28.253108 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:08:28.253108 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:08:28.253108 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:08:28.253108 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:08:28.253108 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:08:28.253108 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:28.253108 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 283/577] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jun 29 12:08:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:28.253848 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf977e-0e82-4072-8bcc-a03ebecc65cd None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:28.274511 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c76d99f-1b6c-444b-80c9-499d81022c2a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:28.311276 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c492fce-dda1-4e1b-89d7-512aead679de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:28.312333 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c492fce-dda1-4e1b-89d7-512aead679de None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:28.312710 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c492fce-dda1-4e1b-89d7-512aead679de None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:28.312880 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c492fce-dda1-4e1b-89d7-512aead679de None admin] PATH_INFO: `/v3/users/glance` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:28.320895 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c492fce-dda1-4e1b-89d7-512aead679de None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:28.322381 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c492fce-dda1-4e1b-89d7-512aead679de None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:28.337793 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-5c492fce-dda1-4e1b-89d7-512aead679de None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 29 12:08:28.337793 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:28.337793 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:28.337793 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:28.337793 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:28.337793 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:28.337793 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:28.337793 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:28.337793 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:28.337793 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:28.337793 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:28.337793 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:28.337793 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:08:28.337793 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:08:28.337793 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:08:28.337793 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:08:28.338801 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:28.338801 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:28.338801 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:08:28.338801 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:28.338801 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:08:28.338801 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:28.338801 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:28.338801 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:28.338801 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:28.338801 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:28.338801 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:28.338801 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:28.338801 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:28.338801 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:28.338801 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:28.338801 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:28.338801 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:28.338801 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:28.339775 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:28.339775 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:28.339775 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:08:28.339775 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:08:28.339775 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:08:28.339775 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:08:28.339775 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:08:28.339775 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:08:28.339775 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 29 12:08:28.339775 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:28.339775 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 295/578] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:08:28 2022] GET /identity/v3/users/glance => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:28.339775 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c492fce-dda1-4e1b-89d7-512aead679de None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:28.369874 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf977e-0e82-4072-8bcc-a03ebecc65cd None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:28.402001 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:28.408877 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24374fd7-fd95-4dd3-aa15-b6095469d8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:28.409662 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24374fd7-fd95-4dd3-aa15-b6095469d8df None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:28.409965 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24374fd7-fd95-4dd3-aa15-b6095469d8df None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:28.410226 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24374fd7-fd95-4dd3-aa15-b6095469d8df None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:28.410984 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24374fd7-fd95-4dd3-aa15-b6095469d8df None admin] RBAC: Adding query filter params (name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:28.411293 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24374fd7-fd95-4dd3-aa15-b6095469d8df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:28.412899 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24374fd7-fd95-4dd3-aa15-b6095469d8df None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:28.421797 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 284/579] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jun 29 12:08:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:28.426404 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24374fd7-fd95-4dd3-aa15-b6095469d8df None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:28.441394 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:28.455632 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c492fce-dda1-4e1b-89d7-512aead679de None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:28.494310 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3267c6-e22e-4ff5-ad8e-e56899b710d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:28.495105 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3267c6-e22e-4ff5-ad8e-e56899b710d2 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:28.495384 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3267c6-e22e-4ff5-ad8e-e56899b710d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:28.495653 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3267c6-e22e-4ff5-ad8e-e56899b710d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:28.503035 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3267c6-e22e-4ff5-ad8e-e56899b710d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:28.504482 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3267c6-e22e-4ff5-ad8e-e56899b710d2 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:28.518931 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-ad3267c6-e22e-4ff5-ad8e-e56899b710d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:28.518931 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:28.518931 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:28.518931 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:28.518931 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:28.518931 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:28.518931 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:28.518931 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:28.518931 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:28.518931 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:28.518931 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:28.518931 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:28.518931 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:08:28.518931 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:08:28.518931 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:08:28.519905 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:08:28.519905 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:28.519905 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:28.519905 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:28.519905 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:28.519905 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:28.519905 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:28.519905 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:28.519905 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:28.519905 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:28.519905 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:28.519905 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:28.519905 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:28.519905 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:28.519905 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:28.519905 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:28.519905 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:28.520816 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:08:28.520816 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:08:28.520816 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:08:28.520816 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:08:28.520816 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:08:28.520816 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:08:28.520816 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:28.520816 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:28.520816 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 296/580] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jun 29 12:08:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:28.522199 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3267c6-e22e-4ff5-ad8e-e56899b710d2 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:28.537487 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24374fd7-fd95-4dd3-aa15-b6095469d8df None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:28.572298 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672b427-c1ea-4623-a7e2-19548a6840cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:28.573130 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672b427-c1ea-4623-a7e2-19548a6840cb None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:28.573519 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672b427-c1ea-4623-a7e2-19548a6840cb None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:28.573957 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672b427-c1ea-4623-a7e2-19548a6840cb None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:28.574822 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9672b427-c1ea-4623-a7e2-19548a6840cb None admin] RBAC: Adding query filter params (name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:28.575137 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9672b427-c1ea-4623-a7e2-19548a6840cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:28.576539 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9672b427-c1ea-4623-a7e2-19548a6840cb None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:28.585191 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 285/581] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jun 29 12:08:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:28.586192 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672b427-c1ea-4623-a7e2-19548a6840cb None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:28.643234 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3267c6-e22e-4ff5-ad8e-e56899b710d2 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:28.657236 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:28.669670 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:28.684881 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a569787-39f3-439c-a480-017b8dac7342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:28.685562 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a569787-39f3-439c-a480-017b8dac7342 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:28.685880 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a569787-39f3-439c-a480-017b8dac7342 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:28.686161 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a569787-39f3-439c-a480-017b8dac7342 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:28.687013 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a569787-39f3-439c-a480-017b8dac7342 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:28.687328 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a569787-39f3-439c-a480-017b8dac7342 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:28.688782 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a569787-39f3-439c-a480-017b8dac7342 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:28.694048 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672b427-c1ea-4623-a7e2-19548a6840cb None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:28.709240 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 297/582] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Jun 29 12:08:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:28.714637 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a569787-39f3-439c-a480-017b8dac7342 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:28.729630 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f45bc48-d8f5-4548-bc0c-79aeb4fca6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:28.730543 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45bc48-d8f5-4548-bc0c-79aeb4fca6ec None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:28.730899 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45bc48-d8f5-4548-bc0c-79aeb4fca6ec None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:28.731236 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45bc48-d8f5-4548-bc0c-79aeb4fca6ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:28.742585 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f45bc48-d8f5-4548-bc0c-79aeb4fca6ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:28.744143 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f45bc48-d8f5-4548-bc0c-79aeb4fca6ec None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:28.761831 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-3f45bc48-d8f5-4548-bc0c-79aeb4fca6ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:28.761831 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:28.761831 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:28.761831 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:28.761831 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:28.761831 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:28.761831 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:28.761831 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:28.761831 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:28.761831 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:28.761831 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:28.761831 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:28.761831 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:28.761831 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:28.761831 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:28.762945 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:28.762945 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:28.762945 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:28.762945 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:28.762945 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:28.762945 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:28.762945 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:28.762945 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:28.762945 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:28.762945 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:28.762945 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:28.762945 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:28.762945 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:28.762945 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:28.762945 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:28.762945 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:28.762945 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:28.764077 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:28.764077 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:28.764077 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:28.764077 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:28.764627 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 286/583] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:28.765459 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f45bc48-d8f5-4548-bc0c-79aeb4fca6ec None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:28.830057 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a569787-39f3-439c-a480-017b8dac7342 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:28.866318 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249cd64d-7706-4124-8d85-c7ee9e17e2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:28.867247 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249cd64d-7706-4124-8d85-c7ee9e17e2b3 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:28.867597 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249cd64d-7706-4124-8d85-c7ee9e17e2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:28.867952 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249cd64d-7706-4124-8d85-c7ee9e17e2b3 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:28.868898 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249cd64d-7706-4124-8d85-c7ee9e17e2b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:28.869209 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249cd64d-7706-4124-8d85-c7ee9e17e2b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:28.870676 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249cd64d-7706-4124-8d85-c7ee9e17e2b3 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:28.870859 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f45bc48-d8f5-4548-bc0c-79aeb4fca6ec None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:28.885267 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 298/584] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jun 29 12:08:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:28.885923 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249cd64d-7706-4124-8d85-c7ee9e17e2b3 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:28.901104 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:28.912734 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55beedce-339c-447f-baef-e2acdd8eba5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:28.913712 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55beedce-339c-447f-baef-e2acdd8eba5a None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:28.913976 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55beedce-339c-447f-baef-e2acdd8eba5a None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:28.914404 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55beedce-339c-447f-baef-e2acdd8eba5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:28.921237 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:28.929593 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55beedce-339c-447f-baef-e2acdd8eba5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:28.931343 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55beedce-339c-447f-baef-e2acdd8eba5a None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:28.957289 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-55beedce-339c-447f-baef-e2acdd8eba5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:28.957289 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:28.957289 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:28.957289 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:28.957289 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:28.957289 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:28.957289 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:28.957289 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:28.957289 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:28.957289 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:28.957289 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:28.957289 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:28.957289 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:28.957289 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:28.957289 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:28.958792 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:28.958792 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:28.958792 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:28.958792 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:28.958792 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:28.958792 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:28.958792 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:28.958792 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:28.958792 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:28.958792 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:28.958792 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:28.958792 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:28.958792 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:28.958792 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:28.958792 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:28.958792 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:28.958792 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:28.960312 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:28.960312 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:28.960312 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:28.960312 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:28.960312 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 287/585] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:28.961227 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55beedce-339c-447f-baef-e2acdd8eba5a None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:29.010638 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249cd64d-7706-4124-8d85-c7ee9e17e2b3 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:29.056681 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a52478-5352-4e6e-81c3-6f0f12a49bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:29.057902 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a52478-5352-4e6e-81c3-6f0f12a49bc1 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:29.058189 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a52478-5352-4e6e-81c3-6f0f12a49bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:29.058466 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a52478-5352-4e6e-81c3-6f0f12a49bc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:29.071023 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a52478-5352-4e6e-81c3-6f0f12a49bc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:29.072485 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a52478-5352-4e6e-81c3-6f0f12a49bc1 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:29.085753 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55beedce-339c-447f-baef-e2acdd8eba5a None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:29.090359 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-c4a52478-5352-4e6e-81c3-6f0f12a49bc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:29.090359 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:29.090359 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:29.090359 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:29.090359 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:29.090359 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:29.090359 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:29.090359 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:29.090359 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:29.090359 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:29.090359 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:29.090359 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:29.090359 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:29.090359 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:29.090359 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:29.091601 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:29.091601 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:29.091601 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:29.091601 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:29.091601 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:29.091601 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:29.091601 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:29.091601 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:29.091601 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:29.091601 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:29.091601 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:29.091601 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:29.091601 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:29.091601 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:29.091601 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:29.091601 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:29.091601 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:29.092507 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:29.092507 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:29.092507 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:29.092507 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:29.092507 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 299/586] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:29.093167 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a52478-5352-4e6e-81c3-6f0f12a49bc1 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:29.125296 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1033252-4ec8-4b81-8c3e-ed4cd6984160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:29.125988 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1033252-4ec8-4b81-8c3e-ed4cd6984160 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:29.126267 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1033252-4ec8-4b81-8c3e-ed4cd6984160 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:29.126704 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1033252-4ec8-4b81-8c3e-ed4cd6984160 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:29.127253 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1033252-4ec8-4b81-8c3e-ed4cd6984160 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:29.127626 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1033252-4ec8-4b81-8c3e-ed4cd6984160 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:29.128983 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1033252-4ec8-4b81-8c3e-ed4cd6984160 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:29.140996 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 288/587] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:29.141861 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1033252-4ec8-4b81-8c3e-ed4cd6984160 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:29.188735 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:29.191324 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:29.212977 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a52478-5352-4e6e-81c3-6f0f12a49bc1 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:29.248439 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df570742-c029-42d8-86f7-98cab2c2fcb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:29.249328 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df570742-c029-42d8-86f7-98cab2c2fcb9 None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:29.249605 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df570742-c029-42d8-86f7-98cab2c2fcb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:29.249903 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df570742-c029-42d8-86f7-98cab2c2fcb9 None admin] PATH_INFO: `/v3/projects/996db30845f84e57865fa40b9a730a05/users/7adaa2ef440941aa8214f2b2fd49b54e/roles/6f63a9619c7b40ebb5b73bde026d606b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:29.252698 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1033252-4ec8-4b81-8c3e-ed4cd6984160 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:29.264544 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df570742-c029-42d8-86f7-98cab2c2fcb9 None admin] RBAC: Authorizing `identity:create_grant(project_id=996db30845f84e57865fa40b9a730a05, user_id=7adaa2ef440941aa8214f2b2fd49b54e, role_id=6f63a9619c7b40ebb5b73bde026d606b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:29.266067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df570742-c029-42d8-86f7-98cab2c2fcb9 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:29.279200 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 300/588] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jun 29 12:08:29 2022] PUT /identity/v3/projects/996db30845f84e57865fa40b9a730a05/users/7adaa2ef440941aa8214f2b2fd49b54e/roles/6f63a9619c7b40ebb5b73bde026d606b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:08:29.279992 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df570742-c029-42d8-86f7-98cab2c2fcb9 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:29.304183 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7058c21d-1d00-4890-a055-4d8b4614c2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:29.305324 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058c21d-1d00-4890-a055-4d8b4614c2bc None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:29.305896 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058c21d-1d00-4890-a055-4d8b4614c2bc None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:29.306376 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058c21d-1d00-4890-a055-4d8b4614c2bc None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:29.307369 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7058c21d-1d00-4890-a055-4d8b4614c2bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:29.307907 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7058c21d-1d00-4890-a055-4d8b4614c2bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:29.309571 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7058c21d-1d00-4890-a055-4d8b4614c2bc None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:29.328948 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 289/589] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:29.328948 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7058c21d-1d00-4890-a055-4d8b4614c2bc None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:29.415502 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df570742-c029-42d8-86f7-98cab2c2fcb9 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:29.450921 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:29.459061 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68711cb-609f-4bb9-b971-97ea78ba0eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:29.459983 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68711cb-609f-4bb9-b971-97ea78ba0eca None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:29.460576 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68711cb-609f-4bb9-b971-97ea78ba0eca None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:29.460990 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68711cb-609f-4bb9-b971-97ea78ba0eca None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:29.461938 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68711cb-609f-4bb9-b971-97ea78ba0eca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:29.462648 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68711cb-609f-4bb9-b971-97ea78ba0eca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:29.464573 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68711cb-609f-4bb9-b971-97ea78ba0eca None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:29.471149 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:29.474830 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7058c21d-1d00-4890-a055-4d8b4614c2bc None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:29.484073 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 301/590] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:29.484073 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68711cb-609f-4bb9-b971-97ea78ba0eca None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:29.528936 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cab13d-5160-49ec-bd51-7d6934d7074f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:29.529941 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cab13d-5160-49ec-bd51-7d6934d7074f None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:29.530325 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cab13d-5160-49ec-bd51-7d6934d7074f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:29.530699 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cab13d-5160-49ec-bd51-7d6934d7074f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:29.548805 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cab13d-5160-49ec-bd51-7d6934d7074f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:29.551210 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cab13d-5160-49ec-bd51-7d6934d7074f None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:29.572828 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-67cab13d-5160-49ec-bd51-7d6934d7074f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 12:08:29.572828 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:29.572828 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:29.572828 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:29.572828 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:29.572828 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:29.572828 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:29.572828 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:29.572828 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:29.572828 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:29.572828 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:29.572828 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:29.572828 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:08:29.572828 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:08:29.572828 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:08:29.572828 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:08:29.574072 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:29.574072 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:29.574072 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:08:29.574072 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:29.574072 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:08:29.574072 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:29.574072 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:29.574072 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:29.574072 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:29.574072 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:29.574072 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:29.574072 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:29.574072 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:29.574072 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:29.574072 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:29.574072 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:29.574072 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:29.574072 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:29.575202 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:29.575202 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:29.575202 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:08:29.575202 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:08:29.575202 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:08:29.575202 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:08:29.575202 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:08:29.575202 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:08:29.575202 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 12:08:29.575202 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:29.575202 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 290/591] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:08:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:29.575202 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cab13d-5160-49ec-bd51-7d6934d7074f None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:29.603018 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68711cb-609f-4bb9-b971-97ea78ba0eca None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:29.646606 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d098e5-83f5-4ced-a029-61be445f1678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:29.648052 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d098e5-83f5-4ced-a029-61be445f1678 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:29.648478 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d098e5-83f5-4ced-a029-61be445f1678 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:29.649393 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d098e5-83f5-4ced-a029-61be445f1678 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:29.659298 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d098e5-83f5-4ced-a029-61be445f1678 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:29.661333 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d098e5-83f5-4ced-a029-61be445f1678 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:29.682386 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-85d098e5-83f5-4ced-a029-61be445f1678 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 29 12:08:29.682386 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:29.682386 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:29.682386 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:29.682386 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:29.682386 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:29.682386 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:29.682386 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:29.682386 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:29.682386 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:29.682386 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:29.682386 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:29.682386 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:08:29.682386 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:08:29.682386 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:08:29.682386 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:08:29.683586 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:29.683586 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:29.683586 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:08:29.683586 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:29.683586 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:08:29.683586 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:29.683586 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:29.683586 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:29.683586 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:29.683586 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:29.683586 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:29.683586 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:29.683586 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:29.683586 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:29.683586 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:29.683586 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:29.683586 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:29.683586 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:29.684746 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:29.684746 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:29.684746 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:08:29.684746 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:08:29.684746 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:08:29.684746 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:08:29.684746 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:08:29.684746 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:08:29.684746 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 29 12:08:29.684746 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:29.687710 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 302/592] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jun 29 12:08:29 2022] GET /identity/v3/users/neutron => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:29.688734 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d098e5-83f5-4ced-a029-61be445f1678 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:29.691602 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cab13d-5160-49ec-bd51-7d6934d7074f None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:29.730027 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08363716-ef76-4294-9b70-22b4be1ab90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:29.730992 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08363716-ef76-4294-9b70-22b4be1ab90f None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:29.731292 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08363716-ef76-4294-9b70-22b4be1ab90f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:29.731666 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08363716-ef76-4294-9b70-22b4be1ab90f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:29.739865 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08363716-ef76-4294-9b70-22b4be1ab90f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:29.741605 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08363716-ef76-4294-9b70-22b4be1ab90f None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:29.756985 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-08363716-ef76-4294-9b70-22b4be1ab90f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:29.756985 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:29.756985 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:29.756985 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:29.756985 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:29.756985 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:29.756985 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:29.756985 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:29.756985 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:29.756985 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:29.756985 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:29.756985 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:29.756985 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:08:29.756985 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:08:29.756985 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:08:29.758176 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:08:29.758176 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:29.758176 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:29.758176 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:29.758176 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:29.758176 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:29.758176 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:29.758176 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:29.758176 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:29.758176 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:29.758176 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:29.758176 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:29.758176 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:29.758176 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:29.758176 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:29.758176 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:29.758176 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:29.759269 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:08:29.759269 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:08:29.759269 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:08:29.759269 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:08:29.759269 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:08:29.759269 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:08:29.759269 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:29.759269 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:29.765624 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 291/593] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jun 29 12:08:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:29.765624 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08363716-ef76-4294-9b70-22b4be1ab90f None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:29.770589 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:29.787179 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:29.842416 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d098e5-83f5-4ced-a029-61be445f1678 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:29.879782 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed54f8d-6356-469a-b8da-988e08cecb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:29.880687 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed54f8d-6356-469a-b8da-988e08cecb0b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:29.881068 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed54f8d-6356-469a-b8da-988e08cecb0b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:29.881449 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed54f8d-6356-469a-b8da-988e08cecb0b None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:29.882765 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed54f8d-6356-469a-b8da-988e08cecb0b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:29.883193 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed54f8d-6356-469a-b8da-988e08cecb0b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:29.884786 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed54f8d-6356-469a-b8da-988e08cecb0b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:29.891307 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08363716-ef76-4294-9b70-22b4be1ab90f None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:29.908245 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 303/594] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Jun 29 12:08:29 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:29.909275 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed54f8d-6356-469a-b8da-988e08cecb0b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:29.935428 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dca4a5-b610-4e8b-a3a4-52f56b06d483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:29.936742 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dca4a5-b610-4e8b-a3a4-52f56b06d483 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:29.937035 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dca4a5-b610-4e8b-a3a4-52f56b06d483 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:29.937309 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dca4a5-b610-4e8b-a3a4-52f56b06d483 None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:29.938432 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dca4a5-b610-4e8b-a3a4-52f56b06d483 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:29.938745 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dca4a5-b610-4e8b-a3a4-52f56b06d483 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:29.940887 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dca4a5-b610-4e8b-a3a4-52f56b06d483 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:29.965751 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 292/595] 10.222.0.27 () {56 vars in 1139 bytes} [Wed Jun 29 12:08:29 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:29.966611 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dca4a5-b610-4e8b-a3a4-52f56b06d483 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:30.037809 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed54f8d-6356-469a-b8da-988e08cecb0b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:30.048491 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:30.055290 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:30.078602 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dca4a5-b610-4e8b-a3a4-52f56b06d483 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:30.081994 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c31db1d-e9be-4e83-8ceb-4947806fbe59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:30.082679 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31db1d-e9be-4e83-8ceb-4947806fbe59 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:30.082960 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31db1d-e9be-4e83-8ceb-4947806fbe59 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:30.083231 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31db1d-e9be-4e83-8ceb-4947806fbe59 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:30.084034 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c31db1d-e9be-4e83-8ceb-4947806fbe59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:30.089576 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c31db1d-e9be-4e83-8ceb-4947806fbe59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:30.090975 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c31db1d-e9be-4e83-8ceb-4947806fbe59 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:30.112723 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 304/596] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jun 29 12:08:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:30.112723 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c31db1d-e9be-4e83-8ceb-4947806fbe59 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:30.133584 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ff532-eb87-4206-8f56-f8958b40fec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:30.134643 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ff532-eb87-4206-8f56-f8958b40fec4 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:30.135028 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ff532-eb87-4206-8f56-f8958b40fec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:30.135604 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ff532-eb87-4206-8f56-f8958b40fec4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:30.146311 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ff532-eb87-4206-8f56-f8958b40fec4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:30.147960 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ff532-eb87-4206-8f56-f8958b40fec4 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:30.166885 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-9f7ff532-eb87-4206-8f56-f8958b40fec4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:30.166885 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:30.166885 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:30.166885 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:30.166885 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:30.166885 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:30.166885 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:30.166885 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:30.166885 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:30.166885 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:30.166885 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:30.166885 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:30.166885 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:30.166885 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:30.166885 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:30.168034 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:30.168034 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:30.168034 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:30.168034 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:30.168034 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:30.168034 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:30.168034 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:30.168034 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:30.168034 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:30.168034 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:30.168034 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:30.168034 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:30.168034 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:30.168034 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:30.168034 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:30.168034 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:30.168034 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:30.169192 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:30.169192 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:30.169192 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:30.169192 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:30.175364 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 293/597] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:30.176299 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ff532-eb87-4206-8f56-f8958b40fec4 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:30.234018 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c31db1d-e9be-4e83-8ceb-4947806fbe59 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:30.269103 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1213dc8-5ee2-4f4c-8171-54eb7938d18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:30.270035 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1213dc8-5ee2-4f4c-8171-54eb7938d18d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:30.270241 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1213dc8-5ee2-4f4c-8171-54eb7938d18d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:30.270466 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1213dc8-5ee2-4f4c-8171-54eb7938d18d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:30.282343 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1213dc8-5ee2-4f4c-8171-54eb7938d18d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:30.283789 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1213dc8-5ee2-4f4c-8171-54eb7938d18d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:30.290104 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ff532-eb87-4206-8f56-f8958b40fec4 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:30.301961 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-f1213dc8-5ee2-4f4c-8171-54eb7938d18d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:30.301961 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:30.301961 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:30.301961 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:30.301961 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:30.301961 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:30.301961 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:30.301961 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:30.301961 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:30.301961 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:30.301961 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:30.301961 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:30.301961 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:30.301961 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:30.301961 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:30.303135 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:30.303135 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:30.303135 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:30.303135 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:30.303135 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:30.303135 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:30.303135 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:30.303135 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:30.303135 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:30.303135 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:30.303135 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:30.303135 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:30.303135 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:30.303135 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:30.303135 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:30.303135 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:30.303135 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:30.304352 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:30.304352 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:30.304352 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:30.304352 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:30.305199 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 305/598] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:30.310421 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1213dc8-5ee2-4f4c-8171-54eb7938d18d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:30.323986 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:30.330924 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba2fa66-1665-4e4d-86a8-1d747a496488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:30.331828 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2fa66-1665-4e4d-86a8-1d747a496488 None admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:30.332138 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2fa66-1665-4e4d-86a8-1d747a496488 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:30.332398 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2fa66-1665-4e4d-86a8-1d747a496488 None admin] PATH_INFO: `/v3/projects/996db30845f84e57865fa40b9a730a05/users/d865d1b935a54ca2b44beda5b0277336/roles/6f63a9619c7b40ebb5b73bde026d606b` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:30.338537 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:30.347647 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba2fa66-1665-4e4d-86a8-1d747a496488 None admin] RBAC: Authorizing `identity:create_grant(project_id=996db30845f84e57865fa40b9a730a05, user_id=d865d1b935a54ca2b44beda5b0277336, role_id=6f63a9619c7b40ebb5b73bde026d606b)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:30.349108 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba2fa66-1665-4e4d-86a8-1d747a496488 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:30.364877 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 294/599] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jun 29 12:08:30 2022] PUT /identity/v3/projects/996db30845f84e57865fa40b9a730a05/users/d865d1b935a54ca2b44beda5b0277336/roles/6f63a9619c7b40ebb5b73bde026d606b => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:08:30.366551 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc85c5f-b0a6-45c6-a5aa-843de3d8124d None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:30.367037 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc85c5f-b0a6-45c6-a5aa-843de3d8124d None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:30.367489 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc85c5f-b0a6-45c6-a5aa-843de3d8124d None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:30.369342 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 295/600] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:08:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:30.370506 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc85c5f-b0a6-45c6-a5aa-843de3d8124d None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:30.461048 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1213dc8-5ee2-4f4c-8171-54eb7938d18d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:30.496993 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc85c5f-b0a6-45c6-a5aa-843de3d8124d None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:30.512295 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08fa0c0-c98f-4f16-8226-2e91e0436841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:30.513270 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08fa0c0-c98f-4f16-8226-2e91e0436841 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:30.513567 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08fa0c0-c98f-4f16-8226-2e91e0436841 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:30.513898 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08fa0c0-c98f-4f16-8226-2e91e0436841 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:30.514650 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08fa0c0-c98f-4f16-8226-2e91e0436841 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:30.514968 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08fa0c0-c98f-4f16-8226-2e91e0436841 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:30.516693 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08fa0c0-c98f-4f16-8226-2e91e0436841 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:30.535970 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 306/601] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:30.537313 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7eb448-4019-40a6-a5aa-a3b467e6724e None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:30.537671 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7eb448-4019-40a6-a5aa-a3b467e6724e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:30.538028 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7eb448-4019-40a6-a5aa-a3b467e6724e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:30.547407 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb6858-96f3-436a-9672-7c06c919fa5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:30.548382 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb6858-96f3-436a-9672-7c06c919fa5f None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:30.548878 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb6858-96f3-436a-9672-7c06c919fa5f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:30.549454 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb6858-96f3-436a-9672-7c06c919fa5f None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:30.550289 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb6858-96f3-436a-9672-7c06c919fa5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:30.550596 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb6858-96f3-436a-9672-7c06c919fa5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:30.551987 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb6858-96f3-436a-9672-7c06c919fa5f None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:30.556091 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-6d7eb448-4019-40a6-a5aa-a3b467e6724e None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:30.557297 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6d7eb448-4019-40a6-a5aa-a3b467e6724e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:30.568037 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 296/602] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:30.569154 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb6858-96f3-436a-9672-7c06c919fa5f None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:30.615863 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:30.646169 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 307/603] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:08:30.646823 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7eb448-4019-40a6-a5aa-a3b467e6724e None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:30.669996 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:30.678885 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb6858-96f3-436a-9672-7c06c919fa5f None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:30.715933 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2dc3da-70d1-4f3f-93ac-18a7b7c7c6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:30.717109 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2dc3da-70d1-4f3f-93ac-18a7b7c7c6d8 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:30.717591 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2dc3da-70d1-4f3f-93ac-18a7b7c7c6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:30.718087 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2dc3da-70d1-4f3f-93ac-18a7b7c7c6d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:30.725741 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2dc3da-70d1-4f3f-93ac-18a7b7c7c6d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:30.727729 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2dc3da-70d1-4f3f-93ac-18a7b7c7c6d8 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:30.742669 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-5d2dc3da-70d1-4f3f-93ac-18a7b7c7c6d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:30.742669 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:30.742669 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:30.742669 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:30.742669 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:30.742669 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:30.742669 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:30.742669 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:30.742669 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:30.742669 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:30.742669 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:30.742669 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:30.742669 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:08:30.742669 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:08:30.742669 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:08:30.743601 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:08:30.743601 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:30.743601 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:30.743601 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:30.743601 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:30.743601 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:30.743601 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:30.743601 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:30.743601 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:30.743601 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:30.743601 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:30.743601 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:30.743601 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:30.743601 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:30.743601 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:30.743601 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:30.743601 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:30.744522 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:08:30.744522 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:08:30.744522 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:08:30.744522 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:08:30.744522 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:08:30.744522 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:08:30.744522 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:30.744522 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:30.747060 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 297/604] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jun 29 12:08:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:30.748047 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2dc3da-70d1-4f3f-93ac-18a7b7c7c6d8 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:30.790711 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7eb448-4019-40a6-a5aa-a3b467e6724e None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:30.828726 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f483357-84ce-41c0-821c-a2bc1b70274e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:30.829528 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f483357-84ce-41c0-821c-a2bc1b70274e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:30.829844 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f483357-84ce-41c0-821c-a2bc1b70274e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:30.830117 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f483357-84ce-41c0-821c-a2bc1b70274e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:30.837725 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f483357-84ce-41c0-821c-a2bc1b70274e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:30.839208 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f483357-84ce-41c0-821c-a2bc1b70274e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:30.854149 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-1f483357-84ce-41c0-821c-a2bc1b70274e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:30.854149 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:30.854149 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:30.854149 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:30.854149 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:30.854149 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:30.854149 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:30.854149 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:30.854149 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:30.854149 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:30.854149 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:30.854149 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:30.854149 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:08:30.854149 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:08:30.854149 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:08:30.855126 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:08:30.855126 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:30.855126 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:30.855126 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:30.855126 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:30.855126 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:30.855126 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:30.855126 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:30.855126 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:30.855126 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:30.855126 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:30.855126 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:30.855126 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:30.855126 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:30.855126 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:30.855126 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:30.855126 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:30.856053 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:08:30.856053 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:08:30.856053 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:08:30.856053 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:08:30.856053 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:08:30.856053 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:08:30.856053 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:30.856053 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:30.856053 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 308/605] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jun 29 12:08:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:30.857025 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f483357-84ce-41c0-821c-a2bc1b70274e None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:30.875774 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:30.879352 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2dc3da-70d1-4f3f-93ac-18a7b7c7c6d8 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:30.916185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a596e9-1ffa-4e28-a724-e19759ea3be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:30.917460 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a596e9-1ffa-4e28-a724-e19759ea3be2 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:30.917970 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a596e9-1ffa-4e28-a724-e19759ea3be2 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:30.918472 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a596e9-1ffa-4e28-a724-e19759ea3be2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:30.929871 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a596e9-1ffa-4e28-a724-e19759ea3be2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:08:30.937766 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:30.938388 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-94a596e9-1ffa-4e28-a724-e19759ea3be2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:08:30.938388 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:30.938388 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:30.938388 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:30.938388 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:30.938388 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:30.938388 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:30.938388 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:30.938388 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:30.938388 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:30.938388 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:30.938388 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:30.938388 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:08:30.938388 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:08:30.938388 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:08:30.938388 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:08:30.939290 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:08:30.939290 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:08:30.939290 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:08:30.939290 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:08:30.939290 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:30.939290 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:30.939290 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:30.939290 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:30.939290 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:30.939290 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:30.939290 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:30.939290 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:30.939290 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:30.939290 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:30.939290 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:30.939290 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:30.940185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:30.940185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:30.940185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:30.940185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:30.940185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:08:30.940185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:08:30.940185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:08:30.940185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:08:30.940185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:08:30.940185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:08:30.940185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:08:30.940185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:30.943031 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 298/606] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jun 29 12:08:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:30.944025 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a596e9-1ffa-4e28-a724-e19759ea3be2 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:30.978888 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f483357-84ce-41c0-821c-a2bc1b70274e None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:31.016588 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8034d5c0-d94e-4cf1-9c10-a647e52d7463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:31.017258 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034d5c0-d94e-4cf1-9c10-a647e52d7463 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:31.017543 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034d5c0-d94e-4cf1-9c10-a647e52d7463 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:31.017870 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034d5c0-d94e-4cf1-9c10-a647e52d7463 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:31.018675 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8034d5c0-d94e-4cf1-9c10-a647e52d7463 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:31.018984 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8034d5c0-d94e-4cf1-9c10-a647e52d7463 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:31.020955 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8034d5c0-d94e-4cf1-9c10-a647e52d7463 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:31.041910 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 309/607] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jun 29 12:08:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:31.042858 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8034d5c0-d94e-4cf1-9c10-a647e52d7463 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:31.054156 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a596e9-1ffa-4e28-a724-e19759ea3be2 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:31.090165 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad7e1db-a6c4-4fb0-9354-79b04f2dca32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:31.091188 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7e1db-a6c4-4fb0-9354-79b04f2dca32 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:31.091668 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7e1db-a6c4-4fb0-9354-79b04f2dca32 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:31.092138 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7e1db-a6c4-4fb0-9354-79b04f2dca32 None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:31.093191 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad7e1db-a6c4-4fb0-9354-79b04f2dca32 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:31.093854 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad7e1db-a6c4-4fb0-9354-79b04f2dca32 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:31.095560 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad7e1db-a6c4-4fb0-9354-79b04f2dca32 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:31.113184 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 299/608] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jun 29 12:08:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:31.114952 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad7e1db-a6c4-4fb0-9354-79b04f2dca32 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:31.154003 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:31.156182 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8034d5c0-d94e-4cf1-9c10-a647e52d7463 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:31.188011 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:31.193270 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4dc22a-23c5-4008-9e75-510a48906f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:31.194604 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4dc22a-23c5-4008-9e75-510a48906f2e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:31.195593 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4dc22a-23c5-4008-9e75-510a48906f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:31.195593 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4dc22a-23c5-4008-9e75-510a48906f2e None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:31.196356 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4dc22a-23c5-4008-9e75-510a48906f2e None admin] RBAC: Adding query filter params (name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:31.197124 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4dc22a-23c5-4008-9e75-510a48906f2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:31.199129 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4dc22a-23c5-4008-9e75-510a48906f2e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:31.213111 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 310/609] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jun 29 12:08:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:31.214034 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4dc22a-23c5-4008-9e75-510a48906f2e None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:31.255960 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad7e1db-a6c4-4fb0-9354-79b04f2dca32 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:31.293329 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877abff-9da8-4c47-8b48-8ec3da1c8d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:31.294619 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877abff-9da8-4c47-8b48-8ec3da1c8d28 None admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:31.295101 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877abff-9da8-4c47-8b48-8ec3da1c8d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:31.295695 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877abff-9da8-4c47-8b48-8ec3da1c8d28 None admin] PATH_INFO: `/v3/projects/996db30845f84e57865fa40b9a730a05/users/f72f0602e17f4ab4a48e3aaa7022d28d/roles/6f63a9619c7b40ebb5b73bde026d606b` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:31.312400 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3877abff-9da8-4c47-8b48-8ec3da1c8d28 None admin] RBAC: Authorizing `identity:create_grant(project_id=996db30845f84e57865fa40b9a730a05, user_id=f72f0602e17f4ab4a48e3aaa7022d28d, role_id=6f63a9619c7b40ebb5b73bde026d606b)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:31.314884 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3877abff-9da8-4c47-8b48-8ec3da1c8d28 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:31.322526 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4dc22a-23c5-4008-9e75-510a48906f2e None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:31.333299 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 300/610] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jun 29 12:08:31 2022] PUT /identity/v3/projects/996db30845f84e57865fa40b9a730a05/users/f72f0602e17f4ab4a48e3aaa7022d28d/roles/6f63a9619c7b40ebb5b73bde026d606b => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:08:31.335000 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877abff-9da8-4c47-8b48-8ec3da1c8d28 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:31.372215 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54270da1-1ca9-4194-92c9-3facd410c999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:31.373043 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54270da1-1ca9-4194-92c9-3facd410c999 None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:31.373726 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54270da1-1ca9-4194-92c9-3facd410c999 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:31.373726 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54270da1-1ca9-4194-92c9-3facd410c999 None admin] PATH_INFO: `/v3/projects/996db30845f84e57865fa40b9a730a05/users/e94618bb382d46f7aaa2ef8f5d690bf2/roles/6f63a9619c7b40ebb5b73bde026d606b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:31.415090 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54270da1-1ca9-4194-92c9-3facd410c999 None admin] RBAC: Authorizing `identity:create_grant(project_id=996db30845f84e57865fa40b9a730a05, user_id=e94618bb382d46f7aaa2ef8f5d690bf2, role_id=6f63a9619c7b40ebb5b73bde026d606b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:31.416594 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54270da1-1ca9-4194-92c9-3facd410c999 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:31.448431 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 311/611] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jun 29 12:08:31 2022] PUT /identity/v3/projects/996db30845f84e57865fa40b9a730a05/users/e94618bb382d46f7aaa2ef8f5d690bf2/roles/6f63a9619c7b40ebb5b73bde026d606b => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:08:31.457411 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365760a7-d27a-480c-a128-c4baa60b8087 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:31.457758 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365760a7-d27a-480c-a128-c4baa60b8087 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:31.458006 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365760a7-d27a-480c-a128-c4baa60b8087 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:31.459804 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 312/612] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:08:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:31.468263 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a85786-0965-4770-9402-7e26c1c2e5f4 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:31.468704 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a85786-0965-4770-9402-7e26c1c2e5f4 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:31.469109 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a85786-0965-4770-9402-7e26c1c2e5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:31.491934 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c7a85786-0965-4770-9402-7e26c1c2e5f4 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:31.493610 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c7a85786-0965-4770-9402-7e26c1c2e5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:31.500042 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:31.551077 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877abff-9da8-4c47-8b48-8ec3da1c8d28 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:31.567568 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:31.608920 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a70eca8-0075-45fb-a252-67f8ac8a8ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:31.610285 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70eca8-0075-45fb-a252-67f8ac8a8ae3 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:31.610807 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70eca8-0075-45fb-a252-67f8ac8a8ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:31.611290 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70eca8-0075-45fb-a252-67f8ac8a8ae3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:31.611900 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 313/613] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 12:08:31.630080 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a70eca8-0075-45fb-a252-67f8ac8a8ae3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:31.631670 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a70eca8-0075-45fb-a252-67f8ac8a8ae3 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:31.640128 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a85786-0965-4770-9402-7e26c1c2e5f4 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:31.657909 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-3a70eca8-0075-45fb-a252-67f8ac8a8ae3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:31.657909 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:31.657909 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:31.657909 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:31.657909 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:31.657909 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:31.657909 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:31.657909 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:31.657909 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:31.657909 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:31.657909 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:31.657909 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:31.657909 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:31.657909 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:31.657909 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:31.659055 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:31.659055 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:31.659055 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:31.659055 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:31.659055 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:31.659055 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:31.659055 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:31.659055 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:31.659055 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:31.659055 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:31.659055 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:31.659055 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:31.659055 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:31.659055 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:31.659055 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:31.659055 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:31.659055 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:31.660138 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:31.660138 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:31.660138 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:31.660138 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:31.662233 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 301/614] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:31.671073 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a70eca8-0075-45fb-a252-67f8ac8a8ae3 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:31.752234 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a85786-0965-4770-9402-7e26c1c2e5f4 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:31.791232 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d32ab2-7a9d-426a-a8ce-68280938fe4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:31.792965 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d32ab2-7a9d-426a-a8ce-68280938fe4c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:31.792965 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d32ab2-7a9d-426a-a8ce-68280938fe4c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:31.793301 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d32ab2-7a9d-426a-a8ce-68280938fe4c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:31.810166 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d32ab2-7a9d-426a-a8ce-68280938fe4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:08:31.813967 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-d0d32ab2-7a9d-426a-a8ce-68280938fe4c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:08:31.813967 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:31.813967 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:31.813967 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:31.813967 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:31.813967 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:31.813967 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:31.813967 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:31.813967 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:31.813967 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:31.813967 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:31.813967 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:31.813967 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:08:31.813967 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:08:31.813967 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:08:31.813967 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:08:31.815120 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:08:31.815120 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:08:31.815120 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:08:31.815120 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:08:31.815120 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:31.815120 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:31.815120 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:31.815120 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:31.815120 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:31.815120 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:31.815120 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:31.815120 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:31.815120 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:31.815120 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:31.815120 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:31.815120 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:31.816181 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:31.816181 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:31.816181 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:31.816181 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:31.816181 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:08:31.816181 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:08:31.816181 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:08:31.816181 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:08:31.816181 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:08:31.816181 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:08:31.816181 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:08:31.816181 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:31.818048 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 314/615] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jun 29 12:08:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:08:31.838264 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d32ab2-7a9d-426a-a8ce-68280938fe4c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:31.871214 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a70eca8-0075-45fb-a252-67f8ac8a8ae3 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:31.878076 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:31.931884 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:31.956383 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59487b3a-3445-41ff-b101-359c96c54d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:31.957019 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d32ab2-7a9d-426a-a8ce-68280938fe4c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:31.957134 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59487b3a-3445-41ff-b101-359c96c54d28 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:31.957313 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59487b3a-3445-41ff-b101-359c96c54d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:31.957577 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59487b3a-3445-41ff-b101-359c96c54d28 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:31.958349 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59487b3a-3445-41ff-b101-359c96c54d28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:31.958651 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59487b3a-3445-41ff-b101-359c96c54d28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:31.960229 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59487b3a-3445-41ff-b101-359c96c54d28 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:31.984296 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 302/616] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:31.989606 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59487b3a-3445-41ff-b101-359c96c54d28 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:31.997368 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e78ee-9ffa-49bc-8a35-ca1475b981e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:31.998513 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e78ee-9ffa-49bc-8a35-ca1475b981e0 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:31.998996 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e78ee-9ffa-49bc-8a35-ca1475b981e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:31.999467 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e78ee-9ffa-49bc-8a35-ca1475b981e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:32.000423 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e78ee-9ffa-49bc-8a35-ca1475b981e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:32.000943 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e78ee-9ffa-49bc-8a35-ca1475b981e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:32.002614 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e78ee-9ffa-49bc-8a35-ca1475b981e0 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:32.013669 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 315/617] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jun 29 12:08:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:08:32.019534 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e78ee-9ffa-49bc-8a35-ca1475b981e0 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:32.119443 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59487b3a-3445-41ff-b101-359c96c54d28 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:32.157984 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33f751e-f69a-4a2e-8aa9-ccf60bd3aa3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:32.159644 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f751e-f69a-4a2e-8aa9-ccf60bd3aa3a None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:32.160129 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f751e-f69a-4a2e-8aa9-ccf60bd3aa3a None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:32.160599 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f751e-f69a-4a2e-8aa9-ccf60bd3aa3a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:32.169360 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33f751e-f69a-4a2e-8aa9-ccf60bd3aa3a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:32.171296 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33f751e-f69a-4a2e-8aa9-ccf60bd3aa3a None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:32.188245 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-a33f751e-f69a-4a2e-8aa9-ccf60bd3aa3a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 29 12:08:32.188245 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:32.188245 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:32.188245 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:32.188245 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:32.188245 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:32.188245 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:32.188245 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:32.188245 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:32.188245 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:32.188245 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:32.188245 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:32.188245 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:08:32.188245 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:08:32.188245 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:08:32.188245 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:08:32.189217 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:32.189217 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:32.189217 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:08:32.189217 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:32.189217 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:08:32.189217 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:32.189217 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:32.189217 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:32.189217 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:32.189217 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:32.189217 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:32.189217 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:32.189217 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:32.189217 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:32.189217 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:32.189217 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:32.189217 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:32.189217 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:32.190579 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:32.190579 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:32.190579 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:08:32.190579 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:08:32.190579 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:08:32.190579 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:08:32.190579 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:08:32.190579 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:08:32.190579 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 29 12:08:32.190579 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:32.193152 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 303/618] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jun 29 12:08:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:32.200733 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33f751e-f69a-4a2e-8aa9-ccf60bd3aa3a None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:32.254100 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:32.261706 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e78ee-9ffa-49bc-8a35-ca1475b981e0 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:32.279460 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:32.322715 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179d286-fdfa-42c4-8729-64787d8da39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:32.323530 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179d286-fdfa-42c4-8729-64787d8da39b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:32.323811 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179d286-fdfa-42c4-8729-64787d8da39b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:32.324078 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179d286-fdfa-42c4-8729-64787d8da39b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:32.344743 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7179d286-fdfa-42c4-8729-64787d8da39b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:32.346260 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7179d286-fdfa-42c4-8729-64787d8da39b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:32.372582 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-7179d286-fdfa-42c4-8729-64787d8da39b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:32.372582 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:32.372582 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:32.372582 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:32.372582 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:32.372582 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:32.372582 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:32.372582 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:32.372582 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:32.372582 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:32.372582 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:32.372582 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:32.372582 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:32.372582 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:32.372582 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:32.373557 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:32.373557 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:32.373557 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:32.373557 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:32.373557 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:32.373557 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:32.373557 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:32.373557 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:32.373557 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:32.373557 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:32.373557 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:32.373557 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:32.373557 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:32.373557 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:32.373557 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:32.373557 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:32.373557 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:32.374643 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:32.374643 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:32.374643 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:32.374643 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:32.375530 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 316/619] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:32.383849 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179d286-fdfa-42c4-8729-64787d8da39b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:32.386277 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33f751e-f69a-4a2e-8aa9-ccf60bd3aa3a None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:32.453355 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7485b46-e69a-471e-97b9-36fa3d05b34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:32.453977 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7485b46-e69a-471e-97b9-36fa3d05b34b None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:32.454258 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7485b46-e69a-471e-97b9-36fa3d05b34b None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:32.454535 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7485b46-e69a-471e-97b9-36fa3d05b34b None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:32.455390 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7485b46-e69a-471e-97b9-36fa3d05b34b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:32.455703 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7485b46-e69a-471e-97b9-36fa3d05b34b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:32.457154 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7485b46-e69a-471e-97b9-36fa3d05b34b None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:32.490987 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 304/620] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Jun 29 12:08:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:32.494161 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7485b46-e69a-471e-97b9-36fa3d05b34b None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:32.558327 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179d286-fdfa-42c4-8729-64787d8da39b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:32.609397 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e28082-c39e-4c05-865a-151bee947dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:32.611583 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e28082-c39e-4c05-865a-151bee947dc1 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:32.613972 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e28082-c39e-4c05-865a-151bee947dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:32.615252 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e28082-c39e-4c05-865a-151bee947dc1 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:32.617791 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e28082-c39e-4c05-865a-151bee947dc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:32.618511 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e28082-c39e-4c05-865a-151bee947dc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:32.621863 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e28082-c39e-4c05-865a-151bee947dc1 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:32.645098 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 317/621] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:32.651384 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e28082-c39e-4c05-865a-151bee947dc1 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:32.670119 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:32.705725 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:32.708544 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7485b46-e69a-471e-97b9-36fa3d05b34b None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:32.745224 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe32824-3be4-485f-b95d-6d7f763bf8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:32.746230 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe32824-3be4-485f-b95d-6d7f763bf8c4 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:32.746607 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe32824-3be4-485f-b95d-6d7f763bf8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:32.746972 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe32824-3be4-485f-b95d-6d7f763bf8c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:32.757913 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe32824-3be4-485f-b95d-6d7f763bf8c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:32.759794 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe32824-3be4-485f-b95d-6d7f763bf8c4 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:32.772213 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e28082-c39e-4c05-865a-151bee947dc1 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:32.778085 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-6fe32824-3be4-485f-b95d-6d7f763bf8c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:32.778085 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:32.778085 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:32.778085 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:32.778085 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:32.778085 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:32.778085 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:32.778085 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:32.778085 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:32.778085 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:32.778085 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:32.778085 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:32.778085 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:32.778085 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:32.778085 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:32.779183 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:32.779183 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:32.779183 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:32.779183 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:32.779183 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:32.779183 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:32.779183 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:32.779183 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:32.779183 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:32.779183 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:32.779183 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:32.779183 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:32.779183 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:32.779183 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:32.779183 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:32.779183 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:32.779183 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:32.780288 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:32.780288 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:32.780288 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:32.780288 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:32.781905 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 305/622] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:32.783330 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac097430-7fec-475f-867b-0a47f320ad20 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:32.783879 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac097430-7fec-475f-867b-0a47f320ad20 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:32.784151 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac097430-7fec-475f-867b-0a47f320ad20 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:32.791400 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 306/623] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:08:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:32.791400 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac097430-7fec-475f-867b-0a47f320ad20 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:32.821947 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95716dc-da2a-47e7-b1e0-5e481b00e396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:32.822749 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95716dc-da2a-47e7-b1e0-5e481b00e396 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:32.823020 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95716dc-da2a-47e7-b1e0-5e481b00e396 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:32.823291 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95716dc-da2a-47e7-b1e0-5e481b00e396 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:32.832126 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95716dc-da2a-47e7-b1e0-5e481b00e396 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:32.833564 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95716dc-da2a-47e7-b1e0-5e481b00e396 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:32.849859 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-b95716dc-da2a-47e7-b1e0-5e481b00e396 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 12:08:32.849859 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:32.849859 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:32.849859 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:32.849859 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:32.849859 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:32.849859 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:32.849859 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:32.849859 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:32.849859 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:32.849859 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:32.849859 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:32.849859 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:08:32.849859 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:08:32.849859 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:08:32.849859 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:08:32.850983 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:32.850983 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:32.850983 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:08:32.850983 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:32.850983 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:08:32.850983 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:32.850983 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:32.850983 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:32.850983 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:32.850983 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:32.850983 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:32.850983 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:32.850983 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:32.850983 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:32.850983 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:32.850983 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:32.850983 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:32.850983 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:32.852166 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:32.852166 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:32.852166 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:08:32.852166 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:08:32.852166 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:08:32.852166 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:08:32.852166 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:08:32.852166 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:08:32.852166 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 12:08:32.852166 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:32.854837 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 318/624] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Jun 29 12:08:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:32.856217 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740caf1-4b2e-43a3-ab6a-511fc56da806 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:32.856638 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740caf1-4b2e-43a3-ab6a-511fc56da806 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:32.857037 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740caf1-4b2e-43a3-ab6a-511fc56da806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:32.874281 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-0740caf1-4b2e-43a3-ab6a-511fc56da806 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:32.875693 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0740caf1-4b2e-43a3-ab6a-511fc56da806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:32.916234 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac097430-7fec-475f-867b-0a47f320ad20 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:32.948800 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:32.961782 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 319/625] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:08:32.961782 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0740caf1-4b2e-43a3-ab6a-511fc56da806 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:32.977421 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ed1ef-8666-47c2-b8bd-1a66b6393255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:32.979570 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ed1ef-8666-47c2-b8bd-1a66b6393255 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:32.979764 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ed1ef-8666-47c2-b8bd-1a66b6393255 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:32.980000 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ed1ef-8666-47c2-b8bd-1a66b6393255 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:32.981667 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ed1ef-8666-47c2-b8bd-1a66b6393255 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:32.982004 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ed1ef-8666-47c2-b8bd-1a66b6393255 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:32.984844 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ed1ef-8666-47c2-b8bd-1a66b6393255 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:33.001116 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 307/626] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:33.002048 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ed1ef-8666-47c2-b8bd-1a66b6393255 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:33.018569 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:33.091093 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0740caf1-4b2e-43a3-ab6a-511fc56da806 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:33.127079 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ed1ef-8666-47c2-b8bd-1a66b6393255 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:33.136923 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef6811-fc12-45a5-b0de-66bbaac81ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:33.137861 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef6811-fc12-45a5-b0de-66bbaac81ede None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:33.139533 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef6811-fc12-45a5-b0de-66bbaac81ede None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:33.139821 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef6811-fc12-45a5-b0de-66bbaac81ede None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:33.140673 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aef6811-fc12-45a5-b0de-66bbaac81ede None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:33.140982 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aef6811-fc12-45a5-b0de-66bbaac81ede None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:33.142508 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aef6811-fc12-45a5-b0de-66bbaac81ede None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:33.165838 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 320/627] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Jun 29 12:08:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:33.165838 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef6811-fc12-45a5-b0de-66bbaac81ede None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:33.186578 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1da18c-c2a0-4f97-bd6d-6f87b1d8ffd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:33.188362 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1da18c-c2a0-4f97-bd6d-6f87b1d8ffd4 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:33.189169 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1da18c-c2a0-4f97-bd6d-6f87b1d8ffd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:33.189640 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1da18c-c2a0-4f97-bd6d-6f87b1d8ffd4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:33.206516 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1da18c-c2a0-4f97-bd6d-6f87b1d8ffd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:08:33.217448 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-1c1da18c-c2a0-4f97-bd6d-6f87b1d8ffd4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:08:33.217448 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:33.217448 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:33.217448 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:33.217448 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:33.217448 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:33.217448 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:33.217448 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:33.217448 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:33.217448 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:33.217448 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:33.217448 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:33.217448 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:08:33.217448 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:08:33.217448 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:08:33.217448 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:08:33.218456 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:08:33.218456 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:08:33.218456 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:08:33.218456 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:08:33.218456 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:33.218456 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:33.218456 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:33.218456 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:33.218456 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:33.218456 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:33.218456 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:33.218456 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:33.218456 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:33.218456 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:33.218456 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:33.218456 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:33.219320 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:33.219320 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:33.219320 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:33.219320 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:33.219320 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:08:33.219320 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:08:33.219320 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:08:33.219320 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:08:33.219320 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:08:33.219320 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:08:33.219320 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:08:33.219320 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:33.227817 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 308/628] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jun 29 12:08:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:33.227817 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1da18c-c2a0-4f97-bd6d-6f87b1d8ffd4 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:33.234479 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:33.288122 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef6811-fc12-45a5-b0de-66bbaac81ede None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:33.305161 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:33.330911 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fafcc3d-0c62-47a7-a492-298ec3989049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:33.332126 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fafcc3d-0c62-47a7-a492-298ec3989049 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:33.332609 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fafcc3d-0c62-47a7-a492-298ec3989049 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:33.333107 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fafcc3d-0c62-47a7-a492-298ec3989049 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:33.340684 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1da18c-c2a0-4f97-bd6d-6f87b1d8ffd4 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:33.341883 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fafcc3d-0c62-47a7-a492-298ec3989049 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:33.343691 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fafcc3d-0c62-47a7-a492-298ec3989049 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:33.359812 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-7fafcc3d-0c62-47a7-a492-298ec3989049 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:33.359812 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:33.359812 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:33.359812 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:33.359812 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:33.359812 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:33.359812 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:33.359812 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:33.359812 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:33.359812 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:33.359812 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:33.359812 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:33.359812 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:08:33.359812 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:08:33.359812 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:08:33.360779 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:08:33.360779 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:33.360779 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:33.360779 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:33.360779 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:33.360779 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:33.360779 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:33.360779 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:33.360779 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:33.360779 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:33.360779 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:33.360779 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:33.360779 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:33.360779 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:33.360779 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:33.360779 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:33.360779 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:33.361687 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:08:33.361687 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:08:33.361687 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:08:33.361687 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:08:33.361687 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:08:33.361687 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:08:33.361687 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:33.361687 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:33.364372 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 321/629] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jun 29 12:08:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:33.365494 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fafcc3d-0c62-47a7-a492-298ec3989049 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:33.376452 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10d347-70ea-4e01-9985-198724705bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:33.377090 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10d347-70ea-4e01-9985-198724705bff None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:33.377370 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10d347-70ea-4e01-9985-198724705bff None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:33.377646 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10d347-70ea-4e01-9985-198724705bff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:33.453383 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa10d347-70ea-4e01-9985-198724705bff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:33.455026 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa10d347-70ea-4e01-9985-198724705bff None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:33.478591 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fafcc3d-0c62-47a7-a492-298ec3989049 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:33.497392 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:33.525544 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb843b3-4772-44c9-a4bf-fa42423fce5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:33.526712 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb843b3-4772-44c9-a4bf-fa42423fce5e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:33.527211 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb843b3-4772-44c9-a4bf-fa42423fce5e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:33.527691 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb843b3-4772-44c9-a4bf-fa42423fce5e None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:33.528734 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb843b3-4772-44c9-a4bf-fa42423fce5e None admin] RBAC: Adding query filter params (name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:33.529317 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb843b3-4772-44c9-a4bf-fa42423fce5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:33.530932 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb843b3-4772-44c9-a4bf-fa42423fce5e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:33.533059 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:33.547824 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 322/630] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jun 29 12:08:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:33.549196 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb843b3-4772-44c9-a4bf-fa42423fce5e None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:33.572609 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 309/631] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:08:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:08:33.572609 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10d347-70ea-4e01-9985-198724705bff None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:33.662202 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb843b3-4772-44c9-a4bf-fa42423fce5e None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:33.678069 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10d347-70ea-4e01-9985-198724705bff None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:33.700571 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e97939b-7e37-493b-be6c-3a3b3e144a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:33.701235 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97939b-7e37-493b-be6c-3a3b3e144a43 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:33.701515 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97939b-7e37-493b-be6c-3a3b3e144a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:33.702173 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97939b-7e37-493b-be6c-3a3b3e144a43 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:33.702961 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e97939b-7e37-493b-be6c-3a3b3e144a43 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:33.703416 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e97939b-7e37-493b-be6c-3a3b3e144a43 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:33.704682 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e97939b-7e37-493b-be6c-3a3b3e144a43 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:33.715204 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4571c7-07f0-4868-8c6c-9f11b7a7e0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:33.716315 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4571c7-07f0-4868-8c6c-9f11b7a7e0fd None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:33.716601 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4571c7-07f0-4868-8c6c-9f11b7a7e0fd None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:33.716873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4571c7-07f0-4868-8c6c-9f11b7a7e0fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:33.717445 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 323/632] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jun 29 12:08:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:33.718787 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d00b4c-a073-44a2-9f7b-df44740aeb85 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:33.719070 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d00b4c-a073-44a2-9f7b-df44740aeb85 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:33.719343 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d00b4c-a073-44a2-9f7b-df44740aeb85 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:33.720711 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 324/633] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:08:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:33.725151 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d00b4c-a073-44a2-9f7b-df44740aeb85 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:33.736988 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4571c7-07f0-4868-8c6c-9f11b7a7e0fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:33.738421 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4571c7-07f0-4868-8c6c-9f11b7a7e0fd None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:33.757144 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-7b4571c7-07f0-4868-8c6c-9f11b7a7e0fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:33.757144 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:33.757144 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:33.757144 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:33.757144 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:33.757144 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:33.757144 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:33.757144 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:33.757144 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:33.757144 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:33.757144 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:33.757144 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:33.757144 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:33.757144 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:33.757144 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:33.758163 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:33.758163 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:33.758163 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:33.758163 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:33.758163 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:33.758163 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:33.758163 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:33.758163 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:33.758163 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:33.758163 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:33.758163 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:33.758163 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:33.758163 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:33.758163 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:33.758163 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:33.758163 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:33.758163 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:33.759114 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:33.759114 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:33.759114 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:33.759114 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:33.759114 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 310/634] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:33.759965 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4571c7-07f0-4868-8c6c-9f11b7a7e0fd None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:33.774400 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:33.786578 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:33.839643 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d00b4c-a073-44a2-9f7b-df44740aeb85 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:33.872178 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4571c7-07f0-4868-8c6c-9f11b7a7e0fd None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:33.875510 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf7778-6c30-4b57-9ef1-6349a3730ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:33.876308 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf7778-6c30-4b57-9ef1-6349a3730ca7 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:33.876590 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf7778-6c30-4b57-9ef1-6349a3730ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:33.876861 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf7778-6c30-4b57-9ef1-6349a3730ca7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:33.887109 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdf7778-6c30-4b57-9ef1-6349a3730ca7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:33.888560 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdf7778-6c30-4b57-9ef1-6349a3730ca7 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:33.905860 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-5cdf7778-6c30-4b57-9ef1-6349a3730ca7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:33.905860 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:33.905860 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:33.905860 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:33.905860 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:33.905860 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:33.905860 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:33.905860 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:33.905860 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:33.905860 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:33.905860 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:33.905860 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:33.905860 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:33.905860 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:33.905860 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:33.906839 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:33.906839 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:33.906839 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:33.906839 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:33.906839 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:33.906839 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:33.906839 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:33.906839 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:33.906839 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:33.906839 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:33.906839 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:33.906839 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:33.906839 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:33.906839 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:33.906839 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:33.906839 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:33.906839 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:33.907750 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:33.907750 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:33.907750 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:33.907750 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:33.907982 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a785b8-fa61-47e2-9a7d-bf43afca67a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:33.908073 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 325/635] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:33.908150 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a785b8-fa61-47e2-9a7d-bf43afca67a2 None admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:33.908150 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a785b8-fa61-47e2-9a7d-bf43afca67a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:33.908282 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a785b8-fa61-47e2-9a7d-bf43afca67a2 None admin] PATH_INFO: `/v3/projects/996db30845f84e57865fa40b9a730a05/users/cc92f8232bda407c84365eb10ede737f/roles/6f63a9619c7b40ebb5b73bde026d606b` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:33.908845 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af682e20-2059-48d2-ac1e-d8e5dbebae71 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:33.908955 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af682e20-2059-48d2-ac1e-d8e5dbebae71 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:33.909200 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af682e20-2059-48d2-ac1e-d8e5dbebae71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:33.926766 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a785b8-fa61-47e2-9a7d-bf43afca67a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=996db30845f84e57865fa40b9a730a05, user_id=cc92f8232bda407c84365eb10ede737f, role_id=6f63a9619c7b40ebb5b73bde026d606b)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:33.927609 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-af682e20-2059-48d2-ac1e-d8e5dbebae71 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:33.928227 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a785b8-fa61-47e2-9a7d-bf43afca67a2 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:33.928952 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-af682e20-2059-48d2-ac1e-d8e5dbebae71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:33.941766 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 311/636] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jun 29 12:08:33 2022] PUT /identity/v3/projects/996db30845f84e57865fa40b9a730a05/users/cc92f8232bda407c84365eb10ede737f/roles/6f63a9619c7b40ebb5b73bde026d606b => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:08:33.942563 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a785b8-fa61-47e2-9a7d-bf43afca67a2 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:34.006285 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 326/637] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:08:34.007556 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78df35-ca94-41d7-adad-a90670a11103 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:34.007852 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78df35-ca94-41d7-adad-a90670a11103 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:34.008140 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78df35-ca94-41d7-adad-a90670a11103 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:34.009511 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 327/638] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:08:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:34.010105 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c78df35-ca94-41d7-adad-a90670a11103 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:34.032078 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:34.044702 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:34.064587 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a785b8-fa61-47e2-9a7d-bf43afca67a2 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:34.107727 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce77a05-3768-476a-99d7-d6f1eadff862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:34.108411 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce77a05-3768-476a-99d7-d6f1eadff862 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:34.108699 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce77a05-3768-476a-99d7-d6f1eadff862 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:34.108972 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce77a05-3768-476a-99d7-d6f1eadff862 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:34.109746 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce77a05-3768-476a-99d7-d6f1eadff862 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:34.110041 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce77a05-3768-476a-99d7-d6f1eadff862 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:34.111470 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce77a05-3768-476a-99d7-d6f1eadff862 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:34.125180 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 312/639] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:34.127604 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c3bd0-5be8-409b-9f8b-9eac4a0aa234 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:34.127604 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c3bd0-5be8-409b-9f8b-9eac4a0aa234 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:34.127604 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c3bd0-5be8-409b-9f8b-9eac4a0aa234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:34.145584 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-8c5c3bd0-5be8-409b-9f8b-9eac4a0aa234 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:34.146825 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-8c5c3bd0-5be8-409b-9f8b-9eac4a0aa234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:34.147085 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c78df35-ca94-41d7-adad-a90670a11103 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:34.184614 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0041b329-6406-4102-99cc-cc05181be811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:34.185279 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041b329-6406-4102-99cc-cc05181be811 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:34.185557 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041b329-6406-4102-99cc-cc05181be811 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:34.185855 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041b329-6406-4102-99cc-cc05181be811 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:34.186578 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0041b329-6406-4102-99cc-cc05181be811 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:34.186879 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0041b329-6406-4102-99cc-cc05181be811 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:34.188375 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0041b329-6406-4102-99cc-cc05181be811 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:34.205179 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 328/640] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:34.205179 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0041b329-6406-4102-99cc-cc05181be811 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:34.220640 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 313/641] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:08:34.221395 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c3bd0-5be8-409b-9f8b-9eac4a0aa234 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:34.291330 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:34.300064 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:34.322039 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0041b329-6406-4102-99cc-cc05181be811 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:34.331449 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c3bd0-5be8-409b-9f8b-9eac4a0aa234 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:34.357986 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489e4852-8e3c-4abc-bc19-518a1e6ac025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:34.358802 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e4852-8e3c-4abc-bc19-518a1e6ac025 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:34.359082 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e4852-8e3c-4abc-bc19-518a1e6ac025 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:34.359500 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e4852-8e3c-4abc-bc19-518a1e6ac025 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:34.367017 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a80f6-b46e-4359-99d7-a08a36b70bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:34.367846 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a80f6-b46e-4359-99d7-a08a36b70bc8 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:34.368132 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a80f6-b46e-4359-99d7-a08a36b70bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:34.368404 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a80f6-b46e-4359-99d7-a08a36b70bc8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:34.369809 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489e4852-8e3c-4abc-bc19-518a1e6ac025 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:08:34.375859 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a80f6-b46e-4359-99d7-a08a36b70bc8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:34.377329 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a80f6-b46e-4359-99d7-a08a36b70bc8 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:34.377496 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-489e4852-8e3c-4abc-bc19-518a1e6ac025 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:08:34.377496 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:34.377496 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:34.377496 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:34.377496 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:34.377496 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:34.377496 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:34.377496 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:34.377496 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:34.377496 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:34.377496 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:34.377496 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:34.377496 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:08:34.377496 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:08:34.377496 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:08:34.377496 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:08:34.378511 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:08:34.378511 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:08:34.378511 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:08:34.378511 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:08:34.378511 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:34.378511 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:34.378511 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:34.378511 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:34.378511 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:34.378511 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:34.378511 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:34.378511 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:34.378511 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:34.378511 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:34.378511 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:34.378511 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:34.384620 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:34.384620 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:34.384620 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:34.384620 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:34.384620 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:08:34.384620 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:08:34.384620 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:08:34.384620 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:08:34.384620 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:08:34.384620 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:08:34.384620 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:08:34.384620 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:34.384620 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 329/642] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jun 29 12:08:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:34.384620 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489e4852-8e3c-4abc-bc19-518a1e6ac025 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:34.399351 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-584a80f6-b46e-4359-99d7-a08a36b70bc8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 29 12:08:34.399351 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:34.399351 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:34.399351 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:34.399351 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:34.399351 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:34.399351 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:34.399351 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:34.399351 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:34.399351 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:34.399351 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:34.399351 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:34.399351 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:08:34.399351 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:08:34.399351 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:08:34.399351 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:08:34.400436 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:34.400436 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:34.400436 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:08:34.400436 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:34.400436 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:08:34.400436 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:34.400436 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:34.400436 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:34.400436 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:34.400436 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:34.400436 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:34.400436 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:34.400436 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:34.400436 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:34.400436 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:34.400436 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:34.400436 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:34.400436 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:34.406082 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:34.406082 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:34.406082 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:08:34.406082 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:08:34.406082 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:08:34.406082 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:08:34.406082 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:08:34.406082 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:08:34.406082 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 29 12:08:34.406082 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:34.406082 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 314/643] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:08:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:34.406082 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a80f6-b46e-4359-99d7-a08a36b70bc8 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:34.501265 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489e4852-8e3c-4abc-bc19-518a1e6ac025 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:34.509854 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a80f6-b46e-4359-99d7-a08a36b70bc8 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:34.533941 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:34.539304 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fbfef1-7abd-40d2-8bdb-2c181ef5132d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:34.540111 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fbfef1-7abd-40d2-8bdb-2c181ef5132d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:34.540399 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fbfef1-7abd-40d2-8bdb-2c181ef5132d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:34.540678 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fbfef1-7abd-40d2-8bdb-2c181ef5132d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:34.545239 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec044d-4032-4bc5-ac63-654aa1c28715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:34.546023 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec044d-4032-4bc5-ac63-654aa1c28715 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:34.546305 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec044d-4032-4bc5-ac63-654aa1c28715 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:34.546578 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec044d-4032-4bc5-ac63-654aa1c28715 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:34.547817 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fbfef1-7abd-40d2-8bdb-2c181ef5132d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:34.549378 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fbfef1-7abd-40d2-8bdb-2c181ef5132d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:34.552349 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:34.557802 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ec044d-4032-4bc5-ac63-654aa1c28715 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:08:34.565722 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-69ec044d-4032-4bc5-ac63-654aa1c28715 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:08:34.565722 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:34.565722 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:34.565722 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:34.565722 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:34.565722 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:34.565722 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:34.565722 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:34.565722 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:34.565722 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:34.565722 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:34.565722 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:34.565722 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:08:34.565722 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:08:34.565722 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:08:34.565722 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:08:34.566661 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:08:34.566661 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:08:34.566661 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:08:34.566661 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:08:34.566661 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:34.566661 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:34.566661 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:34.566661 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:34.566661 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:34.566661 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:34.566661 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:34.566661 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:34.566661 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:34.566661 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:34.566661 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:34.566661 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:34.567572 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:34.567572 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:34.567572 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:34.567572 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:34.567572 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:08:34.567572 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:08:34.567572 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:08:34.567572 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:08:34.567572 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:08:34.567572 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:08:34.567572 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:08:34.567572 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:34.568324 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-a2fbfef1-7abd-40d2-8bdb-2c181ef5132d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:34.568324 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:34.568324 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:34.568324 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:34.568324 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:34.568324 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:34.568324 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:34.568324 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:34.568324 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:34.568324 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:34.568324 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:34.568324 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:34.568324 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:08:34.568324 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:08:34.568324 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:08:34.569140 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:08:34.569140 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:34.569140 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:34.569140 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:34.569140 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:34.569140 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:34.569140 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:34.569140 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:34.569140 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:34.569140 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:34.569140 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:34.569140 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:34.569140 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:34.569140 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:34.569140 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:34.569140 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:34.569140 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:34.571901 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:08:34.571901 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:08:34.571901 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:08:34.571901 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:08:34.571901 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:08:34.571901 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:08:34.571901 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:34.571901 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:34.572786 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 330/645] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jun 29 12:08:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:34.572918 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 315/645] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jun 29 12:08:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:34.573048 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fbfef1-7abd-40d2-8bdb-2c181ef5132d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:34.573369 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec044d-4032-4bc5-ac63-654aa1c28715 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:34.680025 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec044d-4032-4bc5-ac63-654aa1c28715 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:34.680799 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fbfef1-7abd-40d2-8bdb-2c181ef5132d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:34.718248 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da8a06-9359-4302-9dab-64ab265b2819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:34.718949 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da8a06-9359-4302-9dab-64ab265b2819 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:34.719215 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da8a06-9359-4302-9dab-64ab265b2819 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:34.719492 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da8a06-9359-4302-9dab-64ab265b2819 None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:34.719766 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f5001-5630-44d1-ae3a-e7b3cc7cbe10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:34.720339 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8da8a06-9359-4302-9dab-64ab265b2819 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:34.720451 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f5001-5630-44d1-ae3a-e7b3cc7cbe10 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:34.720651 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8da8a06-9359-4302-9dab-64ab265b2819 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:34.720747 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f5001-5630-44d1-ae3a-e7b3cc7cbe10 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:34.720961 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f5001-5630-44d1-ae3a-e7b3cc7cbe10 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:34.721724 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f5001-5630-44d1-ae3a-e7b3cc7cbe10 None admin] RBAC: Adding query filter params (name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:34.722038 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f5001-5630-44d1-ae3a-e7b3cc7cbe10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:34.722144 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8da8a06-9359-4302-9dab-64ab265b2819 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:34.723390 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f5001-5630-44d1-ae3a-e7b3cc7cbe10 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:34.737786 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 331/646] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jun 29 12:08:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:34.737786 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f5001-5630-44d1-ae3a-e7b3cc7cbe10 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:34.746489 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 316/647] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Jun 29 12:08:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:34.746489 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da8a06-9359-4302-9dab-64ab265b2819 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:34.791454 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:34.798519 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:34.837459 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f5001-5630-44d1-ae3a-e7b3cc7cbe10 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:34.854555 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da8a06-9359-4302-9dab-64ab265b2819 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:34.870072 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56c7fae-8998-48d3-b72c-643f28e63c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:34.870732 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c7fae-8998-48d3-b72c-643f28e63c92 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:34.871005 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c7fae-8998-48d3-b72c-643f28e63c92 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:34.871272 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c7fae-8998-48d3-b72c-643f28e63c92 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:34.872082 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56c7fae-8998-48d3-b72c-643f28e63c92 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:34.872361 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56c7fae-8998-48d3-b72c-643f28e63c92 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:34.873812 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56c7fae-8998-48d3-b72c-643f28e63c92 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:34.886350 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 332/648] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jun 29 12:08:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:34.886926 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56c7fae-8998-48d3-b72c-643f28e63c92 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:34.894661 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f37877-9353-4b43-92c6-c75d63622cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:34.895341 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f37877-9353-4b43-92c6-c75d63622cfa None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:34.895624 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f37877-9353-4b43-92c6-c75d63622cfa None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:34.895899 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f37877-9353-4b43-92c6-c75d63622cfa None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:34.896658 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f37877-9353-4b43-92c6-c75d63622cfa None admin] RBAC: Adding query filter params (name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:34.896964 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f37877-9353-4b43-92c6-c75d63622cfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:34.898476 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f37877-9353-4b43-92c6-c75d63622cfa None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:34.908049 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 317/649] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jun 29 12:08:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:34.908846 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f37877-9353-4b43-92c6-c75d63622cfa None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:35.019247 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56c7fae-8998-48d3-b72c-643f28e63c92 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:35.024635 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f37877-9353-4b43-92c6-c75d63622cfa None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:35.027049 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:35.053068 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:35.068726 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbde1c6-3fbb-4121-bfc7-0775ef776b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:35.069131 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579c3ae-609f-4087-a750-d39b936c739f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:35.069919 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579c3ae-609f-4087-a750-d39b936c739f None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:35.070203 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579c3ae-609f-4087-a750-d39b936c739f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:35.070479 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579c3ae-609f-4087-a750-d39b936c739f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:35.070970 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbde1c6-3fbb-4121-bfc7-0775ef776b0b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:35.071453 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbde1c6-3fbb-4121-bfc7-0775ef776b0b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:35.071947 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbde1c6-3fbb-4121-bfc7-0775ef776b0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:35.085417 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbde1c6-3fbb-4121-bfc7-0775ef776b0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:35.086978 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbde1c6-3fbb-4121-bfc7-0775ef776b0b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:35.106386 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-0fbde1c6-3fbb-4121-bfc7-0775ef776b0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:35.106386 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:35.106386 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:35.106386 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:35.106386 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:35.106386 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:35.106386 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:35.106386 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:35.106386 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:35.106386 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:35.106386 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:35.106386 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:35.106386 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:35.106386 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:35.106386 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:35.107399 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:35.107399 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:35.107399 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:35.107399 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:35.107399 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:35.107399 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:35.107399 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:35.107399 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:35.107399 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:35.107399 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:35.107399 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:35.107399 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:35.107399 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:35.107399 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:35.107399 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:35.107399 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:35.107399 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:35.108292 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:35.108292 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:35.108292 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:35.108292 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:35.108292 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 333/650] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:35.109125 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbde1c6-3fbb-4121-bfc7-0775ef776b0b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:35.157632 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8579c3ae-609f-4087-a750-d39b936c739f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:35.159147 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8579c3ae-609f-4087-a750-d39b936c739f None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:35.217531 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbde1c6-3fbb-4121-bfc7-0775ef776b0b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:35.253368 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3503a2a-dcfa-4851-ac39-681cba20a43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:35.254055 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3503a2a-dcfa-4851-ac39-681cba20a43f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:35.254336 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3503a2a-dcfa-4851-ac39-681cba20a43f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:35.254611 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3503a2a-dcfa-4851-ac39-681cba20a43f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:35.255448 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3503a2a-dcfa-4851-ac39-681cba20a43f None admin] RBAC: Adding query filter params (role.id=6f63a9619c7b40ebb5b73bde026d606b, scope.project.id=996db30845f84e57865fa40b9a730a05, user.id=7adaa2ef440941aa8214f2b2fd49b54e) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:35.255761 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3503a2a-dcfa-4851-ac39-681cba20a43f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:35.257368 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3503a2a-dcfa-4851-ac39-681cba20a43f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:35.263513 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 334/651] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jun 29 12:08:35 2022] GET /identity/v3/role_assignments?user.id=7adaa2ef440941aa8214f2b2fd49b54e&scope.project.id=996db30845f84e57865fa40b9a730a05&role.id=6f63a9619c7b40ebb5b73bde026d606b => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:35.264514 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3503a2a-dcfa-4851-ac39-681cba20a43f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:35.264978 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 318/652] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:08:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:08:35.265847 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579c3ae-609f-4087-a750-d39b936c739f None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:35.275703 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:35.331091 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:35.394489 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579c3ae-609f-4087-a750-d39b936c739f None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:35.422081 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3503a2a-dcfa-4851-ac39-681cba20a43f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:35.436775 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ee4b1-1b22-4264-bec7-89949a8f2348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:35.437984 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ee4b1-1b22-4264-bec7-89949a8f2348 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:35.438268 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ee4b1-1b22-4264-bec7-89949a8f2348 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:35.438944 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ee4b1-1b22-4264-bec7-89949a8f2348 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:35.439705 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346ee4b1-1b22-4264-bec7-89949a8f2348 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:35.440031 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346ee4b1-1b22-4264-bec7-89949a8f2348 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:35.442046 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346ee4b1-1b22-4264-bec7-89949a8f2348 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:35.454868 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 319/653] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:35.455737 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ee4b1-1b22-4264-bec7-89949a8f2348 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:35.470205 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dde4d6-5552-4fee-bdc0-e9930d86596f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:35.471008 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dde4d6-5552-4fee-bdc0-e9930d86596f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:35.471287 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dde4d6-5552-4fee-bdc0-e9930d86596f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:35.471557 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dde4d6-5552-4fee-bdc0-e9930d86596f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:35.483274 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dde4d6-5552-4fee-bdc0-e9930d86596f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:35.484731 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dde4d6-5552-4fee-bdc0-e9930d86596f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:35.508500 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-60dde4d6-5552-4fee-bdc0-e9930d86596f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:35.508500 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:35.508500 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:35.508500 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:35.508500 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:35.508500 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:35.508500 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:35.508500 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:35.508500 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:35.508500 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:35.508500 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:35.508500 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:35.508500 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:35.508500 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:35.508500 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:35.509462 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:35.509462 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:35.509462 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:35.509462 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:35.509462 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:35.509462 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:35.509462 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:35.509462 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:35.509462 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:35.509462 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:35.509462 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:35.509462 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:35.509462 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:35.509462 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:35.509462 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:35.509462 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:35.509462 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:35.510479 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:35.510479 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:35.510479 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:35.510479 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:35.511263 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 335/654] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:35.511718 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dde4d6-5552-4fee-bdc0-e9930d86596f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:35.538385 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:35.596152 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ee4b1-1b22-4264-bec7-89949a8f2348 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:35.627294 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:35.642370 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dde4d6-5552-4fee-bdc0-e9930d86596f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:35.643378 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a7fadd-e77e-44c0-8af0-807101af8705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:35.644259 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7fadd-e77e-44c0-8af0-807101af8705 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:35.644703 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7fadd-e77e-44c0-8af0-807101af8705 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:35.644932 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7fadd-e77e-44c0-8af0-807101af8705 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:35.656897 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a7fadd-e77e-44c0-8af0-807101af8705 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:35.658512 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a7fadd-e77e-44c0-8af0-807101af8705 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:35.677114 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-34a7fadd-e77e-44c0-8af0-807101af8705 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:35.677114 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:35.677114 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:35.677114 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:35.677114 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:35.677114 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:35.677114 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:35.677114 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:35.677114 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:35.677114 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:35.677114 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:35.677114 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:35.677114 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:35.677114 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:35.677114 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:35.678128 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:35.678128 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:35.678128 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:35.678128 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:35.678128 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:35.678128 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:35.678128 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:35.678128 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:35.678128 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:35.678128 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:35.678128 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:35.678128 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:35.678128 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:35.678128 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:35.678128 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:35.678128 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:35.678128 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:35.679069 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:35.679069 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:35.679069 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:35.679069 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:35.679332 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 320/655] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:35.680516 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a7fadd-e77e-44c0-8af0-807101af8705 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:35.689402 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82414b35-0ff3-4da7-a9a8-95b4ea0aeda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:35.690538 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82414b35-0ff3-4da7-a9a8-95b4ea0aeda0 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:35.690995 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82414b35-0ff3-4da7-a9a8-95b4ea0aeda0 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:35.691979 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82414b35-0ff3-4da7-a9a8-95b4ea0aeda0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:35.704476 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82414b35-0ff3-4da7-a9a8-95b4ea0aeda0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:35.707241 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82414b35-0ff3-4da7-a9a8-95b4ea0aeda0 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:35.728375 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-82414b35-0ff3-4da7-a9a8-95b4ea0aeda0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 12:08:35.728375 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:35.728375 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:35.728375 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:35.728375 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:35.728375 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:35.728375 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:35.728375 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:35.728375 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:35.728375 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:35.728375 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:35.728375 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:35.728375 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:08:35.728375 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:08:35.728375 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:08:35.728375 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:08:35.729399 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:35.729399 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:35.729399 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:08:35.729399 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:35.729399 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:08:35.729399 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:35.729399 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:35.729399 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:35.729399 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:35.729399 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:35.729399 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:35.729399 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:35.729399 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:35.729399 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:35.729399 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:35.729399 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:35.729399 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:35.729399 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:35.730413 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:35.730413 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:35.730413 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:08:35.730413 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:08:35.730413 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:08:35.730413 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:08:35.730413 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:08:35.730413 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:08:35.730413 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 12:08:35.730413 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:35.736321 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 336/656] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:08:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:35.736321 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82414b35-0ff3-4da7-a9a8-95b4ea0aeda0 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:35.800848 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a7fadd-e77e-44c0-8af0-807101af8705 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:35.818507 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:35.838989 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e2f667-9d00-4932-8973-0637877eb313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:35.839609 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2f667-9d00-4932-8973-0637877eb313 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:35.839895 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2f667-9d00-4932-8973-0637877eb313 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:35.840173 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2f667-9d00-4932-8973-0637877eb313 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:35.840905 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e2f667-9d00-4932-8973-0637877eb313 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:35.841214 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e2f667-9d00-4932-8973-0637877eb313 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:35.842648 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e2f667-9d00-4932-8973-0637877eb313 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:35.848586 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82414b35-0ff3-4da7-a9a8-95b4ea0aeda0 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:35.855701 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 321/657] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:35.856557 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e2f667-9d00-4932-8973-0637877eb313 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:35.886777 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9004050-e1f7-479d-82e0-e720aa655e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:35.887894 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9004050-e1f7-479d-82e0-e720aa655e26 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:35.888375 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9004050-e1f7-479d-82e0-e720aa655e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:35.888845 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9004050-e1f7-479d-82e0-e720aa655e26 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:35.889820 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9004050-e1f7-479d-82e0-e720aa655e26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:35.890323 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9004050-e1f7-479d-82e0-e720aa655e26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:35.891903 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9004050-e1f7-479d-82e0-e720aa655e26 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:35.904766 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 337/658] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:35.906011 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9004050-e1f7-479d-82e0-e720aa655e26 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:35.921795 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:35.971663 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e2f667-9d00-4932-8973-0637877eb313 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:36.008062 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac33262-65de-4ad0-b9d3-7a1b4a1110b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:36.008742 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac33262-65de-4ad0-b9d3-7a1b4a1110b1 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:36.009024 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac33262-65de-4ad0-b9d3-7a1b4a1110b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:36.009299 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac33262-65de-4ad0-b9d3-7a1b4a1110b1 None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:36.009800 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9004050-e1f7-479d-82e0-e720aa655e26 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:36.010183 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac33262-65de-4ad0-b9d3-7a1b4a1110b1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:36.010494 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac33262-65de-4ad0-b9d3-7a1b4a1110b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:36.011943 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac33262-65de-4ad0-b9d3-7a1b4a1110b1 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:36.030969 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 322/659] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Jun 29 12:08:35 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:36.031530 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac33262-65de-4ad0-b9d3-7a1b4a1110b1 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:36.056550 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f7442c-1166-4e87-ae1c-52113e784bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:36.057474 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7442c-1166-4e87-ae1c-52113e784bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:36.057785 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7442c-1166-4e87-ae1c-52113e784bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:36.058064 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7442c-1166-4e87-ae1c-52113e784bb8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:36.066103 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f7442c-1166-4e87-ae1c-52113e784bb8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:36.066665 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:36.068428 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f7442c-1166-4e87-ae1c-52113e784bb8 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:36.085230 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-67f7442c-1166-4e87-ae1c-52113e784bb8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 29 12:08:36.085230 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:36.085230 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:36.085230 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:36.085230 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:36.085230 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:36.085230 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:36.085230 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:36.085230 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:36.085230 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:36.085230 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:36.085230 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:36.085230 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:08:36.085230 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:08:36.085230 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:08:36.085230 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:08:36.086313 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:36.086313 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:36.086313 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:08:36.086313 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:36.086313 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:08:36.086313 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:36.086313 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:36.086313 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:36.086313 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:36.086313 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:36.086313 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:36.086313 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:36.086313 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:36.086313 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:36.086313 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:36.086313 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:36.086313 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:36.086313 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:36.087270 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:36.087270 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:36.087270 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:08:36.087270 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:08:36.087270 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:08:36.087270 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:08:36.087270 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:08:36.087270 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:08:36.087270 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 29 12:08:36.087270 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:36.087270 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 338/660] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jun 29 12:08:35 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:36.088377 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9eba4-dd83-4e61-ab43-1b6d379ee597 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:36.088476 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9eba4-dd83-4e61-ab43-1b6d379ee597 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:36.088698 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9eba4-dd83-4e61-ab43-1b6d379ee597 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:36.093837 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 339/661] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:08:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:36.093837 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e9eba4-dd83-4e61-ab43-1b6d379ee597 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:36.145573 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac33262-65de-4ad0-b9d3-7a1b4a1110b1 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:36.166317 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:36.182958 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722aa62a-9b97-462e-82ee-4630bbfa40ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:36.183873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722aa62a-9b97-462e-82ee-4630bbfa40ff None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:36.184295 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722aa62a-9b97-462e-82ee-4630bbfa40ff None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:36.184427 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722aa62a-9b97-462e-82ee-4630bbfa40ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:36.191364 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722aa62a-9b97-462e-82ee-4630bbfa40ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:36.192808 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722aa62a-9b97-462e-82ee-4630bbfa40ff None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:36.200429 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e9eba4-dd83-4e61-ab43-1b6d379ee597 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:36.207335 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-722aa62a-9b97-462e-82ee-4630bbfa40ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:36.207335 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:36.207335 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:36.207335 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:36.207335 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:36.207335 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:36.207335 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:36.207335 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:36.207335 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:36.207335 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:36.207335 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:36.207335 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:36.207335 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:08:36.207335 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:08:36.207335 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:08:36.208225 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:08:36.208225 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:36.208225 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:36.208225 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:36.208225 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:36.208225 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:36.208225 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:36.208225 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:36.208225 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:36.208225 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:36.208225 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:36.208225 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:36.208225 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:36.208225 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:36.208225 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:36.208225 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:36.208225 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:36.209215 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:08:36.209215 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:08:36.209215 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:08:36.209215 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:08:36.209215 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:08:36.209215 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:08:36.209215 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:36.209215 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:36.209215 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 323/662] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jun 29 12:08:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:36.209771 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722aa62a-9b97-462e-82ee-4630bbfa40ff None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:36.240791 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4126ea-be8e-4286-83e1-e515aa1153cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:36.241587 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4126ea-be8e-4286-83e1-e515aa1153cb None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:36.241974 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4126ea-be8e-4286-83e1-e515aa1153cb None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:36.242458 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4126ea-be8e-4286-83e1-e515aa1153cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:36.308191 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:36.314136 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4126ea-be8e-4286-83e1-e515aa1153cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:36.315589 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4126ea-be8e-4286-83e1-e515aa1153cb None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:36.315692 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722aa62a-9b97-462e-82ee-4630bbfa40ff None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:36.353828 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d252523e-019d-447f-8195-d7b764ec2fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:36.354491 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252523e-019d-447f-8195-d7b764ec2fa1 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:36.354770 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252523e-019d-447f-8195-d7b764ec2fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:36.355042 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252523e-019d-447f-8195-d7b764ec2fa1 None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:36.355877 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d252523e-019d-447f-8195-d7b764ec2fa1 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:36.356182 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d252523e-019d-447f-8195-d7b764ec2fa1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:36.357604 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d252523e-019d-447f-8195-d7b764ec2fa1 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:36.376928 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 324/663] 10.222.0.27 () {56 vars in 1139 bytes} [Wed Jun 29 12:08:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:36.378040 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89755be3-c0d1-4225-ba97-bfe2f0943c70 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:36.378329 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89755be3-c0d1-4225-ba97-bfe2f0943c70 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:36.378604 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89755be3-c0d1-4225-ba97-bfe2f0943c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:36.391859 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:36.395751 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-89755be3-c0d1-4225-ba97-bfe2f0943c70 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:36.396975 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-89755be3-c0d1-4225-ba97-bfe2f0943c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:36.427268 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 340/664] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:08:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:08:36.428149 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4126ea-be8e-4286-83e1-e515aa1153cb None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:36.473986 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 325/665] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:08:36.474666 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89755be3-c0d1-4225-ba97-bfe2f0943c70 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:36.550169 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4126ea-be8e-4286-83e1-e515aa1153cb None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:36.561063 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:36.580664 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89755be3-c0d1-4225-ba97-bfe2f0943c70 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:36.590526 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276cd98-3899-4c8d-8619-933ea3c38fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:36.591437 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276cd98-3899-4c8d-8619-933ea3c38fbf None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:36.591982 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276cd98-3899-4c8d-8619-933ea3c38fbf None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:36.592280 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276cd98-3899-4c8d-8619-933ea3c38fbf None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:36.593101 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3276cd98-3899-4c8d-8619-933ea3c38fbf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:36.593422 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3276cd98-3899-4c8d-8619-933ea3c38fbf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:36.595059 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3276cd98-3899-4c8d-8619-933ea3c38fbf None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:36.612510 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 341/666] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jun 29 12:08:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:36.612510 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276cd98-3899-4c8d-8619-933ea3c38fbf None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:36.624050 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4b7ec-2c73-4ab8-aeeb-859b08ffb987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:36.624705 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4b7ec-2c73-4ab8-aeeb-859b08ffb987 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:36.624986 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4b7ec-2c73-4ab8-aeeb-859b08ffb987 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:36.625255 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4b7ec-2c73-4ab8-aeeb-859b08ffb987 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:36.644094 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:36.697934 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d4b7ec-2c73-4ab8-aeeb-859b08ffb987 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:36.699347 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d4b7ec-2c73-4ab8-aeeb-859b08ffb987 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:36.730487 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276cd98-3899-4c8d-8619-933ea3c38fbf None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:36.764711 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f3420-9b9e-4f9a-b112-57e6dd9ccb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:36.765498 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f3420-9b9e-4f9a-b112-57e6dd9ccb2f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:36.765802 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f3420-9b9e-4f9a-b112-57e6dd9ccb2f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:36.766072 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f3420-9b9e-4f9a-b112-57e6dd9ccb2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:36.776980 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8f3420-9b9e-4f9a-b112-57e6dd9ccb2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:36.778463 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8f3420-9b9e-4f9a-b112-57e6dd9ccb2f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:36.780691 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:36.796815 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-0a8f3420-9b9e-4f9a-b112-57e6dd9ccb2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:36.796815 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:36.796815 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:36.796815 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:36.796815 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:36.796815 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:36.796815 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:36.796815 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:36.796815 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:36.796815 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:36.796815 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:36.796815 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:36.796815 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:36.796815 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:36.796815 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:36.797785 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:36.797785 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:36.797785 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:36.797785 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:36.797785 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:36.797785 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:36.797785 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:36.797785 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:36.797785 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:36.797785 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:36.797785 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:36.797785 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:36.797785 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:36.797785 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:36.797785 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:36.797785 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:36.797785 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:36.798742 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:36.798742 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:36.798742 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:36.798742 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:36.798742 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 342/667] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:36.799043 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f3420-9b9e-4f9a-b112-57e6dd9ccb2f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:36.811624 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 326/668] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:08:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:08:36.811624 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4b7ec-2c73-4ab8-aeeb-859b08ffb987 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:36.886863 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:36.905920 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f3420-9b9e-4f9a-b112-57e6dd9ccb2f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:36.922956 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4b7ec-2c73-4ab8-aeeb-859b08ffb987 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:36.946711 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab098de-4245-4eb0-a36d-a939c3d25d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:36.947530 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab098de-4245-4eb0-a36d-a939c3d25d24 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:36.947812 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab098de-4245-4eb0-a36d-a939c3d25d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:36.948138 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab098de-4245-4eb0-a36d-a939c3d25d24 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:36.959176 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc3cbb-5935-45f5-ba0c-a099a471bf5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:36.959588 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab098de-4245-4eb0-a36d-a939c3d25d24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:08:36.959826 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc3cbb-5935-45f5-ba0c-a099a471bf5b None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:36.960366 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc3cbb-5935-45f5-ba0c-a099a471bf5b None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:36.961407 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc3cbb-5935-45f5-ba0c-a099a471bf5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:36.962352 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bc3cbb-5935-45f5-ba0c-a099a471bf5b None admin] RBAC: Adding query filter params (role.id=6f63a9619c7b40ebb5b73bde026d606b, scope.project.id=996db30845f84e57865fa40b9a730a05, user.id=d865d1b935a54ca2b44beda5b0277336) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:36.962666 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bc3cbb-5935-45f5-ba0c-a099a471bf5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:36.964115 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bc3cbb-5935-45f5-ba0c-a099a471bf5b None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:36.967483 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-bab098de-4245-4eb0-a36d-a939c3d25d24 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:08:36.967483 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:36.967483 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:36.967483 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:36.967483 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:36.967483 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:36.967483 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:36.967483 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:36.967483 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:36.967483 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:36.967483 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:36.967483 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:36.967483 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:08:36.967483 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:08:36.967483 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:08:36.967483 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:08:36.968430 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:08:36.968430 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:08:36.968430 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:08:36.968430 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:08:36.968430 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:36.968430 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:36.968430 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:36.968430 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:36.968430 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:36.968430 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:36.968430 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:36.968430 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:36.968430 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:36.968430 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:36.968430 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:36.968430 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:36.969352 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:36.969352 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:36.969352 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:36.969352 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:36.969352 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:08:36.969352 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:08:36.969352 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:08:36.969352 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:08:36.969352 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:08:36.969352 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:08:36.969352 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:08:36.969352 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:36.977988 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 327/669] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jun 29 12:08:36 2022] GET /identity/v3/role_assignments?user.id=d865d1b935a54ca2b44beda5b0277336&scope.project.id=996db30845f84e57865fa40b9a730a05&role.id=6f63a9619c7b40ebb5b73bde026d606b => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:36.977988 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc3cbb-5935-45f5-ba0c-a099a471bf5b None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:36.978263 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 343/670] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jun 29 12:08:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:36.978263 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab098de-4245-4eb0-a36d-a939c3d25d24 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:37.048986 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:37.111915 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc3cbb-5935-45f5-ba0c-a099a471bf5b None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:37.118888 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab098de-4245-4eb0-a36d-a939c3d25d24 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:37.151491 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5335ac82-b81e-4932-a3b8-2cfd276e6505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:37.152246 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335ac82-b81e-4932-a3b8-2cfd276e6505 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:37.152533 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335ac82-b81e-4932-a3b8-2cfd276e6505 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:37.152810 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335ac82-b81e-4932-a3b8-2cfd276e6505 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:37.153716 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5335ac82-b81e-4932-a3b8-2cfd276e6505 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:37.154042 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5335ac82-b81e-4932-a3b8-2cfd276e6505 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:37.156267 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5335ac82-b81e-4932-a3b8-2cfd276e6505 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:37.160775 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca5128c-e503-44e6-9cb5-be6ab8f6fcff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:37.161896 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5128c-e503-44e6-9cb5-be6ab8f6fcff None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:37.162381 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5128c-e503-44e6-9cb5-be6ab8f6fcff None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:37.162856 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5128c-e503-44e6-9cb5-be6ab8f6fcff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:37.169169 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 328/671] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:37.171276 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5335ac82-b81e-4932-a3b8-2cfd276e6505 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:37.176039 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca5128c-e503-44e6-9cb5-be6ab8f6fcff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:37.177815 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca5128c-e503-44e6-9cb5-be6ab8f6fcff None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:37.180716 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:37.199286 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-bca5128c-e503-44e6-9cb5-be6ab8f6fcff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:37.199286 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:37.199286 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:37.199286 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:37.199286 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:37.199286 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:37.199286 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:37.199286 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:37.199286 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:37.199286 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:37.199286 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:37.199286 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:37.199286 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:37.199286 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:37.199286 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:37.200238 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:37.200238 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:37.200238 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:37.200238 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:37.200238 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:37.200238 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:37.200238 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:37.200238 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:37.200238 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:37.200238 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:37.200238 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:37.200238 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:37.200238 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:37.200238 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:37.200238 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:37.200238 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:37.200238 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:37.201166 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:37.201166 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:37.201166 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:37.201166 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:37.203242 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 344/672] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:37.204211 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca5128c-e503-44e6-9cb5-be6ab8f6fcff None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:37.278446 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5335ac82-b81e-4932-a3b8-2cfd276e6505 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:37.288984 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:37.312605 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca5128c-e503-44e6-9cb5-be6ab8f6fcff None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:37.320329 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972ced5-54a8-47f1-b197-09dda6e94d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:37.321014 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972ced5-54a8-47f1-b197-09dda6e94d7c None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:37.321293 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972ced5-54a8-47f1-b197-09dda6e94d7c None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:37.321564 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972ced5-54a8-47f1-b197-09dda6e94d7c None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:37.322592 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b972ced5-54a8-47f1-b197-09dda6e94d7c None admin] RBAC: Adding query filter params (name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:37.322771 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b972ced5-54a8-47f1-b197-09dda6e94d7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:37.324151 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b972ced5-54a8-47f1-b197-09dda6e94d7c None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:37.333857 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 329/673] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jun 29 12:08:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:37.334790 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972ced5-54a8-47f1-b197-09dda6e94d7c None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:37.351896 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb6029-da67-448d-820f-56175035f32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:37.353073 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb6029-da67-448d-820f-56175035f32a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:37.353562 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb6029-da67-448d-820f-56175035f32a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:37.354065 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb6029-da67-448d-820f-56175035f32a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:37.361540 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eb6029-da67-448d-820f-56175035f32a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:37.363279 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eb6029-da67-448d-820f-56175035f32a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:37.378882 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-e7eb6029-da67-448d-820f-56175035f32a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:37.378882 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:37.378882 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:37.378882 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:37.378882 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:37.378882 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:37.378882 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:37.378882 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:37.378882 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:37.378882 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:37.378882 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:37.378882 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:37.378882 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:08:37.378882 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:08:37.378882 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:08:37.379862 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:08:37.379862 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:37.379862 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:37.379862 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:37.379862 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:37.379862 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:37.379862 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:37.379862 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:37.379862 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:37.379862 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:37.379862 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:37.379862 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:37.379862 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:37.379862 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:37.379862 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:37.379862 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:37.379862 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:37.380807 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:08:37.380807 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:08:37.380807 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:08:37.380807 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:08:37.380807 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:08:37.380807 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:08:37.380807 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:37.380807 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:37.383517 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 345/674] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jun 29 12:08:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:37.384527 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb6029-da67-448d-820f-56175035f32a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:37.443131 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:37.449532 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972ced5-54a8-47f1-b197-09dda6e94d7c None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:37.486543 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5856c-a3f7-4af2-8c41-9c06b2922d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:37.488170 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5856c-a3f7-4af2-8c41-9c06b2922d00 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:37.488663 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5856c-a3f7-4af2-8c41-9c06b2922d00 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:37.489300 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5856c-a3f7-4af2-8c41-9c06b2922d00 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:37.490856 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d5856c-a3f7-4af2-8c41-9c06b2922d00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:37.491436 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d5856c-a3f7-4af2-8c41-9c06b2922d00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:37.493038 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d5856c-a3f7-4af2-8c41-9c06b2922d00 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:37.493151 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb6029-da67-448d-820f-56175035f32a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:37.509856 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 330/675] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:37.511268 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5856c-a3f7-4af2-8c41-9c06b2922d00 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:37.530871 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456382cf-d996-4f12-b9e2-efd91edf93ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:37.531667 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456382cf-d996-4f12-b9e2-efd91edf93ed None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:37.531943 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456382cf-d996-4f12-b9e2-efd91edf93ed None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:37.532207 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456382cf-d996-4f12-b9e2-efd91edf93ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:37.540301 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:37.544039 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456382cf-d996-4f12-b9e2-efd91edf93ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:37.545494 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456382cf-d996-4f12-b9e2-efd91edf93ed None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:37.564022 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-456382cf-d996-4f12-b9e2-efd91edf93ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:37.564022 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:37.564022 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:37.564022 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:37.564022 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:37.564022 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:37.564022 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:37.564022 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:37.564022 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:37.564022 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:37.564022 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:37.564022 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:37.564022 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:37.564022 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:37.564022 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:37.565143 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:37.565143 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:37.565143 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:37.565143 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:37.565143 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:37.565143 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:37.565143 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:37.565143 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:37.565143 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:37.565143 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:37.565143 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:37.565143 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:37.565143 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:37.565143 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:37.565143 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:37.565143 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:37.565143 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:37.566449 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:37.566449 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:37.566449 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:37.566449 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:37.566449 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 346/676] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:37.571053 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50dcc0-cf04-419b-97ec-6c65034a5ac0 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:37.571331 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50dcc0-cf04-419b-97ec-6c65034a5ac0 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:37.571602 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50dcc0-cf04-419b-97ec-6c65034a5ac0 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:37.573764 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 347/677] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:08:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:37.573764 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea50dcc0-cf04-419b-97ec-6c65034a5ac0 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:37.625120 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5856c-a3f7-4af2-8c41-9c06b2922d00 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:37.665468 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365dd8fa-875a-4b19-9464-b7b56034ec50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:37.666168 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365dd8fa-875a-4b19-9464-b7b56034ec50 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:37.666448 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365dd8fa-875a-4b19-9464-b7b56034ec50 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:37.666725 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365dd8fa-875a-4b19-9464-b7b56034ec50 None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:37.667527 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365dd8fa-875a-4b19-9464-b7b56034ec50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:37.667832 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365dd8fa-875a-4b19-9464-b7b56034ec50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:37.669269 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365dd8fa-875a-4b19-9464-b7b56034ec50 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:37.686501 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 331/678] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jun 29 12:08:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:37.686501 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365dd8fa-875a-4b19-9464-b7b56034ec50 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:37.695105 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea50dcc0-cf04-419b-97ec-6c65034a5ac0 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:37.704159 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:37.733874 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8270db8d-eced-476a-b1da-d03e483f5bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:37.734761 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270db8d-eced-476a-b1da-d03e483f5bee None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:37.735111 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270db8d-eced-476a-b1da-d03e483f5bee None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:37.735451 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270db8d-eced-476a-b1da-d03e483f5bee None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:37.742892 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8270db8d-eced-476a-b1da-d03e483f5bee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:37.744419 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8270db8d-eced-476a-b1da-d03e483f5bee None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:37.760228 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-8270db8d-eced-476a-b1da-d03e483f5bee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:37.760228 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:37.760228 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:37.760228 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:37.760228 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:37.760228 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:37.760228 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:37.760228 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:37.760228 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:37.760228 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:37.760228 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:37.760228 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:37.760228 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:08:37.760228 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:08:37.760228 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:08:37.761419 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:08:37.761419 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:37.761419 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:37.761419 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:37.761419 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:37.761419 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:37.761419 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:37.761419 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:37.761419 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:37.761419 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:37.761419 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:37.761419 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:37.761419 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:37.761419 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:37.761419 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:37.761419 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:37.761419 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:37.762582 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:08:37.762582 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:08:37.762582 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:08:37.762582 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:08:37.762582 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:08:37.762582 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:08:37.762582 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:37.762582 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:37.763122 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 348/679] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jun 29 12:08:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:37.764439 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ee639-0e3a-4131-8e28-f73c76d690d1 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:37.764823 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ee639-0e3a-4131-8e28-f73c76d690d1 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:37.765141 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ee639-0e3a-4131-8e28-f73c76d690d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:37.783256 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-807ee639-0e3a-4131-8e28-f73c76d690d1 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:37.784327 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:37.784602 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-807ee639-0e3a-4131-8e28-f73c76d690d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:37.799190 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365dd8fa-875a-4b19-9464-b7b56034ec50 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:37.835102 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e417b0ba-1335-4ec2-8d11-706a927eed48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:37.836002 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e417b0ba-1335-4ec2-8d11-706a927eed48 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:37.836354 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e417b0ba-1335-4ec2-8d11-706a927eed48 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:37.836693 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e417b0ba-1335-4ec2-8d11-706a927eed48 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:37.837500 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e417b0ba-1335-4ec2-8d11-706a927eed48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:37.837968 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e417b0ba-1335-4ec2-8d11-706a927eed48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:37.839355 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e417b0ba-1335-4ec2-8d11-706a927eed48 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:37.865717 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 332/680] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:37.865717 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e417b0ba-1335-4ec2-8d11-706a927eed48 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:37.865992 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 349/681] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:08:37.865992 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ee639-0e3a-4131-8e28-f73c76d690d1 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:37.965118 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e417b0ba-1335-4ec2-8d11-706a927eed48 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:37.966362 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:37.972763 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ee639-0e3a-4131-8e28-f73c76d690d1 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:38.001555 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98e50d-f96e-4126-ab2f-819ac711e4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:38.002245 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98e50d-f96e-4126-ab2f-819ac711e4f1 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:38.002530 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98e50d-f96e-4126-ab2f-819ac711e4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:38.003019 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98e50d-f96e-4126-ab2f-819ac711e4f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:38.003637 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc98e50d-f96e-4126-ab2f-819ac711e4f1 None admin] RBAC: Adding query filter params (role.id=6f63a9619c7b40ebb5b73bde026d606b, scope.project.id=996db30845f84e57865fa40b9a730a05, user.id=f72f0602e17f4ab4a48e3aaa7022d28d) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:38.003951 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc98e50d-f96e-4126-ab2f-819ac711e4f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:38.005391 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc98e50d-f96e-4126-ab2f-819ac711e4f1 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:38.008151 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cdcb2c-054c-4ece-a3f2-639f23d237df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:38.008812 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cdcb2c-054c-4ece-a3f2-639f23d237df None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:38.009092 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cdcb2c-054c-4ece-a3f2-639f23d237df None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:38.009363 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cdcb2c-054c-4ece-a3f2-639f23d237df None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:38.010196 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cdcb2c-054c-4ece-a3f2-639f23d237df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:38.010503 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cdcb2c-054c-4ece-a3f2-639f23d237df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:38.022088 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 333/682] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jun 29 12:08:37 2022] GET /identity/v3/role_assignments?user.id=f72f0602e17f4ab4a48e3aaa7022d28d&scope.project.id=996db30845f84e57865fa40b9a730a05&role.id=6f63a9619c7b40ebb5b73bde026d606b => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:38.022304 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cdcb2c-054c-4ece-a3f2-639f23d237df None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:38.022407 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98e50d-f96e-4126-ab2f-819ac711e4f1 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:38.042298 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:38.042501 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 350/683] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jun 29 12:08:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:38.043418 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cdcb2c-054c-4ece-a3f2-639f23d237df None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:38.170156 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98e50d-f96e-4126-ab2f-819ac711e4f1 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:38.178948 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cdcb2c-054c-4ece-a3f2-639f23d237df None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:38.217671 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88f18a-77fc-438b-b2e6-efd28fed0bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:38.218461 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88f18a-77fc-438b-b2e6-efd28fed0bf3 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:38.218741 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88f18a-77fc-438b-b2e6-efd28fed0bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:38.219009 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88f18a-77fc-438b-b2e6-efd28fed0bf3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:38.220021 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb415ed-ba5b-4a89-ab97-a4b12946809b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:38.220832 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb415ed-ba5b-4a89-ab97-a4b12946809b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:38.221113 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb415ed-ba5b-4a89-ab97-a4b12946809b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:38.221390 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb415ed-ba5b-4a89-ab97-a4b12946809b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:38.229252 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd88f18a-77fc-438b-b2e6-efd28fed0bf3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:38.231095 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd88f18a-77fc-438b-b2e6-efd28fed0bf3 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:38.235079 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb415ed-ba5b-4a89-ab97-a4b12946809b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:08:38.243067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-ecb415ed-ba5b-4a89-ab97-a4b12946809b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:08:38.243067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:38.243067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:38.243067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:38.243067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:38.243067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:38.243067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:38.243067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:38.243067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:38.243067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:38.243067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:38.243067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:38.243067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:08:38.243067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:08:38.243067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:08:38.243067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:08:38.244443 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:08:38.244443 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:08:38.244443 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:08:38.244443 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:08:38.244443 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:38.244443 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:38.244443 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:38.244443 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:38.244443 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:38.244443 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:38.244443 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:38.244443 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:38.244443 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:38.244443 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:38.244443 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:38.244443 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:38.245303 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:38.245303 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:38.245303 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:38.245303 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:38.245303 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:08:38.245303 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:08:38.245303 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:08:38.245303 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:08:38.245303 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:08:38.245303 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:08:38.245303 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:08:38.245303 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:38.245303 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 351/684] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jun 29 12:08:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:38.246048 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb415ed-ba5b-4a89-ab97-a4b12946809b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:38.249807 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-cd88f18a-77fc-438b-b2e6-efd28fed0bf3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 29 12:08:38.249807 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:38.249807 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:38.249807 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:38.249807 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:38.249807 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:38.249807 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:38.249807 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:38.249807 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:38.249807 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:38.249807 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:38.249807 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:38.249807 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:08:38.249807 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:08:38.249807 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:08:38.249807 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:08:38.250808 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:38.250808 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:38.250808 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:08:38.250808 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:38.250808 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:08:38.250808 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:38.250808 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:38.250808 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:38.250808 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:38.250808 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:38.250808 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:38.250808 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:38.250808 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:38.250808 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:38.250808 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:38.250808 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:38.250808 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:38.250808 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:38.251768 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:38.251768 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:38.251768 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:08:38.251768 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:08:38.251768 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:08:38.251768 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:08:38.251768 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:08:38.251768 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:08:38.251768 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 29 12:08:38.251768 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:38.251768 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 334/685] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jun 29 12:08:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:38.255313 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88f18a-77fc-438b-b2e6-efd28fed0bf3 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:38.272049 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:38.349537 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:38.377952 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb415ed-ba5b-4a89-ab97-a4b12946809b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:38.381614 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88f18a-77fc-438b-b2e6-efd28fed0bf3 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:38.417248 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8a72a-ab7f-4a8c-8560-dea3045e7d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:38.418182 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8a72a-ab7f-4a8c-8560-dea3045e7d72 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:38.418529 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8a72a-ab7f-4a8c-8560-dea3045e7d72 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:38.418904 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8a72a-ab7f-4a8c-8560-dea3045e7d72 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:38.419764 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f8a72a-ab7f-4a8c-8560-dea3045e7d72 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:38.420174 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f8a72a-ab7f-4a8c-8560-dea3045e7d72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:38.421649 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f8a72a-ab7f-4a8c-8560-dea3045e7d72 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:38.422428 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe6f2c3-3f88-452e-a5a3-f3bcd8f41397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:38.423512 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6f2c3-3f88-452e-a5a3-f3bcd8f41397 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:38.424633 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6f2c3-3f88-452e-a5a3-f3bcd8f41397 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:38.425057 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6f2c3-3f88-452e-a5a3-f3bcd8f41397 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:38.426061 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe6f2c3-3f88-452e-a5a3-f3bcd8f41397 None admin] RBAC: Adding query filter params (role.id=6f63a9619c7b40ebb5b73bde026d606b, scope.project.id=996db30845f84e57865fa40b9a730a05, user.id=e94618bb382d46f7aaa2ef8f5d690bf2) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:38.426517 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe6f2c3-3f88-452e-a5a3-f3bcd8f41397 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:38.428616 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe6f2c3-3f88-452e-a5a3-f3bcd8f41397 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:38.435970 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 352/686] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jun 29 12:08:38 2022] GET /identity/v3/role_assignments?user.id=e94618bb382d46f7aaa2ef8f5d690bf2&scope.project.id=996db30845f84e57865fa40b9a730a05&role.id=6f63a9619c7b40ebb5b73bde026d606b => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:38.437136 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe6f2c3-3f88-452e-a5a3-f3bcd8f41397 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:38.438126 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 335/687] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:08:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:08:38.448433 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8a72a-ab7f-4a8c-8560-dea3045e7d72 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:38.543063 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:38.568780 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe6f2c3-3f88-452e-a5a3-f3bcd8f41397 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:38.644649 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f6cff-24db-4d8e-a15a-915ca7671d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:38.645599 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f6cff-24db-4d8e-a15a-915ca7671d71 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:38.646039 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f6cff-24db-4d8e-a15a-915ca7671d71 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:38.646436 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f6cff-24db-4d8e-a15a-915ca7671d71 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:38.647500 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226f6cff-24db-4d8e-a15a-915ca7671d71 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:38.648269 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226f6cff-24db-4d8e-a15a-915ca7671d71 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:38.650668 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226f6cff-24db-4d8e-a15a-915ca7671d71 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:38.669722 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8a72a-ab7f-4a8c-8560-dea3045e7d72 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:38.675386 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 353/688] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Jun 29 12:08:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:38.685716 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f6cff-24db-4d8e-a15a-915ca7671d71 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:38.722121 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03b315-f88b-4ae6-bd75-dd8dabc6c576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:38.722929 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03b315-f88b-4ae6-bd75-dd8dabc6c576 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:38.723214 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03b315-f88b-4ae6-bd75-dd8dabc6c576 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:38.723492 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03b315-f88b-4ae6-bd75-dd8dabc6c576 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:38.726811 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:38.737081 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03b315-f88b-4ae6-bd75-dd8dabc6c576 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:38.739168 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03b315-f88b-4ae6-bd75-dd8dabc6c576 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:38.761952 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-2a03b315-f88b-4ae6-bd75-dd8dabc6c576 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:38.761952 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:38.761952 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:38.761952 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:38.761952 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:38.761952 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:38.761952 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:38.761952 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:38.761952 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:38.761952 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:38.761952 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:38.761952 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:38.761952 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:38.761952 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:38.761952 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:38.762933 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:38.762933 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:38.762933 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:38.762933 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:38.762933 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:38.762933 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:38.762933 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:38.762933 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:38.762933 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:38.762933 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:38.762933 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:38.762933 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:38.762933 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:38.762933 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:38.762933 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:38.762933 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:38.762933 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:38.764160 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:38.764160 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:38.764160 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:38.764160 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:38.764160 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 336/689] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:38.769076 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03b315-f88b-4ae6-bd75-dd8dabc6c576 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:38.816761 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f6cff-24db-4d8e-a15a-915ca7671d71 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:38.857037 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ca63f-4b6b-46ce-9722-d5d1680015c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:38.857818 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ca63f-4b6b-46ce-9722-d5d1680015c2 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:38.858097 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ca63f-4b6b-46ce-9722-d5d1680015c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:38.858370 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ca63f-4b6b-46ce-9722-d5d1680015c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:38.868158 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:38.883403 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03b315-f88b-4ae6-bd75-dd8dabc6c576 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:38.921479 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e416ad2-2910-43ba-90fd-266155a46f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:38.922194 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e416ad2-2910-43ba-90fd-266155a46f08 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:38.922479 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e416ad2-2910-43ba-90fd-266155a46f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:38.922756 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e416ad2-2910-43ba-90fd-266155a46f08 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:38.923591 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e416ad2-2910-43ba-90fd-266155a46f08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:38.923931 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e416ad2-2910-43ba-90fd-266155a46f08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:38.925524 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e416ad2-2910-43ba-90fd-266155a46f08 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:38.934305 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441ca63f-4b6b-46ce-9722-d5d1680015c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:38.935866 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441ca63f-4b6b-46ce-9722-d5d1680015c2 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:38.939104 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 337/690] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:38.946592 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e416ad2-2910-43ba-90fd-266155a46f08 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:38.998139 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:39.043409 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 354/691] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:08:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:08:39.058790 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ca63f-4b6b-46ce-9722-d5d1680015c2 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:39.074066 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e416ad2-2910-43ba-90fd-266155a46f08 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:39.110868 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112c3134-dc75-4409-90bb-81fefa0b386c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:39.112143 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c3134-dc75-4409-90bb-81fefa0b386c None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:39.112660 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c3134-dc75-4409-90bb-81fefa0b386c None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:39.113135 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c3134-dc75-4409-90bb-81fefa0b386c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:39.121560 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112c3134-dc75-4409-90bb-81fefa0b386c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:39.123328 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112c3134-dc75-4409-90bb-81fefa0b386c None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:39.138121 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:39.139085 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-112c3134-dc75-4409-90bb-81fefa0b386c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 12:08:39.139085 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:39.139085 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:39.139085 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:39.139085 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:39.139085 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:39.139085 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:39.139085 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:39.139085 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:39.139085 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:39.139085 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:39.139085 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:39.139085 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:08:39.139085 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:08:39.139085 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:08:39.139085 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:08:39.140037 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:39.140037 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:39.140037 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:08:39.140037 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:39.140037 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:08:39.140037 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:39.140037 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:39.140037 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:39.140037 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:39.140037 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:39.140037 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:39.140037 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:39.140037 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:39.140037 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:39.140037 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:39.140037 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:39.140037 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:39.140037 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:39.141111 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:39.141111 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:39.141111 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:08:39.141111 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:08:39.141111 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:08:39.141111 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:08:39.141111 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:08:39.141111 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:08:39.141111 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 12:08:39.141111 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:39.143821 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 338/692] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Jun 29 12:08:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:08:39.149635 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112c3134-dc75-4409-90bb-81fefa0b386c None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:39.255978 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112c3134-dc75-4409-90bb-81fefa0b386c None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:39.268094 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ca63f-4b6b-46ce-9722-d5d1680015c2 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:39.289712 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:39.293506 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3463ed6-dc21-4f1f-80d0-e5c71ad2f5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:39.294531 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3463ed6-dc21-4f1f-80d0-e5c71ad2f5aa None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:39.294993 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3463ed6-dc21-4f1f-80d0-e5c71ad2f5aa None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:39.295494 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3463ed6-dc21-4f1f-80d0-e5c71ad2f5aa None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:39.296543 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3463ed6-dc21-4f1f-80d0-e5c71ad2f5aa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:39.297134 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3463ed6-dc21-4f1f-80d0-e5c71ad2f5aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:39.298911 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3463ed6-dc21-4f1f-80d0-e5c71ad2f5aa None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:39.310964 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e230a7a6-c871-4ef7-80eb-2a00d3af2511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:39.311769 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e230a7a6-c871-4ef7-80eb-2a00d3af2511 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:39.312052 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e230a7a6-c871-4ef7-80eb-2a00d3af2511 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:39.312327 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e230a7a6-c871-4ef7-80eb-2a00d3af2511 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:39.320188 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 339/693] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Jun 29 12:08:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:08:39.324772 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e230a7a6-c871-4ef7-80eb-2a00d3af2511 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:39.326264 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e230a7a6-c871-4ef7-80eb-2a00d3af2511 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:39.327205 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23281e4e-ff6b-4e08-925d-727a89e12be7 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:39.327814 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23281e4e-ff6b-4e08-925d-727a89e12be7 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:39.328246 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23281e4e-ff6b-4e08-925d-727a89e12be7 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:39.330206 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 340/694] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:08:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:39.331080 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23281e4e-ff6b-4e08-925d-727a89e12be7 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:39.354568 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-e230a7a6-c871-4ef7-80eb-2a00d3af2511 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:39.354568 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:39.354568 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:39.354568 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:39.354568 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:39.354568 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:39.354568 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:39.354568 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:39.354568 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:39.354568 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:39.354568 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:39.354568 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:39.354568 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:39.354568 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:39.354568 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:39.355739 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:39.355739 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:39.355739 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:39.355739 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:39.355739 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:39.355739 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:39.355739 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:39.355739 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:39.355739 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:39.355739 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:39.355739 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:39.355739 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:39.355739 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:39.355739 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:39.355739 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:39.355739 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:39.355739 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:39.356724 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:39.356724 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:39.356724 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:39.356724 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:39.357737 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 355/695] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:39.362409 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e3fe2-2467-467c-9c68-f6e04a412f2b None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:39.362409 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e3fe2-2467-467c-9c68-f6e04a412f2b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:39.362409 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e3fe2-2467-467c-9c68-f6e04a412f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:39.380634 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-234e3fe2-2467-467c-9c68-f6e04a412f2b None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:39.381894 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-234e3fe2-2467-467c-9c68-f6e04a412f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:39.456159 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 356/696] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:08:39.461025 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23281e4e-ff6b-4e08-925d-727a89e12be7 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:39.466204 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e3fe2-2467-467c-9c68-f6e04a412f2b None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:39.492260 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:39.500947 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf5876-01ae-455e-80ce-faf91a7eacbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:39.502110 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf5876-01ae-455e-80ce-faf91a7eacbf None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:39.502649 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf5876-01ae-455e-80ce-faf91a7eacbf None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:39.503127 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf5876-01ae-455e-80ce-faf91a7eacbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:39.540131 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:39.583526 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caf5876-01ae-455e-80ce-faf91a7eacbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:39.585526 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caf5876-01ae-455e-80ce-faf91a7eacbf None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:39.589783 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e3fe2-2467-467c-9c68-f6e04a412f2b None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:39.627663 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c9d31-903e-43b5-923c-7efeb967ad8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:39.628329 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c9d31-903e-43b5-923c-7efeb967ad8a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:39.628609 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c9d31-903e-43b5-923c-7efeb967ad8a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:39.628886 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c9d31-903e-43b5-923c-7efeb967ad8a None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:39.629614 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c9d31-903e-43b5-923c-7efeb967ad8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:39.629949 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c9d31-903e-43b5-923c-7efeb967ad8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:39.631338 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c9d31-903e-43b5-923c-7efeb967ad8a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:39.647622 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 357/697] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:39.647622 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c9d31-903e-43b5-923c-7efeb967ad8a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:39.703600 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 341/698] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:08:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:08:39.704898 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf5876-01ae-455e-80ce-faf91a7eacbf None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:39.732324 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:39.758363 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c9d31-903e-43b5-923c-7efeb967ad8a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:39.776164 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:39.794096 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211277e7-f49b-4208-8156-65cadb83d826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:39.794899 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211277e7-f49b-4208-8156-65cadb83d826 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:39.795181 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211277e7-f49b-4208-8156-65cadb83d826 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:39.795457 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211277e7-f49b-4208-8156-65cadb83d826 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:39.806521 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211277e7-f49b-4208-8156-65cadb83d826 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:39.807980 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211277e7-f49b-4208-8156-65cadb83d826 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:39.821098 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf5876-01ae-455e-80ce-faf91a7eacbf None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:39.825312 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-211277e7-f49b-4208-8156-65cadb83d826 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:39.825312 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:39.825312 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:39.825312 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:39.825312 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:39.825312 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:39.825312 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:39.825312 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:39.825312 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:39.825312 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:39.825312 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:39.825312 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:39.825312 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:39.825312 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:39.825312 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:39.826247 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:39.826247 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:39.826247 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:39.826247 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:39.826247 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:39.826247 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:39.826247 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:39.826247 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:39.826247 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:39.826247 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:39.826247 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:39.826247 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:39.826247 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:39.826247 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:39.826247 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:39.826247 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:39.826247 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:39.827537 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:39.827537 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:39.827537 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:39.827537 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:39.827537 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 358/699] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:39.828247 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211277e7-f49b-4208-8156-65cadb83d826 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:39.863218 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac1791-2418-4286-b62c-e91dcc1c0769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:39.864432 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac1791-2418-4286-b62c-e91dcc1c0769 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:39.864959 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac1791-2418-4286-b62c-e91dcc1c0769 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:39.865475 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac1791-2418-4286-b62c-e91dcc1c0769 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:39.873507 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac1791-2418-4286-b62c-e91dcc1c0769 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:39.875435 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac1791-2418-4286-b62c-e91dcc1c0769 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:39.890909 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-71ac1791-2418-4286-b62c-e91dcc1c0769 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:39.890909 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:39.890909 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:39.890909 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:39.890909 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:39.890909 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:39.890909 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:39.890909 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:39.890909 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:39.890909 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:39.890909 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:39.890909 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:39.890909 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:08:39.890909 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:08:39.890909 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:08:39.892310 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:08:39.892310 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:39.892310 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:39.892310 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:39.892310 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:39.892310 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:39.892310 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:39.892310 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:39.892310 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:39.892310 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:39.892310 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:39.892310 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:39.892310 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:39.892310 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:39.892310 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:39.892310 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:39.892310 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:39.893216 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:08:39.893216 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:08:39.893216 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:08:39.893216 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:08:39.893216 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:08:39.893216 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:08:39.893216 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:39.893216 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:39.901048 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 342/700] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jun 29 12:08:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:39.902246 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac1791-2418-4286-b62c-e91dcc1c0769 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:39.932059 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211277e7-f49b-4208-8156-65cadb83d826 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:39.962954 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:39.968162 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4651fd2-1f07-4e2e-8cac-cf6fbef9fe64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:39.968981 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4651fd2-1f07-4e2e-8cac-cf6fbef9fe64 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:39.969261 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4651fd2-1f07-4e2e-8cac-cf6fbef9fe64 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:39.969530 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4651fd2-1f07-4e2e-8cac-cf6fbef9fe64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:39.984548 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4651fd2-1f07-4e2e-8cac-cf6fbef9fe64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:39.987134 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4651fd2-1f07-4e2e-8cac-cf6fbef9fe64 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:40.009243 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-b4651fd2-1f07-4e2e-8cac-cf6fbef9fe64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:40.009243 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:40.009243 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:40.009243 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:40.009243 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:40.009243 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:40.009243 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:40.009243 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:40.009243 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:40.009243 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:40.009243 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:40.009243 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:40.009243 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:40.009243 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:40.009243 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:40.010270 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:40.010270 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:40.010270 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:40.010270 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:40.010270 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:40.010270 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:40.010270 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:40.010270 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:40.010270 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:40.010270 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:40.010270 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:40.010270 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:40.010270 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:40.010270 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:40.010270 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:40.010270 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:40.010270 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:40.011272 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:40.011272 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:40.011272 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:40.011272 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:40.011272 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 359/701] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:40.012039 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4651fd2-1f07-4e2e-8cac-cf6fbef9fe64 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:40.023253 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac1791-2418-4286-b62c-e91dcc1c0769 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:40.064708 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:40.080729 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fee0638-18c3-49b8-a87d-b091b9409d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:40.081641 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee0638-18c3-49b8-a87d-b091b9409d0e None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:40.082338 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee0638-18c3-49b8-a87d-b091b9409d0e None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:40.082621 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee0638-18c3-49b8-a87d-b091b9409d0e None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:40.083632 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fee0638-18c3-49b8-a87d-b091b9409d0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:40.083944 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fee0638-18c3-49b8-a87d-b091b9409d0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:40.086368 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fee0638-18c3-49b8-a87d-b091b9409d0e None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:40.105863 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 343/702] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:40.106988 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fee0638-18c3-49b8-a87d-b091b9409d0e None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:40.138090 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4651fd2-1f07-4e2e-8cac-cf6fbef9fe64 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:40.175061 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5013979-d9bf-49f2-9a43-222199dae3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:40.175755 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5013979-d9bf-49f2-9a43-222199dae3be None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:40.176037 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5013979-d9bf-49f2-9a43-222199dae3be None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:40.176312 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5013979-d9bf-49f2-9a43-222199dae3be None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:40.177106 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5013979-d9bf-49f2-9a43-222199dae3be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:40.177416 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5013979-d9bf-49f2-9a43-222199dae3be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:40.179064 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5013979-d9bf-49f2-9a43-222199dae3be None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:40.192082 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 360/703] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jun 29 12:08:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:40.192928 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5013979-d9bf-49f2-9a43-222199dae3be None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:40.224999 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fee0638-18c3-49b8-a87d-b091b9409d0e None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:40.241135 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:40.262225 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839f2ac-bb77-422b-9d90-c5ff40bcfee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:40.262903 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839f2ac-bb77-422b-9d90-c5ff40bcfee6 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:40.263182 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839f2ac-bb77-422b-9d90-c5ff40bcfee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:40.263456 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839f2ac-bb77-422b-9d90-c5ff40bcfee6 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:40.264184 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3839f2ac-bb77-422b-9d90-c5ff40bcfee6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:40.264485 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3839f2ac-bb77-422b-9d90-c5ff40bcfee6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:40.265947 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3839f2ac-bb77-422b-9d90-c5ff40bcfee6 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:40.278356 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 344/704] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:40.279008 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839f2ac-bb77-422b-9d90-c5ff40bcfee6 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:40.297500 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5013979-d9bf-49f2-9a43-222199dae3be None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:40.331544 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:40.334130 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a989de-b261-49b7-98e0-1d7fb2cc7653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:40.335037 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a989de-b261-49b7-98e0-1d7fb2cc7653 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:40.335464 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a989de-b261-49b7-98e0-1d7fb2cc7653 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:40.335978 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a989de-b261-49b7-98e0-1d7fb2cc7653 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:40.336858 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a989de-b261-49b7-98e0-1d7fb2cc7653 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:40.338499 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a989de-b261-49b7-98e0-1d7fb2cc7653 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:40.360113 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 361/705] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Jun 29 12:08:40 2022] POST /identity/v3/users => generated 254 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:08:40.361275 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a989de-b261-49b7-98e0-1d7fb2cc7653 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:40.396955 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839f2ac-bb77-422b-9d90-c5ff40bcfee6 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:40.444281 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533bbe2d-3d05-44e1-b537-8a25f063178d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:40.446493 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533bbe2d-3d05-44e1-b537-8a25f063178d None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:40.446974 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533bbe2d-3d05-44e1-b537-8a25f063178d None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:40.447393 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533bbe2d-3d05-44e1-b537-8a25f063178d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:40.448446 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533bbe2d-3d05-44e1-b537-8a25f063178d None admin] RBAC: Adding query filter params (role.id=6f63a9619c7b40ebb5b73bde026d606b, scope.project.id=996db30845f84e57865fa40b9a730a05, user.id=cc92f8232bda407c84365eb10ede737f) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:40.448965 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533bbe2d-3d05-44e1-b537-8a25f063178d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:40.450754 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533bbe2d-3d05-44e1-b537-8a25f063178d None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:40.458721 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 345/706] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jun 29 12:08:40 2022] GET /identity/v3/role_assignments?user.id=cc92f8232bda407c84365eb10ede737f&scope.project.id=996db30845f84e57865fa40b9a730a05&role.id=6f63a9619c7b40ebb5b73bde026d606b => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:40.460621 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3b541-3c9a-4c21-983e-22c2808b25c1 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:40.461369 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3b541-3c9a-4c21-983e-22c2808b25c1 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:40.462007 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3b541-3c9a-4c21-983e-22c2808b25c1 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:40.464091 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 346/707] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:08:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:40.470597 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839eee4-ca6e-4953-9169-b1f1dff6aca3 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:40.471231 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839eee4-ca6e-4953-9169-b1f1dff6aca3 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:40.471712 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839eee4-ca6e-4953-9169-b1f1dff6aca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:40.478237 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:40.482846 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a989de-b261-49b7-98e0-1d7fb2cc7653 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:40.491197 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-a839eee4-ca6e-4953-9169-b1f1dff6aca3 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:40.493009 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a839eee4-ca6e-4953-9169-b1f1dff6aca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:40.527617 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40017530-c8d0-428f-8af6-4eec8d7c5986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:40.528446 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40017530-c8d0-428f-8af6-4eec8d7c5986 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:40.528727 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40017530-c8d0-428f-8af6-4eec8d7c5986 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:40.528999 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40017530-c8d0-428f-8af6-4eec8d7c5986 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:40.539706 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40017530-c8d0-428f-8af6-4eec8d7c5986 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:40.541454 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40017530-c8d0-428f-8af6-4eec8d7c5986 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:40.565130 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-40017530-c8d0-428f-8af6-4eec8d7c5986 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:40.565130 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:40.565130 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:40.565130 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:40.565130 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:40.565130 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:40.565130 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:40.565130 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:40.565130 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:40.565130 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:40.565130 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:40.565130 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:40.565130 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:08:40.565130 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:08:40.565130 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:08:40.566130 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:08:40.566130 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:40.566130 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:40.566130 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:40.566130 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:40.566130 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:40.566130 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:40.566130 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:40.566130 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:40.566130 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:40.566130 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:40.566130 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:40.566130 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:40.566130 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:40.566130 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:40.566130 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:40.566130 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:40.567536 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:08:40.567536 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:08:40.567536 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:08:40.567536 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:08:40.567536 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:08:40.567536 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:08:40.567536 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:40.567536 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:40.567536 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 362/708] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jun 29 12:08:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:40.572899 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40017530-c8d0-428f-8af6-4eec8d7c5986 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:40.605474 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 347/709] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:08:40.628875 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a839eee4-ca6e-4953-9169-b1f1dff6aca3 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:40.676348 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:40.693659 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40017530-c8d0-428f-8af6-4eec8d7c5986 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:40.737898 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2cc3c1-ba36-4279-a2f8-3ce659e08d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:40.738571 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2cc3c1-ba36-4279-a2f8-3ce659e08d5e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:40.738852 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2cc3c1-ba36-4279-a2f8-3ce659e08d5e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:40.739129 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2cc3c1-ba36-4279-a2f8-3ce659e08d5e None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:40.739926 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2cc3c1-ba36-4279-a2f8-3ce659e08d5e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:40.740237 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2cc3c1-ba36-4279-a2f8-3ce659e08d5e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:40.741773 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2cc3c1-ba36-4279-a2f8-3ce659e08d5e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:40.753153 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a839eee4-ca6e-4953-9169-b1f1dff6aca3 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:40.754494 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 363/710] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jun 29 12:08:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:40.760818 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2cc3c1-ba36-4279-a2f8-3ce659e08d5e None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:40.791992 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:40.800184 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fefbf9-a3d4-45d2-9b60-07d64a773973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:40.801019 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fefbf9-a3d4-45d2-9b60-07d64a773973 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:40.801297 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fefbf9-a3d4-45d2-9b60-07d64a773973 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:40.801566 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fefbf9-a3d4-45d2-9b60-07d64a773973 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:40.802267 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fefbf9-a3d4-45d2-9b60-07d64a773973 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:40.803646 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fefbf9-a3d4-45d2-9b60-07d64a773973 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:40.821839 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-14fefbf9-a3d4-45d2-9b60-07d64a773973 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 12:08:40.821839 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:40.821839 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 12:08:40.821839 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 12:08:40.821839 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 12:08:40.821839 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 12:08:40.821839 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 12:08:40.821839 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:08:40.821839 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 12:08:40.821839 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:40.821839 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 12:08:40.821839 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:40.821839 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:40.821839 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:40.821839 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:40.821839 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:40.822901 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:40.822901 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:40.822901 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:40.822901 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:40.822901 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:40.822901 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:40.822901 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:40.822901 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 12:08:40.822901 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 12:08:40.822901 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 12:08:40.822901 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 12:08:40.822901 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:40.822901 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:40.822901 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:40.822901 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:40.822901 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:40.824233 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:40.824233 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:40.824233 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:40.824233 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:40.824233 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:40.824233 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:40.824233 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:40.824233 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:40.824233 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:40.824233 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:40.824233 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:40.824233 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 12:08:40.824233 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:08:40.824233 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 12:08:40.824233 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:40.824233 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 348/711] 10.222.0.27 () {56 vars in 1129 bytes} [Wed Jun 29 12:08:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:08:40.829670 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fefbf9-a3d4-45d2-9b60-07d64a773973 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:40.897882 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2cc3c1-ba36-4279-a2f8-3ce659e08d5e None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:40.934487 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fefbf9-a3d4-45d2-9b60-07d64a773973 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:40.937978 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:40.943386 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1d157b-669a-4444-80b4-7a11ca7fea51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:40.944077 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d157b-669a-4444-80b4-7a11ca7fea51 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:40.944356 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d157b-669a-4444-80b4-7a11ca7fea51 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:40.944845 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d157b-669a-4444-80b4-7a11ca7fea51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:40.949846 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1d157b-669a-4444-80b4-7a11ca7fea51 None admin] RBAC: Adding query filter params (role.id=e0e69ac8a8bf4cc4baa6aa18f2fc9919, scope.project.id=996db30845f84e57865fa40b9a730a05, user.id=7adaa2ef440941aa8214f2b2fd49b54e) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:40.950209 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1d157b-669a-4444-80b4-7a11ca7fea51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:40.951697 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1d157b-669a-4444-80b4-7a11ca7fea51 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:40.964797 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 364/712] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jun 29 12:08:40 2022] GET /identity/v3/role_assignments?user.id=7adaa2ef440941aa8214f2b2fd49b54e&scope.project.id=996db30845f84e57865fa40b9a730a05&role.id=e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:08:40.974223 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477f56d-a2ed-4370-ac80-cc0ada7bcde8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:40.975006 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477f56d-a2ed-4370-ac80-cc0ada7bcde8 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:40.975293 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477f56d-a2ed-4370-ac80-cc0ada7bcde8 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:40.975571 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477f56d-a2ed-4370-ac80-cc0ada7bcde8 None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:40.976403 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477f56d-a2ed-4370-ac80-cc0ada7bcde8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:40.976717 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477f56d-a2ed-4370-ac80-cc0ada7bcde8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:40.978216 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477f56d-a2ed-4370-ac80-cc0ada7bcde8 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:40.984230 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 349/713] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Jun 29 12:08:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:08:40.989684 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477f56d-a2ed-4370-ac80-cc0ada7bcde8 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:40.989875 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef099f5-505d-4f60-9887-c354f970268a None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:40.990024 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef099f5-505d-4f60-9887-c354f970268a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:40.990304 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef099f5-505d-4f60-9887-c354f970268a None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:40.992244 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 365/714] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:08:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:40.997798 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b8b3c-90b3-4baf-a0d4-387b68959888 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:40.998088 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b8b3c-90b3-4baf-a0d4-387b68959888 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:40.998372 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b8b3c-90b3-4baf-a0d4-387b68959888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:41.027113 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f48b8b3c-90b3-4baf-a0d4-387b68959888 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:41.035407 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f48b8b3c-90b3-4baf-a0d4-387b68959888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:41.179710 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 366/715] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 12:08:41.187793 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477f56d-a2ed-4370-ac80-cc0ada7bcde8 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:41.224311 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b8b3c-90b3-4baf-a0d4-387b68959888 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:41.237905 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff0449c-9784-4b38-9f78-8056fc3820b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:41.238938 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff0449c-9784-4b38-9f78-8056fc3820b1 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:41.239449 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff0449c-9784-4b38-9f78-8056fc3820b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:41.239923 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff0449c-9784-4b38-9f78-8056fc3820b1 None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:41.240839 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff0449c-9784-4b38-9f78-8056fc3820b1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:41.241414 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff0449c-9784-4b38-9f78-8056fc3820b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:41.243130 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff0449c-9784-4b38-9f78-8056fc3820b1 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:41.250890 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 350/716] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Jun 29 12:08:40 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:41.261009 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:41.397558 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b8b3c-90b3-4baf-a0d4-387b68959888 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:41.444975 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95cebb4-1d41-4f46-be7a-138aeaee5157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:41.445756 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95cebb4-1d41-4f46-be7a-138aeaee5157 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:41.446045 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95cebb4-1d41-4f46-be7a-138aeaee5157 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:41.446314 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95cebb4-1d41-4f46-be7a-138aeaee5157 None admin] PATH_INFO: `/v3/services/network` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:41.446974 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95cebb4-1d41-4f46-be7a-138aeaee5157 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:41.448416 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95cebb4-1d41-4f46-be7a-138aeaee5157 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:41.468302 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-c95cebb4-1d41-4f46-be7a-138aeaee5157 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 12:08:41.468302 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:41.468302 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 12:08:41.468302 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 12:08:41.468302 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 12:08:41.468302 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 12:08:41.468302 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 12:08:41.468302 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:08:41.468302 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 12:08:41.468302 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:41.468302 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 12:08:41.468302 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:41.468302 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:41.468302 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:41.468302 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:41.468302 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:41.468302 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:41.469477 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:41.469477 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:41.469477 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:41.469477 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:41.469477 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:41.469477 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:41.469477 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 12:08:41.469477 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 12:08:41.469477 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 12:08:41.469477 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 12:08:41.469477 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:41.469477 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:41.469477 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:41.469477 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:41.469477 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:41.469477 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:41.470386 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:41.470386 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:41.470386 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:41.470386 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:41.470386 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:41.470386 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:41.470386 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:41.470386 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:41.470386 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:41.470386 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:41.470386 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 12:08:41.470386 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:08:41.470386 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 12:08:41.470386 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:41.470386 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 367/717] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jun 29 12:08:41 2022] GET /identity/v3/services/network => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:08:41.478263 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff0449c-9784-4b38-9f78-8056fc3820b1 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:41.550915 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:41.661056 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff0449c-9784-4b38-9f78-8056fc3820b1 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:41.724400 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc1c9a-8823-4d98-a75b-8000a9d25cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:41.725440 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc1c9a-8823-4d98-a75b-8000a9d25cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:41.726047 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc1c9a-8823-4d98-a75b-8000a9d25cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:41.726556 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc1c9a-8823-4d98-a75b-8000a9d25cc3 None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:41.727502 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdc1c9a-8823-4d98-a75b-8000a9d25cc3 None admin] RBAC: Adding query filter params (name=network) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:41.728008 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdc1c9a-8823-4d98-a75b-8000a9d25cc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:41.729593 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdc1c9a-8823-4d98-a75b-8000a9d25cc3 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:41.737899 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 351/718] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Jun 29 12:08:41 2022] GET /identity/v3/services?name=network => generated 124 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:41.743768 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95cebb4-1d41-4f46-be7a-138aeaee5157 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:41.845004 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:41.872854 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95cebb4-1d41-4f46-be7a-138aeaee5157 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:41.921882 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cecd53-9cb7-409a-a855-9cc8c764643f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:41.922955 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cecd53-9cb7-409a-a855-9cc8c764643f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:41.923463 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cecd53-9cb7-409a-a855-9cc8c764643f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:41.923954 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cecd53-9cb7-409a-a855-9cc8c764643f None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:41.924871 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cecd53-9cb7-409a-a855-9cc8c764643f None admin] RBAC: Adding query filter params (type=network) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:41.925381 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cecd53-9cb7-409a-a855-9cc8c764643f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:41.926990 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cecd53-9cb7-409a-a855-9cc8c764643f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:41.933573 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 368/719] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Jun 29 12:08:41 2022] GET /identity/v3/services?type=network => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:42.932229 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db848893-f876-41fd-889d-51c37b365091 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:42.932772 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db848893-f876-41fd-889d-51c37b365091 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:42.932772 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db848893-f876-41fd-889d-51c37b365091 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:42.934412 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 352/720] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:08:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:42.939913 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a19eea-94f2-4c7a-9238-575d04ee2872 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:42.940343 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a19eea-94f2-4c7a-9238-575d04ee2872 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:42.940516 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a19eea-94f2-4c7a-9238-575d04ee2872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:42.967239 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-41a19eea-94f2-4c7a-9238-575d04ee2872 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:42.968450 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-41a19eea-94f2-4c7a-9238-575d04ee2872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:43.058293 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 369/721] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:08:43.103934 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db848893-f876-41fd-889d-51c37b365091 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:43.231554 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:43.238933 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db848893-f876-41fd-889d-51c37b365091 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:43.286445 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf5ee74-f287-461d-aac3-c357d585bf2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:43.287251 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5ee74-f287-461d-aac3-c357d585bf2a None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:43.287528 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5ee74-f287-461d-aac3-c357d585bf2a None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:43.287794 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5ee74-f287-461d-aac3-c357d585bf2a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:43.306598 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf5ee74-f287-461d-aac3-c357d585bf2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:08:43.314326 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-faf5ee74-f287-461d-aac3-c357d585bf2a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:08:43.314326 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:43.314326 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:43.314326 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:43.314326 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:43.314326 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:43.314326 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:43.314326 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:43.314326 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:43.314326 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:43.314326 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:43.314326 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:43.314326 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:08:43.314326 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:08:43.314326 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:08:43.314326 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:08:43.315261 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:08:43.315261 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:08:43.315261 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:08:43.315261 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:08:43.315261 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:43.315261 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:43.315261 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:43.315261 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:43.315261 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:43.315261 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:43.315261 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:43.315261 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:43.315261 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:43.315261 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:43.315261 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:43.315261 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:43.316115 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:43.316115 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:43.316115 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:43.316115 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:43.316115 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:08:43.316115 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:08:43.316115 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:08:43.316115 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:08:43.316115 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:08:43.316115 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:08:43.316115 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:08:43.316115 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:43.316115 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 353/722] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jun 29 12:08:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:43.322846 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a19eea-94f2-4c7a-9238-575d04ee2872 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:43.328772 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda00d46-fcd6-42b8-b8e0-eb76e889e540 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:43.329054 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda00d46-fcd6-42b8-b8e0-eb76e889e540 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:43.329338 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda00d46-fcd6-42b8-b8e0-eb76e889e540 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:43.330727 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 354/723] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:08:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:43.340371 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37cd66d-eb30-424b-b5d6-3ed3cb0fbcdd None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:43.340655 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37cd66d-eb30-424b-b5d6-3ed3cb0fbcdd None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:43.340926 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37cd66d-eb30-424b-b5d6-3ed3cb0fbcdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:43.371974 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-d37cd66d-eb30-424b-b5d6-3ed3cb0fbcdd None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:43.373189 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-d37cd66d-eb30-424b-b5d6-3ed3cb0fbcdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:43.426452 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:43.448444 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 355/724] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 12:08:43.455254 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba7a59-7c79-41ab-b1ce-0024f5bbbe1f None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:43.455575 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba7a59-7c79-41ab-b1ce-0024f5bbbe1f None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:43.455936 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba7a59-7c79-41ab-b1ce-0024f5bbbe1f None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:43.457395 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 356/725] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:08:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:43.464463 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe7149e-8560-4c2f-9e86-68f231a71c26 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:43.464783 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe7149e-8560-4c2f-9e86-68f231a71c26 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:43.465026 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe7149e-8560-4c2f-9e86-68f231a71c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:43.469185 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a19eea-94f2-4c7a-9238-575d04ee2872 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:43.497094 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-bbe7149e-8560-4c2f-9e86-68f231a71c26 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:43.498570 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-bbe7149e-8560-4c2f-9e86-68f231a71c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:43.514517 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f87a0-7b5d-40c9-81cc-70763f4b05c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:43.515660 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f87a0-7b5d-40c9-81cc-70763f4b05c8 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:43.515941 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f87a0-7b5d-40c9-81cc-70763f4b05c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:43.516348 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f87a0-7b5d-40c9-81cc-70763f4b05c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:43.517222 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418f87a0-7b5d-40c9-81cc-70763f4b05c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:43.517548 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418f87a0-7b5d-40c9-81cc-70763f4b05c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:43.519514 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418f87a0-7b5d-40c9-81cc-70763f4b05c8 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:43.531231 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 370/726] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jun 29 12:08:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:43.532461 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f87a0-7b5d-40c9-81cc-70763f4b05c8 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:43.584926 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 357/727] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 12:08:43.586069 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe7149e-8560-4c2f-9e86-68f231a71c26 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:43.603245 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:43.672701 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f87a0-7b5d-40c9-81cc-70763f4b05c8 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:43.697155 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe7149e-8560-4c2f-9e86-68f231a71c26 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:43.712730 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074aca4d-3e49-4800-ad7c-b27dd52095b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:43.713526 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074aca4d-3e49-4800-ad7c-b27dd52095b8 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:43.713831 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074aca4d-3e49-4800-ad7c-b27dd52095b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:43.714099 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074aca4d-3e49-4800-ad7c-b27dd52095b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:43.716140 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:43.726390 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074aca4d-3e49-4800-ad7c-b27dd52095b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:08:43.735092 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-074aca4d-3e49-4800-ad7c-b27dd52095b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:08:43.735092 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:43.735092 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:43.735092 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:43.735092 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:43.735092 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:43.735092 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:43.735092 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:43.735092 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:43.735092 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:43.735092 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:43.735092 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:43.735092 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:08:43.735092 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:08:43.735092 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:08:43.735092 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:08:43.736276 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:08:43.736276 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:08:43.736276 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:08:43.736276 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:08:43.736276 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:43.736276 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:43.736276 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:43.736276 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:43.736276 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:43.736276 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:43.736276 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:43.736276 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:43.736276 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:43.736276 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:43.736276 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:43.736276 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:43.737349 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:43.737349 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:43.737349 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:43.737349 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:43.737349 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:08:43.737349 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:08:43.737349 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:08:43.737349 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:08:43.737349 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:08:43.737349 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:08:43.737349 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:08:43.737349 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:43.745496 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 371/728] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jun 29 12:08:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:43.745496 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074aca4d-3e49-4800-ad7c-b27dd52095b8 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:43.753429 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f49684-fd0d-44a1-bc4b-12cb7e6b4bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:43.754914 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f49684-fd0d-44a1-bc4b-12cb7e6b4bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:43.755404 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f49684-fd0d-44a1-bc4b-12cb7e6b4bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:43.756234 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f49684-fd0d-44a1-bc4b-12cb7e6b4bb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:43.770194 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f49684-fd0d-44a1-bc4b-12cb7e6b4bb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:43.772457 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f49684-fd0d-44a1-bc4b-12cb7e6b4bb8 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:43.795113 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-47f49684-fd0d-44a1-bc4b-12cb7e6b4bb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:43.795113 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:43.795113 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:43.795113 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:43.795113 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:43.795113 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:43.795113 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:43.795113 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:43.795113 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:43.795113 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:43.795113 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:43.795113 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:43.795113 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:43.795113 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:43.795113 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:43.796109 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:43.796109 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:43.796109 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:43.796109 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:43.796109 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:43.796109 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:43.796109 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:43.796109 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:43.796109 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:43.796109 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:43.796109 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:43.796109 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:43.796109 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:43.796109 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:43.796109 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:43.796109 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:43.796109 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:43.797190 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:43.797190 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:43.797190 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:43.797190 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:43.797190 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 358/729] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:43.798322 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f49684-fd0d-44a1-bc4b-12cb7e6b4bb8 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:43.863520 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074aca4d-3e49-4800-ad7c-b27dd52095b8 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:43.876753 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:43.902659 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840218a9-d468-4a04-aabb-8c5779e25ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:43.904324 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840218a9-d468-4a04-aabb-8c5779e25ace None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:43.904913 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840218a9-d468-4a04-aabb-8c5779e25ace None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:43.905468 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840218a9-d468-4a04-aabb-8c5779e25ace None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:43.915833 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f49684-fd0d-44a1-bc4b-12cb7e6b4bb8 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:43.920151 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840218a9-d468-4a04-aabb-8c5779e25ace None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:08:43.930337 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-840218a9-d468-4a04-aabb-8c5779e25ace None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:08:43.930337 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:43.930337 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:43.930337 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:43.930337 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:43.930337 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:43.930337 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:43.930337 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:43.930337 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:43.930337 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:43.930337 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:43.930337 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:43.930337 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:08:43.930337 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:08:43.930337 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:08:43.930337 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:08:43.931324 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:08:43.931324 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:08:43.931324 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:08:43.931324 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:08:43.931324 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:43.931324 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:43.931324 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:43.931324 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:43.931324 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:43.931324 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:43.931324 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:43.931324 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:43.931324 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:43.931324 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:43.931324 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:43.931324 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:43.932217 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:43.932217 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:43.932217 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:43.932217 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:43.932217 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:08:43.932217 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:08:43.932217 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:08:43.932217 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:08:43.932217 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:08:43.932217 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:08:43.932217 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:08:43.932217 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:43.939338 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 372/730] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jun 29 12:08:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:43.939338 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840218a9-d468-4a04-aabb-8c5779e25ace None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:43.958556 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f2e32a-6dc2-434f-b430-0ffe512855fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:43.959222 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2e32a-6dc2-434f-b430-0ffe512855fd None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:43.959497 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2e32a-6dc2-434f-b430-0ffe512855fd None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:43.959768 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2e32a-6dc2-434f-b430-0ffe512855fd None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:43.960545 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f2e32a-6dc2-434f-b430-0ffe512855fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:43.960845 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f2e32a-6dc2-434f-b430-0ffe512855fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:43.962259 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f2e32a-6dc2-434f-b430-0ffe512855fd None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:43.970967 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 359/731] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:08:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:43.976063 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474eff9-ef3d-4374-b301-b4b2850ee02e None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:43.976063 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474eff9-ef3d-4374-b301-b4b2850ee02e None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:43.976063 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474eff9-ef3d-4374-b301-b4b2850ee02e None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:43.976063 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 360/732] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:08:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:43.976063 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8474eff9-ef3d-4374-b301-b4b2850ee02e None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:44.004891 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:44.057260 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840218a9-d468-4a04-aabb-8c5779e25ace None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:44.092012 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e19b5-660e-45ce-83af-ed061287c0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:44.092964 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e19b5-660e-45ce-83af-ed061287c0cc None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:44.093249 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e19b5-660e-45ce-83af-ed061287c0cc None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:44.093526 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e19b5-660e-45ce-83af-ed061287c0cc None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:44.094335 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283e19b5-660e-45ce-83af-ed061287c0cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:44.094598 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283e19b5-660e-45ce-83af-ed061287c0cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:44.094943 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8474eff9-ef3d-4374-b301-b4b2850ee02e None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:44.095998 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283e19b5-660e-45ce-83af-ed061287c0cc None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:44.112816 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 373/733] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:44.112816 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e19b5-660e-45ce-83af-ed061287c0cc None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:44.128479 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:44.137922 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5814a6-8be7-4cea-a479-cd7abf1f8c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:44.138592 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5814a6-8be7-4cea-a479-cd7abf1f8c1f None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:44.138944 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5814a6-8be7-4cea-a479-cd7abf1f8c1f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:44.139181 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5814a6-8be7-4cea-a479-cd7abf1f8c1f None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:44.139876 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5814a6-8be7-4cea-a479-cd7abf1f8c1f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:44.140181 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5814a6-8be7-4cea-a479-cd7abf1f8c1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:44.141544 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5814a6-8be7-4cea-a479-cd7abf1f8c1f None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:44.154821 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 361/734] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:08:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:44.154821 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92807db6-ecc2-4d45-a967-bd6c5d5c7b22 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:44.154821 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92807db6-ecc2-4d45-a967-bd6c5d5c7b22 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:44.154821 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92807db6-ecc2-4d45-a967-bd6c5d5c7b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:44.169612 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-92807db6-ecc2-4d45-a967-bd6c5d5c7b22 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:44.170971 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-92807db6-ecc2-4d45-a967-bd6c5d5c7b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:44.219062 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e19b5-660e-45ce-83af-ed061287c0cc None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:44.234782 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:44.240894 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 362/735] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:08:44.242555 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92807db6-ecc2-4d45-a967-bd6c5d5c7b22 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:44.266224 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf36e1f-30e7-40c9-bbef-094f367f12d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:44.267154 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf36e1f-30e7-40c9-bbef-094f367f12d3 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:44.267506 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf36e1f-30e7-40c9-bbef-094f367f12d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:44.267943 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf36e1f-30e7-40c9-bbef-094f367f12d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:44.279195 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf36e1f-30e7-40c9-bbef-094f367f12d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:44.280668 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf36e1f-30e7-40c9-bbef-094f367f12d3 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:44.301065 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-aaf36e1f-30e7-40c9-bbef-094f367f12d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:44.301065 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:44.301065 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:44.301065 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:44.301065 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:44.301065 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:44.301065 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:44.301065 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:44.301065 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:44.301065 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:44.301065 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:44.301065 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:44.301065 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:44.301065 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:44.301065 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:44.302060 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:44.302060 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:44.302060 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:44.302060 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:44.302060 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:44.302060 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:44.302060 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:44.302060 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:44.302060 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:44.302060 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:44.302060 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:44.302060 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:44.302060 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:44.302060 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:44.302060 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:44.302060 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:44.302060 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:44.302983 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:44.302983 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:44.302983 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:44.302983 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:44.302983 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 374/736] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:44.303275 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf36e1f-30e7-40c9-bbef-094f367f12d3 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:44.359954 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92807db6-ecc2-4d45-a967-bd6c5d5c7b22 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:44.381751 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:44.397994 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73111b02-aaf2-4b3f-9cef-cc1e1e9e7bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:44.399133 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73111b02-aaf2-4b3f-9cef-cc1e1e9e7bf3 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:44.399684 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73111b02-aaf2-4b3f-9cef-cc1e1e9e7bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:44.400554 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73111b02-aaf2-4b3f-9cef-cc1e1e9e7bf3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:44.410510 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73111b02-aaf2-4b3f-9cef-cc1e1e9e7bf3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:44.411889 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf36e1f-30e7-40c9-bbef-094f367f12d3 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:44.412385 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73111b02-aaf2-4b3f-9cef-cc1e1e9e7bf3 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:44.431380 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-73111b02-aaf2-4b3f-9cef-cc1e1e9e7bf3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 12:08:44.431380 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:44.431380 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:44.431380 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:44.431380 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:44.431380 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:44.431380 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:44.431380 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:44.431380 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:44.431380 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:44.431380 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:44.431380 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:44.431380 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:08:44.431380 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:08:44.431380 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:08:44.431380 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:08:44.432529 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:44.432529 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:44.432529 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:08:44.432529 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:44.432529 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:08:44.432529 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:44.432529 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:44.432529 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:44.432529 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:44.432529 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:44.432529 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:44.432529 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:44.432529 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:44.432529 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:44.432529 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:44.432529 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:44.432529 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:44.432529 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:44.433508 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:44.433508 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:44.433508 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:08:44.433508 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:08:44.433508 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:08:44.433508 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:08:44.433508 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:08:44.433508 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:08:44.433508 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 12:08:44.433508 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:44.433508 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 363/737] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Jun 29 12:08:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:44.434205 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73111b02-aaf2-4b3f-9cef-cc1e1e9e7bf3 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:44.447807 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f1ff5-2744-4b94-9702-a752c735fd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:44.448603 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f1ff5-2744-4b94-9702-a752c735fd29 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:44.448880 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f1ff5-2744-4b94-9702-a752c735fd29 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:44.449357 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f1ff5-2744-4b94-9702-a752c735fd29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:44.460585 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7f1ff5-2744-4b94-9702-a752c735fd29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:44.462209 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7f1ff5-2744-4b94-9702-a752c735fd29 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:44.479658 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-1d7f1ff5-2744-4b94-9702-a752c735fd29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:44.479658 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:44.479658 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:44.479658 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:44.479658 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:44.479658 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:44.479658 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:44.479658 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:44.479658 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:44.479658 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:44.479658 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:44.479658 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:44.479658 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:44.479658 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:44.479658 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:44.480763 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:44.480763 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:44.480763 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:44.480763 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:44.480763 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:44.480763 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:44.480763 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:44.480763 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:44.480763 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:44.480763 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:44.480763 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:44.480763 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:44.480763 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:44.480763 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:44.480763 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:44.480763 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:44.480763 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:44.482114 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:44.482114 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:44.482114 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:44.482114 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:44.482114 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 375/738] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:44.482114 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f1ff5-2744-4b94-9702-a752c735fd29 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:44.501312 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:44.540807 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73111b02-aaf2-4b3f-9cef-cc1e1e9e7bf3 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:44.575047 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1bead7-4171-43e6-840a-68504107fa5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:44.575715 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1bead7-4171-43e6-840a-68504107fa5b None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:44.575996 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1bead7-4171-43e6-840a-68504107fa5b None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:44.576267 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1bead7-4171-43e6-840a-68504107fa5b None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:44.577363 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1bead7-4171-43e6-840a-68504107fa5b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:44.578790 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1bead7-4171-43e6-840a-68504107fa5b None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:44.583408 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f1ff5-2744-4b94-9702-a752c735fd29 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:44.593723 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 364/739] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Jun 29 12:08:44 2022] POST /identity/v3/services => generated 251 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:08:44.607464 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979d546-1a6b-4c96-836b-d2adb7016cfc None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:44.607751 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979d546-1a6b-4c96-836b-d2adb7016cfc None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:44.608025 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979d546-1a6b-4c96-836b-d2adb7016cfc None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:44.609459 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 365/740] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:08:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:44.610402 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979d546-1a6b-4c96-836b-d2adb7016cfc None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:44.639350 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a720c4da-3492-457b-9693-a7f0e00ea6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:44.640302 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720c4da-3492-457b-9693-a7f0e00ea6b0 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:44.640784 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720c4da-3492-457b-9693-a7f0e00ea6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:44.641238 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720c4da-3492-457b-9693-a7f0e00ea6b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:44.642200 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a720c4da-3492-457b-9693-a7f0e00ea6b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:44.642698 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a720c4da-3492-457b-9693-a7f0e00ea6b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:44.644199 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a720c4da-3492-457b-9693-a7f0e00ea6b0 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:44.661007 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:44.666641 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 376/741] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:44.666641 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a720c4da-3492-457b-9693-a7f0e00ea6b0 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:44.739928 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979d546-1a6b-4c96-836b-d2adb7016cfc None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:44.755777 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:44.783605 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a720c4da-3492-457b-9693-a7f0e00ea6b0 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:44.784031 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a4147-8fb9-40b3-ad7b-9c2f63f2f702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:44.784707 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a4147-8fb9-40b3-ad7b-9c2f63f2f702 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:44.784986 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a4147-8fb9-40b3-ad7b-9c2f63f2f702 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:44.785256 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a4147-8fb9-40b3-ad7b-9c2f63f2f702 None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:44.786135 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905a4147-8fb9-40b3-ad7b-9c2f63f2f702 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:44.786439 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905a4147-8fb9-40b3-ad7b-9c2f63f2f702 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:44.787878 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905a4147-8fb9-40b3-ad7b-9c2f63f2f702 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:44.807494 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 366/742] 10.222.0.27 () {56 vars in 1149 bytes} [Wed Jun 29 12:08:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:44.808693 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5d9f9-0ba6-4c0b-9a35-354b0d39ede5 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:44.808977 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5d9f9-0ba6-4c0b-9a35-354b0d39ede5 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:44.809248 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5d9f9-0ba6-4c0b-9a35-354b0d39ede5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:44.827514 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-76d5d9f9-0ba6-4c0b-9a35-354b0d39ede5 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:44.829228 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-76d5d9f9-0ba6-4c0b-9a35-354b0d39ede5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:44.836018 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1624bc-4846-4ade-b5d6-7431ce30664e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:44.836710 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1624bc-4846-4ade-b5d6-7431ce30664e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:44.836994 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1624bc-4846-4ade-b5d6-7431ce30664e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:44.837271 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1624bc-4846-4ade-b5d6-7431ce30664e None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:44.838039 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1624bc-4846-4ade-b5d6-7431ce30664e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:44.838347 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1624bc-4846-4ade-b5d6-7431ce30664e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:44.839792 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1624bc-4846-4ade-b5d6-7431ce30664e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:44.858213 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 377/743] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:44.859709 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1624bc-4846-4ade-b5d6-7431ce30664e None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:44.925721 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 367/744] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:44 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 12:08:44.925721 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d5d9f9-0ba6-4c0b-9a35-354b0d39ede5 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:44.947122 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:44.987942 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1624bc-4846-4ade-b5d6-7431ce30664e None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:45.025915 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d5d9f9-0ba6-4c0b-9a35-354b0d39ede5 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:45.026450 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e1e00-434a-4d49-8d90-b6561e2cc094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:45.026839 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e1e00-434a-4d49-8d90-b6561e2cc094 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:45.027097 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e1e00-434a-4d49-8d90-b6561e2cc094 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:45.027530 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e1e00-434a-4d49-8d90-b6561e2cc094 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:45.029718 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:45.037141 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e1e00-434a-4d49-8d90-b6561e2cc094 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:45.039597 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e1e00-434a-4d49-8d90-b6561e2cc094 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:45.055845 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-192e1e00-434a-4d49-8d90-b6561e2cc094 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 29 12:08:45.055845 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:45.055845 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:45.055845 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:45.055845 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:45.055845 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:45.055845 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:45.055845 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:45.055845 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:45.055845 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:45.055845 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:45.055845 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:45.055845 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:08:45.055845 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:08:45.055845 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:08:45.055845 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:08:45.056771 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:45.056771 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:45.056771 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:08:45.056771 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:45.056771 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:08:45.056771 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:45.056771 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:45.056771 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:45.056771 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:45.056771 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:45.056771 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:45.056771 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:45.056771 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:45.056771 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:45.056771 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:45.056771 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:45.056771 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:45.056771 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:45.057805 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:45.057805 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:45.057805 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:08:45.057805 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:08:45.057805 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:08:45.057805 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:08:45.057805 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:08:45.057805 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:08:45.057805 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 29 12:08:45.057805 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:45.057805 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 378/745] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jun 29 12:08:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:45.058408 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e1e00-434a-4d49-8d90-b6561e2cc094 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:45.075122 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22651373-12c9-4b03-a6b0-816782d20c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:45.075852 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22651373-12c9-4b03-a6b0-816782d20c80 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:45.076079 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22651373-12c9-4b03-a6b0-816782d20c80 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:45.076324 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22651373-12c9-4b03-a6b0-816782d20c80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:45.150664 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22651373-12c9-4b03-a6b0-816782d20c80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:45.152157 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22651373-12c9-4b03-a6b0-816782d20c80 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:45.168810 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e1e00-434a-4d49-8d90-b6561e2cc094 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:45.185843 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:45.206543 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f9aad-c173-4b10-915f-15da2d974251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:45.207365 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f9aad-c173-4b10-915f-15da2d974251 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:45.207642 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f9aad-c173-4b10-915f-15da2d974251 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:45.208221 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f9aad-c173-4b10-915f-15da2d974251 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:45.217122 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4f9aad-c173-4b10-915f-15da2d974251 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:45.218736 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4f9aad-c173-4b10-915f-15da2d974251 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:45.233635 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-2d4f9aad-c173-4b10-915f-15da2d974251 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 12:08:45.233635 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:45.233635 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:45.233635 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:45.233635 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:45.233635 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:45.233635 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:45.233635 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:45.233635 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:45.233635 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:45.233635 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:45.233635 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:45.233635 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:08:45.233635 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:08:45.233635 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:08:45.233635 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:08:45.234941 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:45.234941 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:45.234941 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:08:45.234941 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:45.234941 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:08:45.234941 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:45.234941 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:45.234941 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:45.234941 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:45.234941 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:45.234941 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:45.234941 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:45.234941 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:45.234941 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:45.234941 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:45.234941 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:45.234941 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:45.234941 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:45.235886 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:45.235886 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:45.235886 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:08:45.235886 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:08:45.235886 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:08:45.235886 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:08:45.235886 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:08:45.235886 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:08:45.235886 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 12:08:45.235886 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:45.235886 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 379/746] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Jun 29 12:08:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:45.236467 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f9aad-c173-4b10-915f-15da2d974251 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:45.280244 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 368/747] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:08:44 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 12:08:45.281525 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22651373-12c9-4b03-a6b0-816782d20c80 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:45.313684 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:45.364213 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f9aad-c173-4b10-915f-15da2d974251 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:45.390045 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22651373-12c9-4b03-a6b0-816782d20c80 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:45.401215 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0302bcd-029b-4c17-a9e6-d4c58ff4e0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:45.402060 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0302bcd-029b-4c17-a9e6-d4c58ff4e0ba None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:45.402339 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0302bcd-029b-4c17-a9e6-d4c58ff4e0ba None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:45.402608 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0302bcd-029b-4c17-a9e6-d4c58ff4e0ba None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:45.403334 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0302bcd-029b-4c17-a9e6-d4c58ff4e0ba None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:45.404714 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0302bcd-029b-4c17-a9e6-d4c58ff4e0ba None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:45.417104 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:45.420226 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 380/748] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Jun 29 12:08:45 2022] POST /identity/v3/services => generated 240 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:08:45.421246 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0302bcd-029b-4c17-a9e6-d4c58ff4e0ba None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:45.443853 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe19e2f-5722-48fd-966a-287667e4cc9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:45.445234 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe19e2f-5722-48fd-966a-287667e4cc9f None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:45.445868 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe19e2f-5722-48fd-966a-287667e4cc9f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:45.446464 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe19e2f-5722-48fd-966a-287667e4cc9f None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:45.447601 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe19e2f-5722-48fd-966a-287667e4cc9f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:45.448171 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe19e2f-5722-48fd-966a-287667e4cc9f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:45.449941 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe19e2f-5722-48fd-966a-287667e4cc9f None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:45.479131 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 369/749] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Jun 29 12:08:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:45.479334 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe19e2f-5722-48fd-966a-287667e4cc9f None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:45.557224 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0302bcd-029b-4c17-a9e6-d4c58ff4e0ba None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:45.576055 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:45.606062 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50112d81-0598-437c-93b9-6be2c3e34e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:45.606741 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50112d81-0598-437c-93b9-6be2c3e34e13 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:45.607019 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50112d81-0598-437c-93b9-6be2c3e34e13 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:45.607289 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50112d81-0598-437c-93b9-6be2c3e34e13 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:45.608129 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50112d81-0598-437c-93b9-6be2c3e34e13 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:45.608438 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50112d81-0598-437c-93b9-6be2c3e34e13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:45.610608 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50112d81-0598-437c-93b9-6be2c3e34e13 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:45.630051 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 381/750] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Jun 29 12:08:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:45.630964 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50112d81-0598-437c-93b9-6be2c3e34e13 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:45.637518 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe19e2f-5722-48fd-966a-287667e4cc9f None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:45.678898 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae796a13-57ba-436a-8c50-3b3155f3afe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:45.680330 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae796a13-57ba-436a-8c50-3b3155f3afe4 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:45.680609 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae796a13-57ba-436a-8c50-3b3155f3afe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:45.681608 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae796a13-57ba-436a-8c50-3b3155f3afe4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:45.695361 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae796a13-57ba-436a-8c50-3b3155f3afe4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:45.696968 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae796a13-57ba-436a-8c50-3b3155f3afe4 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:45.717180 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-ae796a13-57ba-436a-8c50-3b3155f3afe4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:45.717180 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:45.717180 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:45.717180 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:45.717180 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:45.717180 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:45.717180 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:45.717180 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:45.717180 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:45.717180 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:45.717180 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:45.717180 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:45.717180 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:45.717180 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:45.717180 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:45.718172 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:45.718172 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:45.718172 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:45.718172 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:45.718172 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:45.718172 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:45.718172 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:45.718172 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:45.718172 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:45.718172 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:45.718172 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:45.718172 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:45.718172 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:45.718172 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:45.718172 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:45.718172 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:45.718172 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:45.719500 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:45.719500 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:45.719500 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:45.719500 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:45.719500 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 370/751] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:45.719500 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae796a13-57ba-436a-8c50-3b3155f3afe4 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:45.760633 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:45.769756 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50112d81-0598-437c-93b9-6be2c3e34e13 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:45.817266 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ab1fd-ffa1-4f15-9b1a-6ffad05842be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:45.818719 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ab1fd-ffa1-4f15-9b1a-6ffad05842be None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:45.819189 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ab1fd-ffa1-4f15-9b1a-6ffad05842be None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:45.819909 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ab1fd-ffa1-4f15-9b1a-6ffad05842be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:45.842649 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae796a13-57ba-436a-8c50-3b3155f3afe4 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:45.867130 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:45.878868 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc9538-49f8-4d43-873c-a1d1a9d60396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:45.879884 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc9538-49f8-4d43-873c-a1d1a9d60396 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:45.880163 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc9538-49f8-4d43-873c-a1d1a9d60396 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:45.880432 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc9538-49f8-4d43-873c-a1d1a9d60396 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:45.892547 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc9538-49f8-4d43-873c-a1d1a9d60396 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:45.894029 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc9538-49f8-4d43-873c-a1d1a9d60396 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:45.899975 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ab1fd-ffa1-4f15-9b1a-6ffad05842be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:45.901840 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ab1fd-ffa1-4f15-9b1a-6ffad05842be None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:45.912252 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-13fc9538-49f8-4d43-873c-a1d1a9d60396 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:45.912252 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:45.912252 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:45.912252 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:45.912252 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:45.912252 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:45.912252 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:45.912252 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:45.912252 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:45.912252 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:45.912252 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:45.912252 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:45.912252 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:45.912252 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:45.912252 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:45.913221 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:45.913221 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:45.913221 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:45.913221 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:45.913221 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:45.913221 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:45.913221 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:45.913221 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:45.913221 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:45.913221 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:45.913221 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:45.913221 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:45.913221 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:45.913221 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:45.913221 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:45.913221 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:45.913221 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:45.914170 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:45.914170 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:45.914170 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:45.914170 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:45.918700 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 371/752] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:45.919622 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc9538-49f8-4d43-873c-a1d1a9d60396 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:46.009739 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:46.014824 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 382/753] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:08:45 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 12:08:46.016003 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ab1fd-ffa1-4f15-9b1a-6ffad05842be None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:46.026155 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc9538-49f8-4d43-873c-a1d1a9d60396 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:46.070820 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e48a8-f270-4645-ad2c-693587cffd1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:46.071833 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e48a8-f270-4645-ad2c-693587cffd1e None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:46.072336 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e48a8-f270-4645-ad2c-693587cffd1e None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:46.072811 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e48a8-f270-4645-ad2c-693587cffd1e None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:46.073751 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688e48a8-f270-4645-ad2c-693587cffd1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:46.074405 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688e48a8-f270-4645-ad2c-693587cffd1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:46.075989 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688e48a8-f270-4645-ad2c-693587cffd1e None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:46.089338 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 372/754] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:46.090492 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e48a8-f270-4645-ad2c-693587cffd1e None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:46.095132 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:46.129223 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ab1fd-ffa1-4f15-9b1a-6ffad05842be None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:46.166178 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e124f59-18b3-429f-8da4-3527e5872f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:46.166855 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e124f59-18b3-429f-8da4-3527e5872f34 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:46.167142 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e124f59-18b3-429f-8da4-3527e5872f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:46.167416 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e124f59-18b3-429f-8da4-3527e5872f34 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:46.168147 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e124f59-18b3-429f-8da4-3527e5872f34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:46.168452 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e124f59-18b3-429f-8da4-3527e5872f34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:46.169861 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e124f59-18b3-429f-8da4-3527e5872f34 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:46.188954 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 383/755] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:46.188954 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e124f59-18b3-429f-8da4-3527e5872f34 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:46.204213 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e48a8-f270-4645-ad2c-693587cffd1e None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:46.249252 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e010d560-1595-4a66-ba2b-fe78381e68d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:46.250124 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010d560-1595-4a66-ba2b-fe78381e68d7 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:46.250909 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010d560-1595-4a66-ba2b-fe78381e68d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:46.251206 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010d560-1595-4a66-ba2b-fe78381e68d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:46.265279 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e010d560-1595-4a66-ba2b-fe78381e68d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:46.267512 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e010d560-1595-4a66-ba2b-fe78381e68d7 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:46.276199 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:46.291559 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-e010d560-1595-4a66-ba2b-fe78381e68d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:46.291559 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:46.291559 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:46.291559 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:46.291559 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:46.291559 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:46.291559 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:46.291559 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:46.291559 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:46.291559 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:46.291559 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:46.291559 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:46.291559 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:46.291559 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:46.291559 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:46.292564 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:46.292564 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:46.292564 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:46.292564 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:46.292564 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:46.292564 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:46.292564 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:46.292564 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:46.292564 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:46.292564 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:46.292564 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:46.292564 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:46.292564 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:46.292564 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:46.292564 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:46.292564 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:46.292564 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:46.294300 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:46.294300 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:46.294300 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:46.294300 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:46.294300 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 373/756] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:46.294300 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e010d560-1595-4a66-ba2b-fe78381e68d7 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:46.321782 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e124f59-18b3-429f-8da4-3527e5872f34 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:46.356328 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:46.362846 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25010901-7f3e-496c-9859-87aaec42afde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:46.364361 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25010901-7f3e-496c-9859-87aaec42afde None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:46.364866 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25010901-7f3e-496c-9859-87aaec42afde None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:46.365359 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25010901-7f3e-496c-9859-87aaec42afde None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:46.374424 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25010901-7f3e-496c-9859-87aaec42afde None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:46.376189 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25010901-7f3e-496c-9859-87aaec42afde None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:46.391856 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-25010901-7f3e-496c-9859-87aaec42afde None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:46.391856 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:46.391856 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:46.391856 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:46.391856 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:46.391856 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:46.391856 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:46.391856 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:46.391856 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:46.391856 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:46.391856 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:46.391856 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:46.391856 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:08:46.391856 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:08:46.391856 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:08:46.392767 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:08:46.392767 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:46.392767 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:46.392767 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:46.392767 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:46.392767 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:46.392767 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:46.392767 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:46.392767 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:46.392767 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:46.392767 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:46.392767 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:46.392767 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:46.392767 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:46.392767 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:46.392767 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:46.392767 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:46.394142 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:08:46.394142 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:08:46.394142 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:08:46.394142 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:08:46.394142 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:08:46.394142 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:08:46.394142 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:46.394142 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:46.396480 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 384/757] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jun 29 12:08:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:46.397821 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25010901-7f3e-496c-9859-87aaec42afde None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:46.404613 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e010d560-1595-4a66-ba2b-fe78381e68d7 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:46.439889 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7523b7d-e801-4321-bace-8abb75f1940c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:46.440691 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7523b7d-e801-4321-bace-8abb75f1940c None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:46.440968 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7523b7d-e801-4321-bace-8abb75f1940c None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:46.441232 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7523b7d-e801-4321-bace-8abb75f1940c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:46.449047 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7523b7d-e801-4321-bace-8abb75f1940c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:46.450533 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7523b7d-e801-4321-bace-8abb75f1940c None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:46.465866 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-f7523b7d-e801-4321-bace-8abb75f1940c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:46.465866 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:46.465866 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:46.465866 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:46.465866 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:46.465866 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:46.465866 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:46.465866 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:46.465866 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:46.465866 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:46.465866 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:46.465866 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:46.465866 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:08:46.465866 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:08:46.465866 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:08:46.466800 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:08:46.466800 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:46.466800 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:46.466800 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:46.466800 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:46.466800 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:46.466800 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:46.466800 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:46.466800 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:46.466800 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:46.466800 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:46.466800 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:46.466800 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:46.466800 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:46.466800 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:46.466800 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:46.466800 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:46.467723 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:08:46.467723 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:08:46.467723 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:08:46.467723 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:08:46.467723 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:08:46.467723 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:08:46.467723 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:46.467723 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:46.472039 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 374/758] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jun 29 12:08:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:46.472885 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7523b7d-e801-4321-bace-8abb75f1940c None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:46.514648 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25010901-7f3e-496c-9859-87aaec42afde None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:46.534779 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:46.555825 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e13baf-563c-4724-b217-b98ea13bb024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:46.557027 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e13baf-563c-4724-b217-b98ea13bb024 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:46.557553 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e13baf-563c-4724-b217-b98ea13bb024 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:46.558057 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e13baf-563c-4724-b217-b98ea13bb024 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:46.558989 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e13baf-563c-4724-b217-b98ea13bb024 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:46.559623 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e13baf-563c-4724-b217-b98ea13bb024 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:46.561344 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e13baf-563c-4724-b217-b98ea13bb024 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:46.575554 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 385/759] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:46.577253 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e13baf-563c-4724-b217-b98ea13bb024 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:46.579933 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7523b7d-e801-4321-bace-8abb75f1940c None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:46.616592 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d57b6ca-2442-4925-847e-8b9811e842d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:46.617978 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57b6ca-2442-4925-847e-8b9811e842d1 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:46.617978 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57b6ca-2442-4925-847e-8b9811e842d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:46.617978 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57b6ca-2442-4925-847e-8b9811e842d1 None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:46.618709 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d57b6ca-2442-4925-847e-8b9811e842d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:46.619014 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d57b6ca-2442-4925-847e-8b9811e842d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:46.620455 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d57b6ca-2442-4925-847e-8b9811e842d1 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:46.634002 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 375/760] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jun 29 12:08:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:46.634918 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d57b6ca-2442-4925-847e-8b9811e842d1 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:46.639589 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:46.696482 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e13baf-563c-4724-b217-b98ea13bb024 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:46.732906 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b57bc-f95b-4c3a-93cd-15d632079160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:46.733570 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b57bc-f95b-4c3a-93cd-15d632079160 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:46.733901 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b57bc-f95b-4c3a-93cd-15d632079160 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:46.734172 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b57bc-f95b-4c3a-93cd-15d632079160 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:46.734971 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645b57bc-f95b-4c3a-93cd-15d632079160 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:46.735276 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645b57bc-f95b-4c3a-93cd-15d632079160 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:46.736704 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645b57bc-f95b-4c3a-93cd-15d632079160 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:46.746642 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d57b6ca-2442-4925-847e-8b9811e842d1 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:46.749624 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 386/761] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jun 29 12:08:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:46.750474 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b57bc-f95b-4c3a-93cd-15d632079160 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:46.768911 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:46.787775 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d7975-9c12-4eb4-8631-b9caf86d8b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:46.788612 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d7975-9c12-4eb4-8631-b9caf86d8b55 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:46.789219 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d7975-9c12-4eb4-8631-b9caf86d8b55 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:46.789495 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d7975-9c12-4eb4-8631-b9caf86d8b55 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:46.796423 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10d7975-9c12-4eb4-8631-b9caf86d8b55 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:46.797938 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10d7975-9c12-4eb4-8631-b9caf86d8b55 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:46.812853 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-f10d7975-9c12-4eb4-8631-b9caf86d8b55 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:46.812853 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:46.812853 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:46.812853 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:46.812853 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:46.812853 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:46.812853 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:46.812853 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:46.812853 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:46.812853 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:46.812853 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:46.812853 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:46.812853 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:08:46.812853 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:08:46.812853 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:08:46.813781 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:08:46.813781 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:46.813781 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:46.813781 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:46.813781 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:46.813781 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:46.813781 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:46.813781 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:46.813781 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:46.813781 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:46.813781 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:46.813781 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:46.813781 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:46.813781 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:46.813781 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:46.813781 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:46.813781 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:46.814715 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:08:46.814715 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:08:46.814715 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:08:46.814715 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:08:46.814715 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:08:46.814715 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:08:46.814715 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:46.814715 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:46.818961 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 376/762] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jun 29 12:08:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:46.820138 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba95847-3e23-4afd-8e90-a8eab98883e6 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:46.820479 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba95847-3e23-4afd-8e90-a8eab98883e6 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:46.820683 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba95847-3e23-4afd-8e90-a8eab98883e6 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:46.822007 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 377/763] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:08:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:46.822684 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba95847-3e23-4afd-8e90-a8eab98883e6 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:46.863321 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b57bc-f95b-4c3a-93cd-15d632079160 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:46.876963 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:46.899675 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ea226-2cfc-43f9-bb3a-c28f7bd5c342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:46.900438 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ea226-2cfc-43f9-bb3a-c28f7bd5c342 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:46.900720 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ea226-2cfc-43f9-bb3a-c28f7bd5c342 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:46.900984 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ea226-2cfc-43f9-bb3a-c28f7bd5c342 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:46.901839 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95ea226-2cfc-43f9-bb3a-c28f7bd5c342 None admin] RBAC: Adding query filter params (role.id=6f63a9619c7b40ebb5b73bde026d606b, scope.project.id=996db30845f84e57865fa40b9a730a05, user.id=cad33601754a462c828566fb54c6e100) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:46.902151 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95ea226-2cfc-43f9-bb3a-c28f7bd5c342 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:46.903585 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95ea226-2cfc-43f9-bb3a-c28f7bd5c342 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:46.909067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 387/764] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jun 29 12:08:46 2022] GET /identity/v3/role_assignments?user.id=cad33601754a462c828566fb54c6e100&scope.project.id=996db30845f84e57865fa40b9a730a05&role.id=6f63a9619c7b40ebb5b73bde026d606b => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:46.909943 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ea226-2cfc-43f9-bb3a-c28f7bd5c342 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:46.952531 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba95847-3e23-4afd-8e90-a8eab98883e6 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:47.004021 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b037d2fc-4cd5-4c91-801e-a1a7f09a1d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:47.005546 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037d2fc-4cd5-4c91-801e-a1a7f09a1d12 None admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:47.006085 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037d2fc-4cd5-4c91-801e-a1a7f09a1d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:47.006506 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037d2fc-4cd5-4c91-801e-a1a7f09a1d12 None admin] PATH_INFO: `/v3/projects/996db30845f84e57865fa40b9a730a05/users/7adaa2ef440941aa8214f2b2fd49b54e/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:47.011022 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b037d2fc-4cd5-4c91-801e-a1a7f09a1d12 None admin] RBAC: Authorizing `identity:create_grant(project_id=996db30845f84e57865fa40b9a730a05, user_id=7adaa2ef440941aa8214f2b2fd49b54e, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:47.013029 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b037d2fc-4cd5-4c91-801e-a1a7f09a1d12 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:47.032791 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 378/765] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jun 29 12:08:46 2022] PUT /identity/v3/projects/996db30845f84e57865fa40b9a730a05/users/7adaa2ef440941aa8214f2b2fd49b54e/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:08:47.035416 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bcc1b9-3f31-4d0a-bb2c-ae81c41d3b9e None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:47.035871 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bcc1b9-3f31-4d0a-bb2c-ae81c41d3b9e None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:47.036295 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bcc1b9-3f31-4d0a-bb2c-ae81c41d3b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:47.061279 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-06bcc1b9-3f31-4d0a-bb2c-ae81c41d3b9e None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:47.063639 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-06bcc1b9-3f31-4d0a-bb2c-ae81c41d3b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:47.065206 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ea226-2cfc-43f9-bb3a-c28f7bd5c342 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:47.110129 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:47.145569 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28909eb6-b073-4deb-b573-77b05db418a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:47.146375 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28909eb6-b073-4deb-b573-77b05db418a9 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:47.146749 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28909eb6-b073-4deb-b573-77b05db418a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:47.147115 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28909eb6-b073-4deb-b573-77b05db418a9 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:47.148915 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28909eb6-b073-4deb-b573-77b05db418a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:47.148915 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28909eb6-b073-4deb-b573-77b05db418a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:47.150658 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28909eb6-b073-4deb-b573-77b05db418a9 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:47.167713 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 379/766] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:08:47.176512 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 388/767] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jun 29 12:08:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:47.183286 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bcc1b9-3f31-4d0a-bb2c-ae81c41d3b9e None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:47.198598 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28909eb6-b073-4deb-b573-77b05db418a9 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:47.249410 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:47.315416 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bcc1b9-3f31-4d0a-bb2c-ae81c41d3b9e None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:47.335099 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28909eb6-b073-4deb-b573-77b05db418a9 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:47.378550 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646b55a1-85de-4d30-900c-1544a54f66f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:47.379222 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b55a1-85de-4d30-900c-1544a54f66f6 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:47.379506 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b55a1-85de-4d30-900c-1544a54f66f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:47.379780 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b55a1-85de-4d30-900c-1544a54f66f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:47.380633 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646b55a1-85de-4d30-900c-1544a54f66f6 None admin] RBAC: Adding query filter params (role.id=e0e69ac8a8bf4cc4baa6aa18f2fc9919, scope.project.id=996db30845f84e57865fa40b9a730a05, user.id=cc92f8232bda407c84365eb10ede737f) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:47.380946 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646b55a1-85de-4d30-900c-1544a54f66f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:47.382850 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646b55a1-85de-4d30-900c-1544a54f66f6 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:47.385804 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a2a923-365d-454d-907e-a136515d9397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:47.386636 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2a923-365d-454d-907e-a136515d9397 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:47.386913 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2a923-365d-454d-907e-a136515d9397 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:47.387187 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2a923-365d-454d-907e-a136515d9397 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:47.387863 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a2a923-365d-454d-907e-a136515d9397 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:47.389253 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a2a923-365d-454d-907e-a136515d9397 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:47.395839 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 380/768] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jun 29 12:08:47 2022] GET /identity/v3/role_assignments?user.id=cc92f8232bda407c84365eb10ede737f&scope.project.id=996db30845f84e57865fa40b9a730a05&role.id=e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:47.406345 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-08a2a923-365d-454d-907e-a136515d9397 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 12:08:47.406345 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:47.406345 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 12:08:47.406345 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 12:08:47.406345 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 12:08:47.406345 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 12:08:47.406345 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 12:08:47.406345 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:08:47.406345 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 12:08:47.406345 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:47.406345 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 12:08:47.406345 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:47.406345 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:47.406345 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:47.406345 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:47.406345 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:47.407442 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:47.407442 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:47.407442 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:47.407442 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:47.407442 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:47.407442 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:47.407442 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:47.407442 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 12:08:47.407442 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 12:08:47.407442 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 12:08:47.407442 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 12:08:47.407442 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:47.407442 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:47.407442 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:47.407442 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:47.407442 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:47.408275 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:47.408275 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:47.408275 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:47.408275 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:47.408275 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:47.408275 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:47.408275 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:47.408275 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:47.408275 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:47.408275 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:47.408275 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:47.408275 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 12:08:47.408275 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:08:47.408275 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 12:08:47.408275 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:47.408275 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 389/769] 10.222.0.27 () {56 vars in 1129 bytes} [Wed Jun 29 12:08:47 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:47.414145 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646b55a1-85de-4d30-900c-1544a54f66f6 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:47.449616 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:47.556592 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646b55a1-85de-4d30-900c-1544a54f66f6 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:47.593742 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264dfcc9-3531-47d2-abb1-cf186fbb4f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:47.594433 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264dfcc9-3531-47d2-abb1-cf186fbb4f89 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:47.594718 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264dfcc9-3531-47d2-abb1-cf186fbb4f89 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:47.594995 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264dfcc9-3531-47d2-abb1-cf186fbb4f89 None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:47.595727 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264dfcc9-3531-47d2-abb1-cf186fbb4f89 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:47.596037 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264dfcc9-3531-47d2-abb1-cf186fbb4f89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:47.597580 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264dfcc9-3531-47d2-abb1-cf186fbb4f89 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:47.603342 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 381/770] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Jun 29 12:08:47 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:08:47.610837 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a2a923-365d-454d-907e-a136515d9397 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:47.748619 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affb75c-1440-4098-911f-d74277a010ab None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:47.748797 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affb75c-1440-4098-911f-d74277a010ab None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:47.749075 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affb75c-1440-4098-911f-d74277a010ab None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:47.750742 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 382/771] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:08:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:47.755655 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223dbf69-5498-448d-b98c-113535cc91a9 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:47.755933 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223dbf69-5498-448d-b98c-113535cc91a9 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:47.756208 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223dbf69-5498-448d-b98c-113535cc91a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:47.792724 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-223dbf69-5498-448d-b98c-113535cc91a9 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:47.793975 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-223dbf69-5498-448d-b98c-113535cc91a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:47.886044 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 383/772] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 12:08:47.932948 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223dbf69-5498-448d-b98c-113535cc91a9 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:47.934698 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:47.939365 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a2a923-365d-454d-907e-a136515d9397 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:47.988649 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db267ae-d8cf-4292-83f2-a546dbfd9e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:47.989326 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db267ae-d8cf-4292-83f2-a546dbfd9e69 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:47.989602 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db267ae-d8cf-4292-83f2-a546dbfd9e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:47.990056 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db267ae-d8cf-4292-83f2-a546dbfd9e69 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:47.990781 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db267ae-d8cf-4292-83f2-a546dbfd9e69 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:47.991077 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db267ae-d8cf-4292-83f2-a546dbfd9e69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:47.993281 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db267ae-d8cf-4292-83f2-a546dbfd9e69 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:48.000274 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 390/773] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Jun 29 12:08:47 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:48.003801 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:48.006511 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db267ae-d8cf-4292-83f2-a546dbfd9e69 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:48.143086 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223dbf69-5498-448d-b98c-113535cc91a9 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:48.188329 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db267ae-d8cf-4292-83f2-a546dbfd9e69 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:48.214993 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05885b1a-c76f-4cae-9300-9d0181624eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:48.215809 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05885b1a-c76f-4cae-9300-9d0181624eaa None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:48.216085 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05885b1a-c76f-4cae-9300-9d0181624eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:48.216405 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05885b1a-c76f-4cae-9300-9d0181624eaa None admin] PATH_INFO: `/v3/services/network` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:48.217124 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05885b1a-c76f-4cae-9300-9d0181624eaa None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:48.218565 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05885b1a-c76f-4cae-9300-9d0181624eaa None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:48.234891 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd0f9da-3553-41b3-8720-974bd48d27b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:48.235872 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0f9da-3553-41b3-8720-974bd48d27b4 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:48.236350 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0f9da-3553-41b3-8720-974bd48d27b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:48.236817 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0f9da-3553-41b3-8720-974bd48d27b4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:48.237844 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd0f9da-3553-41b3-8720-974bd48d27b4 None admin] RBAC: Adding query filter params (interface=public, service_id=62fb54c05f064fa3b7d070ada33135d6, region_id=RegionOne) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:48.238383 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd0f9da-3553-41b3-8720-974bd48d27b4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:48.239949 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd0f9da-3553-41b3-8720-974bd48d27b4 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:48.245904 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-05885b1a-c76f-4cae-9300-9d0181624eaa None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 12:08:48.245904 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:48.245904 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 12:08:48.245904 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 12:08:48.245904 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 12:08:48.245904 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 12:08:48.245904 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 12:08:48.245904 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:08:48.245904 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 12:08:48.245904 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:48.245904 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 12:08:48.245904 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:48.245904 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:48.245904 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:48.245904 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:48.245904 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:48.245904 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:48.246898 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:48.246898 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:48.246898 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:48.246898 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:48.246898 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:48.246898 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:48.246898 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 12:08:48.246898 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 12:08:48.246898 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 12:08:48.246898 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 12:08:48.246898 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:48.246898 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:48.246898 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:48.246898 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:48.246898 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:48.246898 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:48.247754 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:48.247754 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:48.247754 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:48.247754 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:48.247754 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:48.247754 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:48.247754 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:48.247754 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:48.247754 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:48.247754 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:48.247754 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 12:08:48.247754 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:08:48.247754 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 12:08:48.247754 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:48.247754 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 384/774] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jun 29 12:08:47 2022] GET /identity/v3/services/network => generated 88 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:08:48.255296 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05885b1a-c76f-4cae-9300-9d0181624eaa None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:48.256397 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 391/775] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Jun 29 12:08:48 2022] GET /identity/v3/endpoints?service_id=62fb54c05f064fa3b7d070ada33135d6&interface=public®ion_id=RegionOne => generated 194 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:48.261533 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd0f9da-3553-41b3-8720-974bd48d27b4 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:48.309389 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:48.353647 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:48.363278 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05885b1a-c76f-4cae-9300-9d0181624eaa None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:48.402229 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65726602-73a8-4ef6-bde7-6dc5f40b9d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:48.402901 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65726602-73a8-4ef6-bde7-6dc5f40b9d02 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:48.403179 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65726602-73a8-4ef6-bde7-6dc5f40b9d02 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:48.403446 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65726602-73a8-4ef6-bde7-6dc5f40b9d02 None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:48.404160 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65726602-73a8-4ef6-bde7-6dc5f40b9d02 None admin] RBAC: Adding query filter params (name=network) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:48.404461 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65726602-73a8-4ef6-bde7-6dc5f40b9d02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:48.405860 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65726602-73a8-4ef6-bde7-6dc5f40b9d02 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:48.420383 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 385/776] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Jun 29 12:08:48 2022] GET /identity/v3/services?name=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:48.425827 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65726602-73a8-4ef6-bde7-6dc5f40b9d02 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:48.442769 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd0f9da-3553-41b3-8720-974bd48d27b4 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:48.509194 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae236c2-ed47-4a97-ba8d-4d61378108e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:48.509808 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae236c2-ed47-4a97-ba8d-4d61378108e9 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:48.510094 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae236c2-ed47-4a97-ba8d-4d61378108e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:48.510371 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae236c2-ed47-4a97-ba8d-4d61378108e9 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:48.511072 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae236c2-ed47-4a97-ba8d-4d61378108e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:48.512459 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae236c2-ed47-4a97-ba8d-4d61378108e9 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:48.523115 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 392/777] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Jun 29 12:08:48 2022] GET /identity/v3/services => generated 772 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:08:48.588199 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65726602-73a8-4ef6-bde7-6dc5f40b9d02 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:48.627780 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f76bd81-5650-4516-a8e5-ed230ed06446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:48.628543 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76bd81-5650-4516-a8e5-ed230ed06446 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:48.628838 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76bd81-5650-4516-a8e5-ed230ed06446 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:48.629111 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76bd81-5650-4516-a8e5-ed230ed06446 None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:48.629944 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f76bd81-5650-4516-a8e5-ed230ed06446 None admin] RBAC: Adding query filter params (type=network) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:48.630251 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f76bd81-5650-4516-a8e5-ed230ed06446 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:48.631666 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f76bd81-5650-4516-a8e5-ed230ed06446 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:48.637966 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 386/778] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Jun 29 12:08:48 2022] GET /identity/v3/services?type=network => generated 350 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:48.647073 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae236c2-ed47-4a97-ba8d-4d61378108e9 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:48.782882 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:48.793546 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae236c2-ed47-4a97-ba8d-4d61378108e9 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:48.844412 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d234899-968c-47f0-9dab-05953b8636f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:48.845091 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d234899-968c-47f0-9dab-05953b8636f8 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:48.845375 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d234899-968c-47f0-9dab-05953b8636f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:48.845650 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d234899-968c-47f0-9dab-05953b8636f8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:48.846486 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d234899-968c-47f0-9dab-05953b8636f8 None admin] RBAC: Adding query filter params (interface=public, service_id=cca039e2a2354e6094aec6abf4a921c4, region_id=RegionOne) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:48.846799 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d234899-968c-47f0-9dab-05953b8636f8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:48.848197 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d234899-968c-47f0-9dab-05953b8636f8 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:48.858494 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 393/779] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Jun 29 12:08:48 2022] GET /identity/v3/endpoints?service_id=cca039e2a2354e6094aec6abf4a921c4&interface=public®ion_id=RegionOne => generated 194 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:48.863988 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f76bd81-5650-4516-a8e5-ed230ed06446 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:48.888688 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:48.979658 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f76bd81-5650-4516-a8e5-ed230ed06446 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:49.016271 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7de66-013c-415f-bc30-36ed5009630b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:49.017003 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7de66-013c-415f-bc30-36ed5009630b None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:49.017293 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7de66-013c-415f-bc30-36ed5009630b None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:49.017571 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7de66-013c-415f-bc30-36ed5009630b None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:49.018300 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc7de66-013c-415f-bc30-36ed5009630b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:49.019679 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc7de66-013c-415f-bc30-36ed5009630b None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:49.027523 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 387/780] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Jun 29 12:08:48 2022] GET /identity/v3/services => generated 772 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:49.572810 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20953b31-95ca-461d-a9ab-3c3dc52b1221 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:49.573373 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20953b31-95ca-461d-a9ab-3c3dc52b1221 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:49.573373 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20953b31-95ca-461d-a9ab-3c3dc52b1221 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:49.574989 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 394/781] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:08:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:49.580574 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4035b1-a050-4284-a71e-9edc0d1c724a None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:49.581064 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4035b1-a050-4284-a71e-9edc0d1c724a None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:49.581212 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4035b1-a050-4284-a71e-9edc0d1c724a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:49.602795 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-ea4035b1-a050-4284-a71e-9edc0d1c724a None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:49.604016 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ea4035b1-a050-4284-a71e-9edc0d1c724a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:49.676027 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7563a-a0cd-4f37-842b-5f21fc88eca1 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:49.676353 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7563a-a0cd-4f37-842b-5f21fc88eca1 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:49.676576 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7563a-a0cd-4f37-842b-5f21fc88eca1 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:49.678315 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 395/782] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:08:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:08:49.685279 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8ff32-78ec-4561-9ed9-a510f56dc16e None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:49.685564 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8ff32-78ec-4561-9ed9-a510f56dc16e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:49.685856 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8ff32-78ec-4561-9ed9-a510f56dc16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:49.696174 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 388/783] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:08:49.704814 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-d5d8ff32-78ec-4561-9ed9-a510f56dc16e None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:49.714243 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d5d8ff32-78ec-4561-9ed9-a510f56dc16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:49.720304 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4035b1-a050-4284-a71e-9edc0d1c724a None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:49.753581 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:49.797785 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 396/784] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:08:49.799302 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79f257-9e8b-45ef-b241-47ca046dff60 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:49.799651 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79f257-9e8b-45ef-b241-47ca046dff60 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:49.800033 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79f257-9e8b-45ef-b241-47ca046dff60 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:49.801585 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 397/785] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:08:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:49.811018 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ade655-92d4-44a8-be9d-de411ea4152c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:49.811302 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ade655-92d4-44a8-be9d-de411ea4152c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:49.811589 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ade655-92d4-44a8-be9d-de411ea4152c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:49.840537 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-d7ade655-92d4-44a8-be9d-de411ea4152c None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:49.841659 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d7ade655-92d4-44a8-be9d-de411ea4152c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:49.854600 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4035b1-a050-4284-a71e-9edc0d1c724a None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:49.889917 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2593c4d-5d62-4e93-808c-40a0f424e586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:49.890719 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2593c4d-5d62-4e93-808c-40a0f424e586 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:49.890995 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2593c4d-5d62-4e93-808c-40a0f424e586 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:49.891262 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2593c4d-5d62-4e93-808c-40a0f424e586 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:49.902418 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2593c4d-5d62-4e93-808c-40a0f424e586 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:08:49.910105 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-e2593c4d-5d62-4e93-808c-40a0f424e586 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:08:49.910105 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:49.910105 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:49.910105 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:49.910105 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:49.910105 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:49.910105 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:49.910105 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:49.910105 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:49.910105 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:49.910105 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:49.910105 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:49.910105 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:08:49.910105 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:08:49.910105 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:08:49.910105 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:08:49.911044 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:08:49.911044 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:08:49.911044 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:08:49.911044 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:08:49.911044 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:49.911044 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:49.911044 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:49.911044 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:49.911044 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:49.911044 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:49.911044 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:49.911044 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:49.911044 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:49.911044 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:49.911044 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:49.911044 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:49.911898 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:49.911898 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:49.911898 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:49.911898 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:49.911898 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:08:49.911898 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:08:49.911898 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:08:49.911898 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:08:49.911898 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:08:49.911898 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:08:49.911898 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:08:49.911898 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:49.911898 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 389/786] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jun 29 12:08:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:49.913377 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2593c4d-5d62-4e93-808c-40a0f424e586 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:49.917726 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 398/787] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:08:49.917726 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ade655-92d4-44a8-be9d-de411ea4152c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:49.942357 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:50.007591 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:50.029933 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ade655-92d4-44a8-be9d-de411ea4152c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:50.045785 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2593c4d-5d62-4e93-808c-40a0f424e586 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:50.067540 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb067a50-4bb0-4c80-b01a-261334c34a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:50.068227 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb067a50-4bb0-4c80-b01a-261334c34a35 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:50.068525 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb067a50-4bb0-4c80-b01a-261334c34a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:50.068789 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb067a50-4bb0-4c80-b01a-261334c34a35 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:50.069683 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb067a50-4bb0-4c80-b01a-261334c34a35 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:50.070013 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb067a50-4bb0-4c80-b01a-261334c34a35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:50.071711 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb067a50-4bb0-4c80-b01a-261334c34a35 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:50.079921 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03abc443-aa6e-4d9e-99a2-ea6c95289b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:50.080930 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03abc443-aa6e-4d9e-99a2-ea6c95289b97 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:50.081350 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03abc443-aa6e-4d9e-99a2-ea6c95289b97 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:50.081786 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03abc443-aa6e-4d9e-99a2-ea6c95289b97 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:50.082203 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 399/788] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:08:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:50.083276 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb067a50-4bb0-4c80-b01a-261334c34a35 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:50.093750 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03abc443-aa6e-4d9e-99a2-ea6c95289b97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:08:50.102779 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-03abc443-aa6e-4d9e-99a2-ea6c95289b97 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:08:50.102779 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:50.102779 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:50.102779 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:50.102779 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:50.102779 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:50.102779 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:50.102779 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:50.102779 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:50.102779 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:50.102779 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:50.102779 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:50.102779 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:08:50.102779 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:08:50.102779 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:08:50.102779 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:08:50.103858 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:08:50.103858 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:08:50.103858 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:08:50.103858 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:08:50.103858 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:50.103858 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:50.103858 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:50.103858 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:50.103858 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:50.103858 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:50.103858 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:50.103858 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:50.103858 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:50.103858 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:50.103858 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:50.103858 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:50.104704 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:50.104704 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:50.104704 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:50.104704 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:50.104704 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:08:50.104704 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:08:50.104704 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:08:50.104704 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:08:50.104704 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:08:50.104704 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:08:50.104704 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:08:50.104704 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:50.107514 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 390/789] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jun 29 12:08:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:50.108504 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03abc443-aa6e-4d9e-99a2-ea6c95289b97 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:50.185182 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:50.212609 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb067a50-4bb0-4c80-b01a-261334c34a35 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:50.241324 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03abc443-aa6e-4d9e-99a2-ea6c95289b97 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:50.256307 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea61c014-ce4e-48d3-8260-9f63fd32cac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:50.257329 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61c014-ce4e-48d3-8260-9f63fd32cac3 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:50.257705 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61c014-ce4e-48d3-8260-9f63fd32cac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:50.258056 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61c014-ce4e-48d3-8260-9f63fd32cac3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:50.269486 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea61c014-ce4e-48d3-8260-9f63fd32cac3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:08:50.275501 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:50.279438 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-ea61c014-ce4e-48d3-8260-9f63fd32cac3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:08:50.279438 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:50.279438 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:50.279438 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:50.279438 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:50.279438 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:50.279438 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:50.279438 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:50.279438 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:50.279438 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:50.279438 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:50.279438 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:50.279438 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:08:50.279438 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:08:50.279438 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:08:50.279438 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:08:50.280403 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:08:50.280403 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:08:50.280403 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:08:50.280403 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:08:50.280403 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:50.280403 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:50.280403 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:50.280403 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:50.280403 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:50.280403 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:50.280403 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:50.280403 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:50.280403 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:50.280403 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:50.280403 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:50.280403 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:50.281265 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:50.281265 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:50.281265 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:50.281265 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:50.281265 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:08:50.281265 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:08:50.281265 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:08:50.281265 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:08:50.281265 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:08:50.281265 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:08:50.281265 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:08:50.281265 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:50.286001 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 400/790] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jun 29 12:08:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:50.287023 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea61c014-ce4e-48d3-8260-9f63fd32cac3 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:50.287650 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a214b-72d1-42ac-91ff-f915c4352a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:50.289081 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a214b-72d1-42ac-91ff-f915c4352a20 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:50.289550 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a214b-72d1-42ac-91ff-f915c4352a20 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:50.290059 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a214b-72d1-42ac-91ff-f915c4352a20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:50.302214 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8a214b-72d1-42ac-91ff-f915c4352a20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:50.304355 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8a214b-72d1-42ac-91ff-f915c4352a20 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:50.322827 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-6b8a214b-72d1-42ac-91ff-f915c4352a20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:50.322827 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:50.322827 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:50.322827 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:50.322827 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:50.322827 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:50.322827 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:50.322827 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:50.322827 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:50.322827 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:50.322827 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:50.322827 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:50.322827 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:50.322827 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:50.322827 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:50.323856 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:50.323856 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:50.323856 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:50.323856 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:50.323856 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:50.323856 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:50.323856 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:50.323856 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:50.323856 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:50.323856 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:50.323856 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:50.323856 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:50.323856 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:50.323856 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:50.323856 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:50.323856 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:50.323856 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:50.324769 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:50.324769 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:50.324769 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:50.324769 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:50.327151 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 391/791] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:50.328154 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a214b-72d1-42ac-91ff-f915c4352a20 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:50.391281 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea61c014-ce4e-48d3-8260-9f63fd32cac3 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:50.426778 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ab09e-4f23-43ad-aaeb-7c7b0ed09afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:50.427562 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ab09e-4f23-43ad-aaeb-7c7b0ed09afb None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:50.427942 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ab09e-4f23-43ad-aaeb-7c7b0ed09afb None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:50.428315 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ab09e-4f23-43ad-aaeb-7c7b0ed09afb None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:50.429311 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ab09e-4f23-43ad-aaeb-7c7b0ed09afb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:50.429771 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ab09e-4f23-43ad-aaeb-7c7b0ed09afb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:50.431255 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ab09e-4f23-43ad-aaeb-7c7b0ed09afb None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:50.436288 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a214b-72d1-42ac-91ff-f915c4352a20 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:50.436719 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:50.444693 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 401/792] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:08:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:50.446129 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ab09e-4f23-43ad-aaeb-7c7b0ed09afb None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:50.476187 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62cf9b2-e57d-4ffa-8b33-3d687343a679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:50.477398 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62cf9b2-e57d-4ffa-8b33-3d687343a679 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:50.477993 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62cf9b2-e57d-4ffa-8b33-3d687343a679 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:50.478466 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62cf9b2-e57d-4ffa-8b33-3d687343a679 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:50.479410 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62cf9b2-e57d-4ffa-8b33-3d687343a679 None admin] RBAC: Adding query filter params (name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:50.480023 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62cf9b2-e57d-4ffa-8b33-3d687343a679 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:50.481742 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62cf9b2-e57d-4ffa-8b33-3d687343a679 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:50.491636 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 392/793] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jun 29 12:08:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:50.492972 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62cf9b2-e57d-4ffa-8b33-3d687343a679 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:50.551812 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:50.564936 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ab09e-4f23-43ad-aaeb-7c7b0ed09afb None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:50.600947 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b95cf1-1369-47bf-b060-56f5527bd2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:50.601675 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b95cf1-1369-47bf-b060-56f5527bd2fd None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:50.601675 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b95cf1-1369-47bf-b060-56f5527bd2fd None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:50.602082 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b95cf1-1369-47bf-b060-56f5527bd2fd None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:50.602824 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b95cf1-1369-47bf-b060-56f5527bd2fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:50.603131 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b95cf1-1369-47bf-b060-56f5527bd2fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:50.604518 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b95cf1-1369-47bf-b060-56f5527bd2fd None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:50.614643 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62cf9b2-e57d-4ffa-8b33-3d687343a679 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:50.617738 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 402/794] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:50.618886 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b95cf1-1369-47bf-b060-56f5527bd2fd None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:50.652724 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db0a6f-defd-40c0-a214-e632efced0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:50.653893 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db0a6f-defd-40c0-a214-e632efced0e7 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:50.654452 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db0a6f-defd-40c0-a214-e632efced0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:50.655009 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db0a6f-defd-40c0-a214-e632efced0e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:50.666752 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7db0a6f-defd-40c0-a214-e632efced0e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:50.668716 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7db0a6f-defd-40c0-a214-e632efced0e7 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:50.682268 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:50.688819 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-d7db0a6f-defd-40c0-a214-e632efced0e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:50.688819 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:50.688819 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:50.688819 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:50.688819 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:50.688819 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:50.688819 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:50.688819 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:50.688819 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:50.688819 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:50.688819 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:50.688819 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:50.688819 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:50.688819 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:50.688819 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:50.689814 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:50.689814 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:50.689814 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:50.689814 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:50.689814 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:50.689814 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:50.689814 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:50.689814 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:50.689814 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:50.689814 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:50.689814 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:50.689814 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:50.689814 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:50.689814 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:50.689814 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:50.689814 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:50.689814 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:50.693683 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:50.693683 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:50.693683 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:50.693683 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:50.693683 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 393/795] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:50.693683 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db0a6f-defd-40c0-a214-e632efced0e7 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:50.731005 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b95cf1-1369-47bf-b060-56f5527bd2fd None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:50.766369 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f139f6fe-67ef-4d80-8263-60a5dd668810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:50.767225 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139f6fe-67ef-4d80-8263-60a5dd668810 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:50.767508 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139f6fe-67ef-4d80-8263-60a5dd668810 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:50.767832 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139f6fe-67ef-4d80-8263-60a5dd668810 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:50.780862 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f139f6fe-67ef-4d80-8263-60a5dd668810 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:50.783589 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f139f6fe-67ef-4d80-8263-60a5dd668810 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:50.802508 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-f139f6fe-67ef-4d80-8263-60a5dd668810 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:50.802508 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:50.802508 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:50.802508 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:50.802508 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:50.802508 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:50.802508 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:50.802508 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:50.802508 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:50.802508 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:50.802508 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:50.802508 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:50.802508 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:50.802508 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:50.802508 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:50.803456 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:50.803456 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:50.803456 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:50.803456 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:50.803456 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:50.803456 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:50.803456 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:50.803456 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:50.803456 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:50.803456 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:50.803456 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:50.803456 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:50.803456 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:50.803456 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:50.803456 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:50.803456 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:50.803456 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:50.804463 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:50.804463 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:50.804463 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:50.804463 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:50.806457 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:50.809108 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 403/796] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:50.810040 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f139f6fe-67ef-4d80-8263-60a5dd668810 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:50.814036 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db0a6f-defd-40c0-a214-e632efced0e7 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:50.852414 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a711377-adef-49d2-9ba9-1d1443c2c0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:50.854208 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a711377-adef-49d2-9ba9-1d1443c2c0c7 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:50.854947 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a711377-adef-49d2-9ba9-1d1443c2c0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:50.855810 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a711377-adef-49d2-9ba9-1d1443c2c0c7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:50.865807 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a711377-adef-49d2-9ba9-1d1443c2c0c7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:50.867828 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a711377-adef-49d2-9ba9-1d1443c2c0c7 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:50.883796 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-1a711377-adef-49d2-9ba9-1d1443c2c0c7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 12:08:50.883796 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:50.883796 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:50.883796 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:50.883796 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:50.883796 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:50.883796 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:50.883796 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:50.883796 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:50.883796 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:50.883796 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:50.883796 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:50.883796 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:08:50.883796 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:08:50.883796 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:08:50.883796 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:08:50.884785 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:50.884785 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:50.884785 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:08:50.884785 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:50.884785 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:08:50.884785 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:50.884785 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:50.884785 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:50.884785 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:50.884785 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:50.884785 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:50.884785 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:50.884785 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:50.884785 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:50.884785 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:50.884785 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:50.884785 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:50.884785 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:50.885914 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:50.885914 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:50.885914 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:08:50.885914 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:08:50.885914 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:08:50.885914 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:08:50.885914 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:08:50.885914 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:08:50.885914 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 12:08:50.885914 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:50.888572 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 394/797] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Jun 29 12:08:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:50.889672 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a711377-adef-49d2-9ba9-1d1443c2c0c7 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:50.927737 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f139f6fe-67ef-4d80-8263-60a5dd668810 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:50.944289 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:50.970970 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d53909-9a35-4d0b-bfc2-b2eca774d1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:50.971649 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d53909-9a35-4d0b-bfc2-b2eca774d1e5 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:50.971933 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d53909-9a35-4d0b-bfc2-b2eca774d1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:50.972263 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d53909-9a35-4d0b-bfc2-b2eca774d1e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:50.973203 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d53909-9a35-4d0b-bfc2-b2eca774d1e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:50.973518 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d53909-9a35-4d0b-bfc2-b2eca774d1e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:50.975436 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d53909-9a35-4d0b-bfc2-b2eca774d1e5 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:50.991870 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 404/798] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:50.993879 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d53909-9a35-4d0b-bfc2-b2eca774d1e5 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:51.013802 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a711377-adef-49d2-9ba9-1d1443c2c0c7 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:51.058429 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7e5b48-4139-463f-b40b-541ee5c4a415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:51.059208 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e5b48-4139-463f-b40b-541ee5c4a415 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:51.059621 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e5b48-4139-463f-b40b-541ee5c4a415 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:51.060040 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e5b48-4139-463f-b40b-541ee5c4a415 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:51.060863 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7e5b48-4139-463f-b40b-541ee5c4a415 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:51.061297 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7e5b48-4139-463f-b40b-541ee5c4a415 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:51.063060 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7e5b48-4139-463f-b40b-541ee5c4a415 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:51.076353 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 395/799] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:51.077951 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7e5b48-4139-463f-b40b-541ee5c4a415 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:51.097654 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:51.126411 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d53909-9a35-4d0b-bfc2-b2eca774d1e5 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:51.160528 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d556d22-d43b-4f04-b591-8a85bc842a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:51.161461 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d556d22-d43b-4f04-b591-8a85bc842a2e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:51.161766 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d556d22-d43b-4f04-b591-8a85bc842a2e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:51.162049 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d556d22-d43b-4f04-b591-8a85bc842a2e None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:51.162890 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d556d22-d43b-4f04-b591-8a85bc842a2e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:51.163274 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d556d22-d43b-4f04-b591-8a85bc842a2e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:51.164699 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d556d22-d43b-4f04-b591-8a85bc842a2e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:51.188909 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 405/800] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Jun 29 12:08:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:51.189769 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d556d22-d43b-4f04-b591-8a85bc842a2e None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:51.198459 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7e5b48-4139-463f-b40b-541ee5c4a415 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:51.225471 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:51.237201 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee214b-af49-41b4-9d4c-ffa6d61813b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:51.238073 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee214b-af49-41b4-9d4c-ffa6d61813b1 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:51.238347 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee214b-af49-41b4-9d4c-ffa6d61813b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:51.238624 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee214b-af49-41b4-9d4c-ffa6d61813b1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:51.247468 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ee214b-af49-41b4-9d4c-ffa6d61813b1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:51.248950 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ee214b-af49-41b4-9d4c-ffa6d61813b1 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:51.263736 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-08ee214b-af49-41b4-9d4c-ffa6d61813b1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 29 12:08:51.263736 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:51.263736 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:51.263736 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:51.263736 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:51.263736 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:51.263736 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:51.263736 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:51.263736 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:51.263736 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:51.263736 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:51.263736 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:51.263736 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:08:51.263736 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:08:51.263736 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:08:51.263736 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:08:51.264723 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:51.264723 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:51.264723 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:08:51.264723 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:51.264723 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:08:51.264723 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:51.264723 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:51.264723 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:51.264723 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:51.264723 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:51.264723 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:51.264723 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:51.264723 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:51.264723 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:51.264723 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:51.264723 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:51.264723 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:51.264723 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:51.265677 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:51.265677 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:51.265677 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:08:51.265677 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:08:51.265677 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:08:51.265677 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:08:51.265677 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:08:51.265677 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:08:51.265677 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 29 12:08:51.265677 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:51.265677 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 396/801] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jun 29 12:08:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:51.266315 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c9c96-fcce-45c7-9cec-96ad6ad1d469 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:51.266735 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c9c96-fcce-45c7-9cec-96ad6ad1d469 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:51.266735 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c9c96-fcce-45c7-9cec-96ad6ad1d469 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:51.271944 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 397/802] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:08:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:51.271944 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3c9c96-fcce-45c7-9cec-96ad6ad1d469 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:51.311403 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d556d22-d43b-4f04-b591-8a85bc842a2e None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:51.346224 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e201c127-4448-4dbd-9f7c-c65a93b74777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:51.347043 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201c127-4448-4dbd-9f7c-c65a93b74777 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:51.347327 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201c127-4448-4dbd-9f7c-c65a93b74777 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:51.347603 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201c127-4448-4dbd-9f7c-c65a93b74777 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:51.354969 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e201c127-4448-4dbd-9f7c-c65a93b74777 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:51.356420 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e201c127-4448-4dbd-9f7c-c65a93b74777 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:51.359714 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:51.372447 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-e201c127-4448-4dbd-9f7c-c65a93b74777 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 12:08:51.372447 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:51.372447 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:51.372447 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:51.372447 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:51.372447 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:51.372447 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:51.372447 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:51.372447 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:51.372447 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:51.372447 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:51.372447 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:51.372447 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:08:51.372447 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:08:51.372447 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:08:51.372447 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:08:51.373451 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:51.373451 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:51.373451 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:08:51.373451 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:51.373451 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:08:51.373451 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:51.373451 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:51.373451 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:51.373451 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:51.373451 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:51.373451 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:51.373451 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:51.373451 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:51.373451 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:51.373451 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:51.373451 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:51.373451 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:51.373451 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:51.374433 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:51.374433 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:51.374433 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:08:51.374433 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:08:51.374433 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:08:51.374433 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:08:51.374433 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:08:51.374433 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:08:51.374433 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 12:08:51.374433 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:51.374433 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 406/803] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Jun 29 12:08:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:51.375024 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e201c127-4448-4dbd-9f7c-c65a93b74777 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:51.389994 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3c9c96-fcce-45c7-9cec-96ad6ad1d469 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:51.426669 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ccfd3d-8f7e-463f-b80b-7e3ca4ff7727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:51.427298 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccfd3d-8f7e-463f-b80b-7e3ca4ff7727 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:51.427612 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccfd3d-8f7e-463f-b80b-7e3ca4ff7727 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:51.427842 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccfd3d-8f7e-463f-b80b-7e3ca4ff7727 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:51.471273 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:51.482491 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e201c127-4448-4dbd-9f7c-c65a93b74777 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:51.501703 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ccfd3d-8f7e-463f-b80b-7e3ca4ff7727 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:51.503219 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ccfd3d-8f7e-463f-b80b-7e3ca4ff7727 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:51.518551 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b77fd-10f1-4077-975d-2a553db48eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:51.519229 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b77fd-10f1-4077-975d-2a553db48eb0 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:51.519512 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b77fd-10f1-4077-975d-2a553db48eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:51.519784 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b77fd-10f1-4077-975d-2a553db48eb0 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:51.520626 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29b77fd-10f1-4077-975d-2a553db48eb0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:51.520935 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29b77fd-10f1-4077-975d-2a553db48eb0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:51.522406 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29b77fd-10f1-4077-975d-2a553db48eb0 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:51.539546 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 407/804] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Jun 29 12:08:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:51.540780 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a950d0-7c39-4332-8bba-a38c4f85ec99 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:51.541070 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a950d0-7c39-4332-8bba-a38c4f85ec99 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:51.541347 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a950d0-7c39-4332-8bba-a38c4f85ec99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:51.557280 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-d3a950d0-7c39-4332-8bba-a38c4f85ec99 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:51.558520 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d3a950d0-7c39-4332-8bba-a38c4f85ec99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:51.581571 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:51.605047 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 398/805] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:08:51 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 12:08:51.606227 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ccfd3d-8f7e-463f-b80b-7e3ca4ff7727 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:51.630032 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 408/806] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:08:51.631360 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d5fa53-570d-49c9-bf1a-c570246a9125 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:51.631644 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d5fa53-570d-49c9-bf1a-c570246a9125 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:51.631959 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d5fa53-570d-49c9-bf1a-c570246a9125 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:51.633461 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 409/807] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:08:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:51.634184 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d5fa53-570d-49c9-bf1a-c570246a9125 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:51.733220 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:51.760027 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d5fa53-570d-49c9-bf1a-c570246a9125 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:51.795643 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9421af1a-0847-4bf5-a937-99f5dffc1b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:51.796437 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9421af1a-0847-4bf5-a937-99f5dffc1b82 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:51.796716 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9421af1a-0847-4bf5-a937-99f5dffc1b82 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:51.796986 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9421af1a-0847-4bf5-a937-99f5dffc1b82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:51.807140 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9421af1a-0847-4bf5-a937-99f5dffc1b82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:51.808595 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9421af1a-0847-4bf5-a937-99f5dffc1b82 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:51.825945 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-9421af1a-0847-4bf5-a937-99f5dffc1b82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:51.825945 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:51.825945 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:51.825945 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:51.825945 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:51.825945 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:51.825945 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:51.825945 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:51.825945 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:51.825945 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:51.825945 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:51.825945 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:51.825945 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:51.825945 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:51.825945 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:51.827253 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:51.827253 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:51.827253 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:51.827253 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:51.827253 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:51.827253 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:51.827253 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:51.827253 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:51.827253 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:51.827253 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:51.827253 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:51.827253 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:51.827253 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:51.827253 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:51.827253 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:51.827253 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:51.827253 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:51.828190 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:51.828190 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:51.828190 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:51.828190 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:51.828190 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 410/808] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:51.828519 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9421af1a-0847-4bf5-a937-99f5dffc1b82 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:51.839628 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ccfd3d-8f7e-463f-b80b-7e3ca4ff7727 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:51.874032 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b5aa93-6662-42db-a0e4-78dcb48be3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:51.874726 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5aa93-6662-42db-a0e4-78dcb48be3c2 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:51.874993 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5aa93-6662-42db-a0e4-78dcb48be3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:51.875269 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5aa93-6662-42db-a0e4-78dcb48be3c2 None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:51.876121 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b5aa93-6662-42db-a0e4-78dcb48be3c2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:51.876433 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b5aa93-6662-42db-a0e4-78dcb48be3c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:51.877897 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b5aa93-6662-42db-a0e4-78dcb48be3c2 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:51.895040 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 399/809] 10.222.0.27 () {56 vars in 1149 bytes} [Wed Jun 29 12:08:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:51.896547 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca59a6-b2d9-449e-beb1-c90142314c64 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:51.896832 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca59a6-b2d9-449e-beb1-c90142314c64 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:51.897088 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca59a6-b2d9-449e-beb1-c90142314c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:51.912784 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-aaca59a6-b2d9-449e-beb1-c90142314c64 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:51.914142 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-aaca59a6-b2d9-449e-beb1-c90142314c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:51.928597 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9421af1a-0847-4bf5-a937-99f5dffc1b82 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:51.941380 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:51.957666 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:51.963896 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74604e0b-4cfd-4827-b64b-5d92bbbe3395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:51.964724 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74604e0b-4cfd-4827-b64b-5d92bbbe3395 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:51.965008 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74604e0b-4cfd-4827-b64b-5d92bbbe3395 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:51.965282 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74604e0b-4cfd-4827-b64b-5d92bbbe3395 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:51.975340 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74604e0b-4cfd-4827-b64b-5d92bbbe3395 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:51.976863 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74604e0b-4cfd-4827-b64b-5d92bbbe3395 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:51.980241 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 400/810] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:08:51.981075 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca59a6-b2d9-449e-beb1-c90142314c64 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:51.994919 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-74604e0b-4cfd-4827-b64b-5d92bbbe3395 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:51.994919 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:51.994919 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:51.994919 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:51.994919 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:51.994919 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:51.994919 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:51.994919 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:51.994919 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:51.994919 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:51.994919 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:51.994919 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:51.994919 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:51.994919 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:51.994919 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:51.995926 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:51.995926 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:51.995926 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:51.995926 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:51.995926 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:51.995926 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:51.995926 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:51.995926 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:51.995926 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:51.995926 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:51.995926 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:51.995926 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:51.995926 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:51.995926 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:51.995926 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:51.995926 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:51.995926 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:51.996850 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:51.996850 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:51.996850 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:51.996850 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:51.996850 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 411/811] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:51.997149 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74604e0b-4cfd-4827-b64b-5d92bbbe3395 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:52.096374 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74604e0b-4cfd-4827-b64b-5d92bbbe3395 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:52.097127 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca59a6-b2d9-449e-beb1-c90142314c64 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:52.129769 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c60c0-2bab-40d6-b2ce-c5b5c8627ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:52.130423 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c60c0-2bab-40d6-b2ce-c5b5c8627ef0 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:52.130698 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c60c0-2bab-40d6-b2ce-c5b5c8627ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:52.130966 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c60c0-2bab-40d6-b2ce-c5b5c8627ef0 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:52.131332 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db11bf-a739-4497-b7a5-8150ae2459d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:52.131681 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c60c0-2bab-40d6-b2ce-c5b5c8627ef0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:52.132024 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c60c0-2bab-40d6-b2ce-c5b5c8627ef0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:52.132171 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db11bf-a739-4497-b7a5-8150ae2459d9 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:52.132465 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db11bf-a739-4497-b7a5-8150ae2459d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:52.132740 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db11bf-a739-4497-b7a5-8150ae2459d9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:52.133381 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db11bf-a739-4497-b7a5-8150ae2459d9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:52.133481 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c60c0-2bab-40d6-b2ce-c5b5c8627ef0 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:52.134767 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db11bf-a739-4497-b7a5-8150ae2459d9 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:52.144751 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 412/812] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:52.145532 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c60c0-2bab-40d6-b2ce-c5b5c8627ef0 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:52.146811 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-77db11bf-a739-4497-b7a5-8150ae2459d9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 12:08:52.146811 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:52.146811 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 12:08:52.146811 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 12:08:52.146811 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 12:08:52.146811 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 12:08:52.146811 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 12:08:52.146811 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:08:52.146811 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 12:08:52.146811 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:52.146811 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 12:08:52.146811 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:52.146811 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:52.146811 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:52.146811 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:52.146811 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:52.147788 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:52.147788 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:52.147788 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:52.147788 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:52.147788 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:52.147788 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:52.147788 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:52.147788 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 12:08:52.147788 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 12:08:52.147788 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 12:08:52.147788 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 12:08:52.147788 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:52.147788 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:52.147788 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:52.147788 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:52.147788 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:52.148665 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:52.148665 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:52.148665 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:52.148665 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:52.148665 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:52.148665 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:52.148665 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:52.148665 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:52.148665 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:52.148665 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:52.148665 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:52.148665 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 12:08:52.148665 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:08:52.148665 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 12:08:52.148665 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:52.148665 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 401/813] 10.222.0.27 () {56 vars in 1129 bytes} [Wed Jun 29 12:08:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:52.151465 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db11bf-a739-4497-b7a5-8150ae2459d9 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:52.180355 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:52.190281 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:52.248107 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c60c0-2bab-40d6-b2ce-c5b5c8627ef0 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:52.250657 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db11bf-a739-4497-b7a5-8150ae2459d9 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:52.283750 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45caeb6c-8729-446d-bba7-84040d709080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:52.284418 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45caeb6c-8729-446d-bba7-84040d709080 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:52.284700 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45caeb6c-8729-446d-bba7-84040d709080 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:52.284975 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45caeb6c-8729-446d-bba7-84040d709080 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:52.285747 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45caeb6c-8729-446d-bba7-84040d709080 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:52.286027 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45caeb6c-8729-446d-bba7-84040d709080 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:52.287400 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45caeb6c-8729-446d-bba7-84040d709080 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:52.288041 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67466f47-e4aa-440b-931d-e3ec6039fe27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:52.289284 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67466f47-e4aa-440b-931d-e3ec6039fe27 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:52.289729 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67466f47-e4aa-440b-931d-e3ec6039fe27 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:52.290147 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67466f47-e4aa-440b-931d-e3ec6039fe27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:52.299644 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 402/814] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:52.300623 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45caeb6c-8729-446d-bba7-84040d709080 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:52.307239 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67466f47-e4aa-440b-931d-e3ec6039fe27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:52.309541 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67466f47-e4aa-440b-931d-e3ec6039fe27 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:52.334181 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-67466f47-e4aa-440b-931d-e3ec6039fe27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:52.334181 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:52.334181 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:52.334181 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:52.334181 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:52.334181 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:52.334181 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:52.334181 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:52.334181 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:52.334181 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:52.334181 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:52.334181 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:52.334181 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:52.334181 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:52.334181 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:52.335316 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:52.335316 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:52.335316 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:52.335316 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:52.335316 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:52.335316 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:52.335316 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:52.335316 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:52.335316 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:52.335316 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:52.335316 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:52.335316 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:52.335316 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:52.335316 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:52.335316 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:52.335316 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:52.335316 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:52.336237 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:52.336237 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:52.336237 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:52.336237 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:52.336237 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 413/815] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:52.337145 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67466f47-e4aa-440b-931d-e3ec6039fe27 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:52.392742 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:52.402624 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45caeb6c-8729-446d-bba7-84040d709080 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:52.436447 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:52.436800 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78cdd89-d0ae-433d-81b5-3a8781ec24c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:52.437596 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78cdd89-d0ae-433d-81b5-3a8781ec24c3 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:52.437897 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78cdd89-d0ae-433d-81b5-3a8781ec24c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:52.438165 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78cdd89-d0ae-433d-81b5-3a8781ec24c3 None admin] PATH_INFO: `/v3/services/network` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:52.438817 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78cdd89-d0ae-433d-81b5-3a8781ec24c3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:52.440175 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78cdd89-d0ae-433d-81b5-3a8781ec24c3 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:52.443461 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67466f47-e4aa-440b-931d-e3ec6039fe27 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:52.451662 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-d78cdd89-d0ae-433d-81b5-3a8781ec24c3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 12:08:52.451662 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:52.451662 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 12:08:52.451662 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 12:08:52.451662 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 12:08:52.451662 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 12:08:52.451662 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 12:08:52.451662 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:08:52.451662 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 12:08:52.451662 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:52.451662 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 12:08:52.451662 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:52.451662 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:52.451662 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:52.451662 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:52.451662 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:52.451662 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:52.453185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:52.453185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:52.453185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:52.453185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:52.453185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:52.453185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:52.453185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 12:08:52.453185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 12:08:52.453185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 12:08:52.453185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 12:08:52.453185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:52.453185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:52.453185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:52.453185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:52.453185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:52.453185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:52.454146 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:52.454146 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:52.454146 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:52.454146 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:52.454146 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:52.454146 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:52.454146 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:52.454146 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:52.454146 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:52.454146 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:52.454146 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 12:08:52.454146 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:08:52.454146 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 12:08:52.454146 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:52.454146 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 403/816] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jun 29 12:08:52 2022] GET /identity/v3/services/network => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:52.455118 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78cdd89-d0ae-433d-81b5-3a8781ec24c3 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:52.483184 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635476a6-8a83-47d3-a9f4-da8e4d2f4196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:52.484020 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635476a6-8a83-47d3-a9f4-da8e4d2f4196 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:52.484264 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635476a6-8a83-47d3-a9f4-da8e4d2f4196 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:52.484534 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635476a6-8a83-47d3-a9f4-da8e4d2f4196 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:52.491778 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635476a6-8a83-47d3-a9f4-da8e4d2f4196 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:52.493257 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635476a6-8a83-47d3-a9f4-da8e4d2f4196 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:52.508615 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-635476a6-8a83-47d3-a9f4-da8e4d2f4196 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:52.508615 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:52.508615 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:52.508615 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:52.508615 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:52.508615 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:52.508615 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:52.508615 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:52.508615 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:52.508615 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:52.508615 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:52.508615 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:52.508615 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:08:52.508615 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:08:52.508615 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:08:52.509647 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:08:52.509647 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:52.509647 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:52.509647 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:52.509647 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:52.509647 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:52.509647 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:52.509647 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:52.509647 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:52.509647 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:52.509647 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:52.509647 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:52.509647 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:52.509647 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:52.509647 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:52.509647 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:52.509647 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:52.510780 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:08:52.510780 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:08:52.510780 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:08:52.510780 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:08:52.510780 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:08:52.510780 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:08:52.510780 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:52.510780 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:52.510780 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 414/817] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jun 29 12:08:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:52.510780 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635476a6-8a83-47d3-a9f4-da8e4d2f4196 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:52.563325 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78cdd89-d0ae-433d-81b5-3a8781ec24c3 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:52.599536 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e058f04-da2b-4aae-b7cd-f4a59bee92a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:52.600204 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e058f04-da2b-4aae-b7cd-f4a59bee92a9 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:52.600485 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e058f04-da2b-4aae-b7cd-f4a59bee92a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:52.600867 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e058f04-da2b-4aae-b7cd-f4a59bee92a9 None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:52.601577 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e058f04-da2b-4aae-b7cd-f4a59bee92a9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:52.601961 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e058f04-da2b-4aae-b7cd-f4a59bee92a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:52.603348 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e058f04-da2b-4aae-b7cd-f4a59bee92a9 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:52.607904 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 404/818] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Jun 29 12:08:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:52.608661 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635476a6-8a83-47d3-a9f4-da8e4d2f4196 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:52.608774 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e058f04-da2b-4aae-b7cd-f4a59bee92a9 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:52.629228 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:52.654076 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b323280-e191-499c-a0ba-f0557acbde6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:52.654952 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b323280-e191-499c-a0ba-f0557acbde6e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:52.655429 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b323280-e191-499c-a0ba-f0557acbde6e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:52.655865 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b323280-e191-499c-a0ba-f0557acbde6e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:52.664610 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b323280-e191-499c-a0ba-f0557acbde6e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:52.666105 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b323280-e191-499c-a0ba-f0557acbde6e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:52.680437 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-0b323280-e191-499c-a0ba-f0557acbde6e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:52.680437 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:52.680437 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:52.680437 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:52.680437 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:52.680437 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:52.680437 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:52.680437 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:52.680437 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:52.680437 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:52.680437 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:52.680437 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:52.680437 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:08:52.680437 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:08:52.680437 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:08:52.681345 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:08:52.681345 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:52.681345 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:52.681345 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:52.681345 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:52.681345 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:52.681345 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:52.681345 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:52.681345 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:52.681345 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:52.681345 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:52.681345 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:52.681345 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:52.681345 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:52.681345 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:52.681345 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:52.681345 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:52.682307 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:08:52.682307 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:08:52.682307 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:08:52.682307 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:08:52.682307 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:08:52.682307 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:08:52.682307 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:52.682307 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:52.682307 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 415/819] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jun 29 12:08:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:52.682792 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b323280-e191-499c-a0ba-f0557acbde6e None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:52.703228 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:52.719752 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e058f04-da2b-4aae-b7cd-f4a59bee92a9 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:52.756127 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18daca63-0470-4251-b423-713e11433618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:52.756788 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18daca63-0470-4251-b423-713e11433618 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:52.757121 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18daca63-0470-4251-b423-713e11433618 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:52.757394 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18daca63-0470-4251-b423-713e11433618 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:52.758144 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18daca63-0470-4251-b423-713e11433618 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:52.758446 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18daca63-0470-4251-b423-713e11433618 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:52.759862 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18daca63-0470-4251-b423-713e11433618 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:52.771623 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 405/820] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:52.772410 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18daca63-0470-4251-b423-713e11433618 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:52.787484 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b323280-e191-499c-a0ba-f0557acbde6e None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:52.821343 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89490266-64b7-4f8b-a0a9-540a1ed37d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:52.822030 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89490266-64b7-4f8b-a0a9-540a1ed37d7c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:52.822310 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89490266-64b7-4f8b-a0a9-540a1ed37d7c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:52.822579 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89490266-64b7-4f8b-a0a9-540a1ed37d7c None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:52.823258 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89490266-64b7-4f8b-a0a9-540a1ed37d7c None admin] RBAC: Adding query filter params (name=network) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:52.823560 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89490266-64b7-4f8b-a0a9-540a1ed37d7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:52.824932 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89490266-64b7-4f8b-a0a9-540a1ed37d7c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:52.829761 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 416/821] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Jun 29 12:08:52 2022] GET /identity/v3/services?name=network => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:52.830540 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89490266-64b7-4f8b-a0a9-540a1ed37d7c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:52.849498 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:52.872092 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18daca63-0470-4251-b423-713e11433618 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:52.906777 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa8e5b-7d46-435d-9a3f-5ff332065345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:52.907434 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa8e5b-7d46-435d-9a3f-5ff332065345 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:52.907709 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa8e5b-7d46-435d-9a3f-5ff332065345 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:52.907976 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa8e5b-7d46-435d-9a3f-5ff332065345 None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:52.908770 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfa8e5b-7d46-435d-9a3f-5ff332065345 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:52.908935 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:52.909092 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfa8e5b-7d46-435d-9a3f-5ff332065345 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:52.910519 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfa8e5b-7d46-435d-9a3f-5ff332065345 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:52.922057 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 406/822] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jun 29 12:08:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:52.923981 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa8e5b-7d46-435d-9a3f-5ff332065345 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:52.932235 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89490266-64b7-4f8b-a0a9-540a1ed37d7c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:52.966128 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d2ecc2-26e4-4d8b-92ad-d7187ad08849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:52.966982 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2ecc2-26e4-4d8b-92ad-d7187ad08849 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:52.967100 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2ecc2-26e4-4d8b-92ad-d7187ad08849 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:52.967316 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2ecc2-26e4-4d8b-92ad-d7187ad08849 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:52.968018 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d2ecc2-26e4-4d8b-92ad-d7187ad08849 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:52.968318 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d2ecc2-26e4-4d8b-92ad-d7187ad08849 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:52.969676 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d2ecc2-26e4-4d8b-92ad-d7187ad08849 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:52.974456 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 417/823] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Jun 29 12:08:52 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:52.975216 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d2ecc2-26e4-4d8b-92ad-d7187ad08849 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:53.023254 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa8e5b-7d46-435d-9a3f-5ff332065345 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:53.058967 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a2eea-caba-4aeb-8203-a55d57e04707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:53.059637 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a2eea-caba-4aeb-8203-a55d57e04707 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:53.059916 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a2eea-caba-4aeb-8203-a55d57e04707 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:53.060190 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a2eea-caba-4aeb-8203-a55d57e04707 None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:53.060985 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a2eea-caba-4aeb-8203-a55d57e04707 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:53.061298 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a2eea-caba-4aeb-8203-a55d57e04707 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:53.062778 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a2eea-caba-4aeb-8203-a55d57e04707 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:53.069494 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:53.075965 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 407/824] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jun 29 12:08:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:53.077110 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a2eea-caba-4aeb-8203-a55d57e04707 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:53.086771 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d2ecc2-26e4-4d8b-92ad-d7187ad08849 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:53.123235 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb142c8-ee84-429c-8ad0-b6a8b14478e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:53.124067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb142c8-ee84-429c-8ad0-b6a8b14478e0 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:53.124350 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb142c8-ee84-429c-8ad0-b6a8b14478e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:53.124624 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb142c8-ee84-429c-8ad0-b6a8b14478e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:53.131596 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb142c8-ee84-429c-8ad0-b6a8b14478e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:53.133138 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb142c8-ee84-429c-8ad0-b6a8b14478e0 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:53.147576 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-1fb142c8-ee84-429c-8ad0-b6a8b14478e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:53.147576 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:53.147576 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:53.147576 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:53.147576 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:53.147576 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:53.147576 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:53.147576 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:53.147576 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:53.147576 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:53.147576 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:53.147576 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:53.147576 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:08:53.147576 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:08:53.147576 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:08:53.148687 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:08:53.148687 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:53.148687 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:53.148687 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:53.148687 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:53.148687 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:53.148687 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:53.148687 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:53.148687 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:53.148687 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:53.148687 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:53.148687 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:53.148687 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:53.148687 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:53.148687 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:53.148687 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:53.148687 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:53.149625 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:08:53.149625 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:08:53.149625 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:08:53.149625 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:08:53.149625 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:08:53.149625 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:08:53.149625 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:53.149625 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:53.149625 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 418/825] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jun 29 12:08:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:53.149625 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb142c8-ee84-429c-8ad0-b6a8b14478e0 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:53.152735 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:53.175840 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a2eea-caba-4aeb-8203-a55d57e04707 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:53.210525 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ffb8f8-d06d-43a1-b8a7-bb555ceed378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:53.211195 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ffb8f8-d06d-43a1-b8a7-bb555ceed378 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:53.211473 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ffb8f8-d06d-43a1-b8a7-bb555ceed378 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:53.211747 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ffb8f8-d06d-43a1-b8a7-bb555ceed378 None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:53.212523 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ffb8f8-d06d-43a1-b8a7-bb555ceed378 None admin] RBAC: Adding query filter params (type=network) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:53.212831 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ffb8f8-d06d-43a1-b8a7-bb555ceed378 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:53.214254 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ffb8f8-d06d-43a1-b8a7-bb555ceed378 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:53.218990 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 408/826] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Jun 29 12:08:53 2022] GET /identity/v3/services?type=network => generated 350 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:53.219759 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ffb8f8-d06d-43a1-b8a7-bb555ceed378 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:53.256526 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb142c8-ee84-429c-8ad0-b6a8b14478e0 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:53.281980 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:53.290918 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b06f7-54a9-49ca-bdc6-8912ab7f0fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:53.291809 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b06f7-54a9-49ca-bdc6-8912ab7f0fe1 None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:53.292110 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b06f7-54a9-49ca-bdc6-8912ab7f0fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:53.292380 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b06f7-54a9-49ca-bdc6-8912ab7f0fe1 None admin] PATH_INFO: `/v3/projects/996db30845f84e57865fa40b9a730a05/users/cc92f8232bda407c84365eb10ede737f/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:53.294489 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279b06f7-54a9-49ca-bdc6-8912ab7f0fe1 None admin] RBAC: Authorizing `identity:create_grant(project_id=996db30845f84e57865fa40b9a730a05, user_id=cc92f8232bda407c84365eb10ede737f, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:53.296329 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279b06f7-54a9-49ca-bdc6-8912ab7f0fe1 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:53.309579 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 419/827] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jun 29 12:08:53 2022] PUT /identity/v3/projects/996db30845f84e57865fa40b9a730a05/users/cc92f8232bda407c84365eb10ede737f/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:08:53.310523 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b06f7-54a9-49ca-bdc6-8912ab7f0fe1 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:53.332445 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ffb8f8-d06d-43a1-b8a7-bb555ceed378 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:53.371452 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8797858-f90c-4f98-bdba-eb7284b787f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:53.372137 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8797858-f90c-4f98-bdba-eb7284b787f8 None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:53.372417 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8797858-f90c-4f98-bdba-eb7284b787f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:53.372691 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8797858-f90c-4f98-bdba-eb7284b787f8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:53.373457 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8797858-f90c-4f98-bdba-eb7284b787f8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:53.374883 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8797858-f90c-4f98-bdba-eb7284b787f8 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:53.383282 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:53.409722 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 409/828] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Jun 29 12:08:53 2022] POST /identity/v3/endpoints => generated 346 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:08:53.409722 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8797858-f90c-4f98-bdba-eb7284b787f8 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:53.430998 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b06f7-54a9-49ca-bdc6-8912ab7f0fe1 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:53.481942 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca89b4-4308-4fdd-b23c-bbaeb8fc3993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:53.482635 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca89b4-4308-4fdd-b23c-bbaeb8fc3993 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:53.482914 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca89b4-4308-4fdd-b23c-bbaeb8fc3993 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:53.483185 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca89b4-4308-4fdd-b23c-bbaeb8fc3993 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:53.484027 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ca89b4-4308-4fdd-b23c-bbaeb8fc3993 None admin] RBAC: Adding query filter params (role.id=e0e69ac8a8bf4cc4baa6aa18f2fc9919, scope.project.id=996db30845f84e57865fa40b9a730a05, user.id=7adaa2ef440941aa8214f2b2fd49b54e) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:53.484337 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ca89b4-4308-4fdd-b23c-bbaeb8fc3993 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:53.485815 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ca89b4-4308-4fdd-b23c-bbaeb8fc3993 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:53.493552 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 420/829] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jun 29 12:08:53 2022] GET /identity/v3/role_assignments?user.id=7adaa2ef440941aa8214f2b2fd49b54e&scope.project.id=996db30845f84e57865fa40b9a730a05&role.id=e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:53.494517 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca89b4-4308-4fdd-b23c-bbaeb8fc3993 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:53.556039 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8797858-f90c-4f98-bdba-eb7284b787f8 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:53.586290 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:53.607717 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9301ed79-3d69-483b-a96a-4ed8f77c3ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:53.608641 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301ed79-3d69-483b-a96a-4ed8f77c3ad2 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:53.608925 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301ed79-3d69-483b-a96a-4ed8f77c3ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:53.609199 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301ed79-3d69-483b-a96a-4ed8f77c3ad2 None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:53.610049 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9301ed79-3d69-483b-a96a-4ed8f77c3ad2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:53.610461 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9301ed79-3d69-483b-a96a-4ed8f77c3ad2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:53.613110 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9301ed79-3d69-483b-a96a-4ed8f77c3ad2 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:53.631430 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 410/830] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jun 29 12:08:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:53.635752 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca89b4-4308-4fdd-b23c-bbaeb8fc3993 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:53.637013 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9301ed79-3d69-483b-a96a-4ed8f77c3ad2 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:53.664378 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:53.680178 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd33cc1b-a409-4af6-9e41-2998a0f7ada3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:53.681238 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33cc1b-a409-4af6-9e41-2998a0f7ada3 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:53.681607 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33cc1b-a409-4af6-9e41-2998a0f7ada3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:53.682008 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33cc1b-a409-4af6-9e41-2998a0f7ada3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:53.682845 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd33cc1b-a409-4af6-9e41-2998a0f7ada3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:53.684319 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd33cc1b-a409-4af6-9e41-2998a0f7ada3 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:53.709807 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 421/831] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Jun 29 12:08:53 2022] POST /identity/v3/endpoints => generated 327 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:08:53.774140 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9301ed79-3d69-483b-a96a-4ed8f77c3ad2 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:53.828449 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807897d-f2d4-4dba-b6f5-e3dc58161adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:53.829366 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807897d-f2d4-4dba-b6f5-e3dc58161adb None admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:53.829647 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807897d-f2d4-4dba-b6f5-e3dc58161adb None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:53.829956 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807897d-f2d4-4dba-b6f5-e3dc58161adb None admin] PATH_INFO: `/v3/projects/996db30845f84e57865fa40b9a730a05/users/cad33601754a462c828566fb54c6e100/roles/6f63a9619c7b40ebb5b73bde026d606b` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:53.847620 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d807897d-f2d4-4dba-b6f5-e3dc58161adb None admin] RBAC: Authorizing `identity:create_grant(project_id=996db30845f84e57865fa40b9a730a05, user_id=cad33601754a462c828566fb54c6e100, role_id=6f63a9619c7b40ebb5b73bde026d606b)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:53.849107 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d807897d-f2d4-4dba-b6f5-e3dc58161adb None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:53.868689 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 411/832] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jun 29 12:08:53 2022] PUT /identity/v3/projects/996db30845f84e57865fa40b9a730a05/users/cad33601754a462c828566fb54c6e100/roles/6f63a9619c7b40ebb5b73bde026d606b => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:08:55.531363 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df207a-776e-4225-a75d-ad3da639beba None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:55.531929 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df207a-776e-4225-a75d-ad3da639beba None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:55.531929 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df207a-776e-4225-a75d-ad3da639beba None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:55.533507 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 422/833] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:08:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:55.539088 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c1058-b8eb-4663-81f6-3328e34207fa None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:55.539554 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c1058-b8eb-4663-81f6-3328e34207fa None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:55.539651 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c1058-b8eb-4663-81f6-3328e34207fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:55.558216 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-855c1058-b8eb-4663-81f6-3328e34207fa None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:55.559425 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-855c1058-b8eb-4663-81f6-3328e34207fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:55.579219 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:55.633411 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 412/834] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:55 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 12:08:55.657626 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df207a-776e-4225-a75d-ad3da639beba None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:55.671051 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fad0ca-c2fa-481c-8b70-ec78d01f8428 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:55.671350 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fad0ca-c2fa-481c-8b70-ec78d01f8428 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:55.671605 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fad0ca-c2fa-481c-8b70-ec78d01f8428 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:55.673232 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 413/835] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:08:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:55.678382 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2a067-b31d-4502-9739-4b560572774d None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:55.678677 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2a067-b31d-4502-9739-4b560572774d None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:55.678997 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2a067-b31d-4502-9739-4b560572774d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:55.696797 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-2cd2a067-b31d-4502-9739-4b560572774d None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:55.698198 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-2cd2a067-b31d-4502-9739-4b560572774d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:55.785299 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 414/836] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:55 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 12:08:55.794414 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df207a-776e-4225-a75d-ad3da639beba None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:55.805359 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c6151-bc59-4df7-aaee-0dd4a4f43df3 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:55.806001 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c6151-bc59-4df7-aaee-0dd4a4f43df3 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:55.806467 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c6151-bc59-4df7-aaee-0dd4a4f43df3 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:55.808051 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 415/837] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:08:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:08:55.808964 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c6151-bc59-4df7-aaee-0dd4a4f43df3 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:55.832515 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd3860f-b5d5-4408-96c4-4e4eb7c05964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:55.833359 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3860f-b5d5-4408-96c4-4e4eb7c05964 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:55.833588 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3860f-b5d5-4408-96c4-4e4eb7c05964 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:55.834169 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3860f-b5d5-4408-96c4-4e4eb7c05964 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:55.845164 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd3860f-b5d5-4408-96c4-4e4eb7c05964 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:08:55.852875 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-3fd3860f-b5d5-4408-96c4-4e4eb7c05964 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:08:55.852875 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:55.852875 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:55.852875 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:55.852875 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:55.852875 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:55.852875 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:55.852875 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:55.852875 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:55.852875 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:55.852875 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:55.852875 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:55.852875 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:08:55.852875 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:08:55.852875 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:08:55.852875 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:08:55.853908 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:08:55.853908 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:08:55.853908 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:08:55.853908 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:08:55.853908 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:55.853908 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:55.853908 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:55.853908 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:55.853908 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:55.853908 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:55.853908 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:55.853908 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:55.853908 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:55.853908 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:55.853908 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:55.853908 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:55.854790 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:55.854790 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:55.854790 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:55.854790 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:55.854790 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:08:55.854790 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:08:55.854790 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:08:55.854790 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:08:55.854790 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:08:55.854790 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:08:55.854790 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:08:55.854790 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:55.854790 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 423/838] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jun 29 12:08:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:55.855521 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bfd3c0-563a-4387-9789-0c9890780d79 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:55.855603 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bfd3c0-563a-4387-9789-0c9890780d79 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:55.856514 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bfd3c0-563a-4387-9789-0c9890780d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:55.872678 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-b0bfd3c0-563a-4387-9789-0c9890780d79 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:55.873897 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b0bfd3c0-563a-4387-9789-0c9890780d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:55.905002 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:55.907737 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:55.926270 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c6151-bc59-4df7-aaee-0dd4a4f43df3 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:55.947427 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 424/839] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:55 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:08:55.948567 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bfd3c0-563a-4387-9789-0c9890780d79 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:55.970007 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5797831e-94f6-4ae9-a6e2-594fb7955f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:55.970813 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797831e-94f6-4ae9-a6e2-594fb7955f63 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:55.971089 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797831e-94f6-4ae9-a6e2-594fb7955f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:55.971363 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797831e-94f6-4ae9-a6e2-594fb7955f63 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:55.972016 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5797831e-94f6-4ae9-a6e2-594fb7955f63 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:55.973388 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5797831e-94f6-4ae9-a6e2-594fb7955f63 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:55.985032 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-5797831e-94f6-4ae9-a6e2-594fb7955f63 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 12:08:55.985032 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:55.985032 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 12:08:55.985032 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 12:08:55.985032 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 12:08:55.985032 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 12:08:55.985032 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 12:08:55.985032 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:08:55.985032 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 12:08:55.985032 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:55.985032 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 12:08:55.985032 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:55.985032 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:55.985032 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:55.985032 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:55.985032 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:55.985032 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:55.986258 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:55.986258 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:55.986258 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:55.986258 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:55.986258 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:55.986258 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:55.986258 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 12:08:55.986258 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 12:08:55.986258 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 12:08:55.986258 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 12:08:55.986258 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:55.986258 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:55.986258 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:55.986258 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:55.986258 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:55.986258 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:55.987126 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:55.987126 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:55.987126 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:55.987126 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:55.987126 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:55.987126 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:55.987126 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:55.987126 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:55.987126 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:55.987126 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:55.987126 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 12:08:55.987126 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:08:55.987126 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 12:08:55.987126 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:55.987126 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 416/840] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jun 29 12:08:55 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:55.987950 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a1c6e-46c8-46e8-96af-b5668bcd1c6d None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:55.987950 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a1c6e-46c8-46e8-96af-b5668bcd1c6d None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:55.987950 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a1c6e-46c8-46e8-96af-b5668bcd1c6d None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:55.989739 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 417/841] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:08:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:55.990017 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147a1c6e-46c8-46e8-96af-b5668bcd1c6d None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:56.060898 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bfd3c0-563a-4387-9789-0c9890780d79 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:56.095542 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dcdbc1-da84-4284-87a2-afae389c68c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:56.096222 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcdbc1-da84-4284-87a2-afae389c68c0 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:56.096506 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcdbc1-da84-4284-87a2-afae389c68c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:56.096783 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcdbc1-da84-4284-87a2-afae389c68c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:56.097539 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dcdbc1-da84-4284-87a2-afae389c68c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:56.097887 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dcdbc1-da84-4284-87a2-afae389c68c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:56.098508 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147a1c6e-46c8-46e8-96af-b5668bcd1c6d None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:56.099273 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dcdbc1-da84-4284-87a2-afae389c68c0 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:56.107698 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 425/842] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:08:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:56.108589 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dcdbc1-da84-4284-87a2-afae389c68c0 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:56.133389 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4112b351-988b-4049-9620-670403c93e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:56.134251 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112b351-988b-4049-9620-670403c93e27 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:56.134539 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112b351-988b-4049-9620-670403c93e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:56.134816 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112b351-988b-4049-9620-670403c93e27 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:56.135477 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4112b351-988b-4049-9620-670403c93e27 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:56.136867 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4112b351-988b-4049-9620-670403c93e27 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:56.140910 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:56.149278 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-4112b351-988b-4049-9620-670403c93e27 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 12:08:56.149278 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:56.149278 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 12:08:56.149278 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 12:08:56.149278 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 12:08:56.149278 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 12:08:56.149278 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 12:08:56.149278 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:08:56.149278 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 12:08:56.149278 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:56.149278 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 12:08:56.149278 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:56.149278 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:56.149278 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:56.149278 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:56.149278 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:56.150283 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:56.150283 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:56.150283 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:56.150283 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:56.150283 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:56.150283 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:56.150283 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:56.150283 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 12:08:56.150283 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 12:08:56.150283 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 12:08:56.150283 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 12:08:56.150283 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:56.150283 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:56.150283 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:56.150283 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:56.150283 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:56.151207 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:56.151207 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:56.151207 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:56.151207 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:56.151207 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:56.151207 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:56.151207 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:56.151207 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:56.151207 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:56.151207 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:56.151207 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:56.151207 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 12:08:56.151207 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:08:56.151207 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 12:08:56.151207 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:56.151207 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 418/843] 10.222.0.27 () {56 vars in 1132 bytes} [Wed Jun 29 12:08:55 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:56.152106 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56de6aa-b353-4ae2-9f69-fdb97a4271bf None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:56.152384 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56de6aa-b353-4ae2-9f69-fdb97a4271bf None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:56.152690 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56de6aa-b353-4ae2-9f69-fdb97a4271bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:56.168813 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-f56de6aa-b353-4ae2-9f69-fdb97a4271bf None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:56.170053 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-f56de6aa-b353-4ae2-9f69-fdb97a4271bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:56.177410 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:56.214481 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dcdbc1-da84-4284-87a2-afae389c68c0 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:56.237561 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 419/844] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:56 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:08:56.238433 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56de6aa-b353-4ae2-9f69-fdb97a4271bf None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:56.259828 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7e2af-592a-4996-b5e8-3e3eb01a4f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:56.260508 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7e2af-592a-4996-b5e8-3e3eb01a4f6b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:56.260785 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7e2af-592a-4996-b5e8-3e3eb01a4f6b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:56.261058 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7e2af-592a-4996-b5e8-3e3eb01a4f6b None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:56.261791 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c7e2af-592a-4996-b5e8-3e3eb01a4f6b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:56.262074 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c7e2af-592a-4996-b5e8-3e3eb01a4f6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:56.263438 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c7e2af-592a-4996-b5e8-3e3eb01a4f6b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:56.268050 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 426/845] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jun 29 12:08:56 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:56.269402 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7e2af-592a-4996-b5e8-3e3eb01a4f6b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:56.340513 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56de6aa-b353-4ae2-9f69-fdb97a4271bf None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:56.363175 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:56.370920 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7e2af-592a-4996-b5e8-3e3eb01a4f6b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:56.375511 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae37ee4-d1a9-41f3-8b7f-80986551bb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:56.376308 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae37ee4-d1a9-41f3-8b7f-80986551bb6c None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:56.376589 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae37ee4-d1a9-41f3-8b7f-80986551bb6c None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:56.376861 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae37ee4-d1a9-41f3-8b7f-80986551bb6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:56.387562 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae37ee4-d1a9-41f3-8b7f-80986551bb6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:56.389041 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae37ee4-d1a9-41f3-8b7f-80986551bb6c None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:56.390910 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:56.404025 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f68f24-8422-496a-9922-cd4475db4edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:56.404689 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f68f24-8422-496a-9922-cd4475db4edb None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:56.404966 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f68f24-8422-496a-9922-cd4475db4edb None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:56.405236 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f68f24-8422-496a-9922-cd4475db4edb None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:56.405979 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f68f24-8422-496a-9922-cd4475db4edb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:56.406280 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f68f24-8422-496a-9922-cd4475db4edb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:56.407632 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f68f24-8422-496a-9922-cd4475db4edb None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:56.407996 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-fae37ee4-d1a9-41f3-8b7f-80986551bb6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:56.407996 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:56.407996 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:56.407996 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:56.407996 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:56.407996 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:56.407996 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:56.407996 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:56.407996 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:56.407996 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:56.407996 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:56.407996 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:56.407996 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:56.407996 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:56.407996 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:56.408873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:56.408873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:56.408873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:56.408873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:56.408873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:56.408873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:56.408873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:56.408873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:56.408873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:56.408873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:56.408873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:56.408873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:56.408873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:56.408873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:56.408873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:56.408873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:56.408873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:56.409826 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:56.409826 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:56.409826 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:56.409826 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:56.409826 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 420/846] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:56.410105 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae37ee4-d1a9-41f3-8b7f-80986551bb6c None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:56.415448 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 427/847] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Jun 29 12:08:56 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:56.416357 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f68f24-8422-496a-9922-cd4475db4edb None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:56.515258 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae37ee4-d1a9-41f3-8b7f-80986551bb6c None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:56.520354 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f68f24-8422-496a-9922-cd4475db4edb None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:56.549074 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08039c98-d2a1-4896-832a-b7be6854297a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:56.549905 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08039c98-d2a1-4896-832a-b7be6854297a None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:56.550186 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08039c98-d2a1-4896-832a-b7be6854297a None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:56.550452 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08039c98-d2a1-4896-832a-b7be6854297a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:56.555399 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b345cc82-972a-4e46-8568-bdaedf1d4c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:56.556056 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345cc82-972a-4e46-8568-bdaedf1d4c01 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:56.556339 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345cc82-972a-4e46-8568-bdaedf1d4c01 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:56.556611 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345cc82-972a-4e46-8568-bdaedf1d4c01 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:56.557326 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b345cc82-972a-4e46-8568-bdaedf1d4c01 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:56.557636 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b345cc82-972a-4e46-8568-bdaedf1d4c01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:56.559048 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b345cc82-972a-4e46-8568-bdaedf1d4c01 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:56.561086 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08039c98-d2a1-4896-832a-b7be6854297a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:08:56.563677 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 428/848] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jun 29 12:08:56 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:56.564462 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b345cc82-972a-4e46-8568-bdaedf1d4c01 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:56.568919 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-08039c98-d2a1-4896-832a-b7be6854297a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:08:56.568919 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:56.568919 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:56.568919 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:56.568919 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:56.568919 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:56.568919 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:56.568919 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:56.568919 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:56.568919 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:56.568919 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:56.568919 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:56.568919 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:08:56.568919 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:08:56.568919 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:08:56.568919 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:08:56.570063 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:08:56.570063 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:08:56.570063 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:08:56.570063 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:08:56.570063 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:56.570063 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:56.570063 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:56.570063 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:56.570063 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:56.570063 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:56.570063 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:56.570063 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:56.570063 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:56.570063 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:56.570063 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:56.570063 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:56.570931 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:56.570931 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:56.570931 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:56.570931 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:56.570931 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:08:56.570931 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:08:56.570931 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:08:56.570931 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:08:56.570931 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:08:56.570931 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:08:56.570931 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:08:56.570931 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:56.570931 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 421/849] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jun 29 12:08:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:56.571642 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08039c98-d2a1-4896-832a-b7be6854297a None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:56.598868 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:56.643968 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:56.685350 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b345cc82-972a-4e46-8568-bdaedf1d4c01 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:56.698545 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08039c98-d2a1-4896-832a-b7be6854297a None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:56.723876 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6173b81e-94eb-4f9a-b9d7-f89905a93954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:56.724542 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173b81e-94eb-4f9a-b9d7-f89905a93954 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:56.724825 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173b81e-94eb-4f9a-b9d7-f89905a93954 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:56.725104 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173b81e-94eb-4f9a-b9d7-f89905a93954 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:56.726571 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6173b81e-94eb-4f9a-b9d7-f89905a93954 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:56.727002 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6173b81e-94eb-4f9a-b9d7-f89905a93954 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:56.729357 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6173b81e-94eb-4f9a-b9d7-f89905a93954 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:56.739767 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084a6d1b-7615-4c2e-9cd5-56a1b985cd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:56.740474 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a6d1b-7615-4c2e-9cd5-56a1b985cd1f None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:56.740723 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a6d1b-7615-4c2e-9cd5-56a1b985cd1f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:56.741019 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a6d1b-7615-4c2e-9cd5-56a1b985cd1f None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:56.741804 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084a6d1b-7615-4c2e-9cd5-56a1b985cd1f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:56.742127 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084a6d1b-7615-4c2e-9cd5-56a1b985cd1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:56.745632 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 429/850] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:56.745831 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084a6d1b-7615-4c2e-9cd5-56a1b985cd1f None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:56.745916 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6173b81e-94eb-4f9a-b9d7-f89905a93954 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:56.750540 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 422/851] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Jun 29 12:08:56 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:56.750540 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084a6d1b-7615-4c2e-9cd5-56a1b985cd1f None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:56.844795 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:56.873644 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6173b81e-94eb-4f9a-b9d7-f89905a93954 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:56.881641 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084a6d1b-7615-4c2e-9cd5-56a1b985cd1f None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:56.901792 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:56.915256 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c6abf8-50f5-4222-9c82-435e7cca2416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:56.916216 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6abf8-50f5-4222-9c82-435e7cca2416 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:56.916547 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6abf8-50f5-4222-9c82-435e7cca2416 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:56.916917 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6abf8-50f5-4222-9c82-435e7cca2416 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:56.917905 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c6abf8-50f5-4222-9c82-435e7cca2416 None admin] RBAC: Adding query filter params (name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:56.918309 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c6abf8-50f5-4222-9c82-435e7cca2416 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:56.919797 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c6abf8-50f5-4222-9c82-435e7cca2416 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:56.923337 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c9f0e5-44b0-41a4-89b9-301c9db4b0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:56.924342 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9f0e5-44b0-41a4-89b9-301c9db4b0ca None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:56.924786 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9f0e5-44b0-41a4-89b9-301c9db4b0ca None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:56.925058 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9f0e5-44b0-41a4-89b9-301c9db4b0ca None admin] PATH_INFO: `/v3/users/swift` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:56.931309 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 430/852] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jun 29 12:08:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:56.935016 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c9f0e5-44b0-41a4-89b9-301c9db4b0ca None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:56.936486 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c9f0e5-44b0-41a4-89b9-301c9db4b0ca None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:56.936836 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c6abf8-50f5-4222-9c82-435e7cca2416 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:56.952304 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-39c9f0e5-44b0-41a4-89b9-301c9db4b0ca None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 29 12:08:56.952304 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:56.952304 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:56.952304 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:56.952304 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:56.952304 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:56.952304 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:56.952304 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:56.952304 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:56.952304 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:56.952304 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:56.952304 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:56.952304 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:08:56.952304 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:08:56.952304 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:08:56.952304 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:08:56.953316 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:56.953316 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:56.953316 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:08:56.953316 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:56.953316 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:08:56.953316 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:56.953316 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:56.953316 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:56.953316 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:56.953316 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:56.953316 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:56.953316 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:56.953316 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:56.953316 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:56.953316 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:56.953316 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:56.953316 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:56.953316 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:56.954430 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:56.954430 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:56.954430 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:08:56.954430 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:08:56.954430 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:08:56.954430 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:08:56.954430 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:08:56.954430 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:08:56.954430 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 29 12:08:56.954430 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:56.954430 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 423/853] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jun 29 12:08:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:56.960308 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c9f0e5-44b0-41a4-89b9-301c9db4b0ca None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:57.071340 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c9f0e5-44b0-41a4-89b9-301c9db4b0ca None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:57.084856 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c6abf8-50f5-4222-9c82-435e7cca2416 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:57.108211 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd26293-8b3e-40ae-96cb-4e56a86a2ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:57.109038 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd26293-8b3e-40ae-96cb-4e56a86a2ba0 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:57.109414 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd26293-8b3e-40ae-96cb-4e56a86a2ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:57.109826 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd26293-8b3e-40ae-96cb-4e56a86a2ba0 None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:57.110780 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd26293-8b3e-40ae-96cb-4e56a86a2ba0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:57.111191 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd26293-8b3e-40ae-96cb-4e56a86a2ba0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:57.112872 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd26293-8b3e-40ae-96cb-4e56a86a2ba0 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:57.131217 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125a1ae-f730-419c-a94a-c2565ad07916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:57.132447 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125a1ae-f730-419c-a94a-c2565ad07916 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:57.132870 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125a1ae-f730-419c-a94a-c2565ad07916 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:57.133319 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125a1ae-f730-419c-a94a-c2565ad07916 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:57.136858 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 424/854] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Jun 29 12:08:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:08:57.137925 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd26293-8b3e-40ae-96cb-4e56a86a2ba0 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:57.150636 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d125a1ae-f730-419c-a94a-c2565ad07916 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:57.152989 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d125a1ae-f730-419c-a94a-c2565ad07916 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:57.156835 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:57.176025 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:57.180569 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-d125a1ae-f730-419c-a94a-c2565ad07916 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:57.180569 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:57.180569 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:57.180569 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:57.180569 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:57.180569 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:57.180569 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:57.180569 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:57.180569 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:57.180569 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:57.180569 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:57.180569 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:57.180569 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:57.180569 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:57.180569 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:57.181654 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:57.181654 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:57.181654 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:57.181654 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:57.181654 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:57.181654 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:57.181654 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:57.181654 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:57.181654 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:57.181654 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:57.181654 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:57.181654 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:57.181654 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:57.181654 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:57.181654 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:57.181654 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:57.181654 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:57.182812 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:57.182812 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:57.182812 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:57.182812 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:57.185764 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 431/855] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:57.198332 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125a1ae-f730-419c-a94a-c2565ad07916 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:57.255999 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd26293-8b3e-40ae-96cb-4e56a86a2ba0 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:57.294216 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409a381-9dc0-464b-856e-7153a0dc6be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:57.294961 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409a381-9dc0-464b-856e-7153a0dc6be9 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:57.295244 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409a381-9dc0-464b-856e-7153a0dc6be9 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:57.295511 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409a381-9dc0-464b-856e-7153a0dc6be9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:57.314635 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125a1ae-f730-419c-a94a-c2565ad07916 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:57.350209 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea209a81-4f27-4456-a8a0-f591e4c7b156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:57.351083 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea209a81-4f27-4456-a8a0-f591e4c7b156 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:57.351427 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea209a81-4f27-4456-a8a0-f591e4c7b156 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:57.351767 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea209a81-4f27-4456-a8a0-f591e4c7b156 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:57.352585 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea209a81-4f27-4456-a8a0-f591e4c7b156 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:57.352964 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea209a81-4f27-4456-a8a0-f591e4c7b156 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:57.354453 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea209a81-4f27-4456-a8a0-f591e4c7b156 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:57.368866 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2409a381-9dc0-464b-856e-7153a0dc6be9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:57.370355 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2409a381-9dc0-464b-856e-7153a0dc6be9 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:57.371698 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 432/856] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:57.372929 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea209a81-4f27-4456-a8a0-f591e4c7b156 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:57.412703 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:57.445789 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:57.498717 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 425/857] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:08:57 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 12:08:57.505320 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409a381-9dc0-464b-856e-7153a0dc6be9 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:57.512157 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea209a81-4f27-4456-a8a0-f591e4c7b156 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:57.554916 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a88536b-8e68-4157-88b5-06da09ef32ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:57.555743 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88536b-8e68-4157-88b5-06da09ef32ca None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:57.556286 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88536b-8e68-4157-88b5-06da09ef32ca None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:57.556286 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88536b-8e68-4157-88b5-06da09ef32ca None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:57.564388 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a88536b-8e68-4157-88b5-06da09ef32ca None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:57.565823 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a88536b-8e68-4157-88b5-06da09ef32ca None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:57.583178 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-5a88536b-8e68-4157-88b5-06da09ef32ca None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 12:08:57.583178 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:57.583178 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:57.583178 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:57.583178 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:57.583178 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:57.583178 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:57.583178 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:57.583178 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:57.583178 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:57.583178 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:57.583178 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:57.583178 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:08:57.583178 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:08:57.583178 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:08:57.583178 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:08:57.584207 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:57.584207 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:57.584207 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:08:57.584207 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:57.584207 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:08:57.584207 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:08:57.584207 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:57.584207 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:57.584207 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:57.584207 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:57.584207 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:57.584207 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:57.584207 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:57.584207 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:57.584207 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:57.584207 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:57.584207 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:57.584207 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:57.585298 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:57.585298 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:57.585298 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:08:57.585298 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:08:57.585298 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:08:57.585298 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:08:57.585298 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:08:57.585298 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:08:57.585298 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 12:08:57.585298 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:57.589464 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 433/858] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Jun 29 12:08:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:08:57.590472 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a88536b-8e68-4157-88b5-06da09ef32ca None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:57.636641 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409a381-9dc0-464b-856e-7153a0dc6be9 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:57.684996 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f4489-6f06-4d92-a8b6-980f7bf4cc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:57.686401 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f4489-6f06-4d92-a8b6-980f7bf4cc0a None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:57.687278 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f4489-6f06-4d92-a8b6-980f7bf4cc0a None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:57.687810 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f4489-6f06-4d92-a8b6-980f7bf4cc0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:57.692049 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:57.704274 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f4489-6f06-4d92-a8b6-980f7bf4cc0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:57.705790 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f4489-6f06-4d92-a8b6-980f7bf4cc0a None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:57.713979 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a88536b-8e68-4157-88b5-06da09ef32ca None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:57.725814 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-e38f4489-6f06-4d92-a8b6-980f7bf4cc0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:57.725814 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:57.725814 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:57.725814 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:57.725814 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:57.725814 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:57.725814 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:57.725814 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:57.725814 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:57.725814 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:57.725814 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:57.725814 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:57.725814 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:57.725814 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:57.725814 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:57.726942 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:57.726942 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:57.726942 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:57.726942 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:57.726942 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:57.726942 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:57.726942 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:57.726942 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:57.726942 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:57.726942 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:57.726942 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:57.726942 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:57.726942 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:57.726942 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:57.726942 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:57.726942 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:57.726942 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:57.727863 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:57.727863 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:57.727863 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:57.727863 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:57.732403 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 426/859] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:57.733274 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f4489-6f06-4d92-a8b6-980f7bf4cc0a None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:57.738274 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:57.761773 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c5d91-869c-4227-8eae-a9abf650ae0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:57.763040 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c5d91-869c-4227-8eae-a9abf650ae0c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:57.763823 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c5d91-869c-4227-8eae-a9abf650ae0c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:57.764545 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c5d91-869c-4227-8eae-a9abf650ae0c None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:57.765760 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8c5d91-869c-4227-8eae-a9abf650ae0c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:57.766284 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8c5d91-869c-4227-8eae-a9abf650ae0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:57.769346 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8c5d91-869c-4227-8eae-a9abf650ae0c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:57.793943 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 434/860] 10.222.0.27 () {56 vars in 1149 bytes} [Wed Jun 29 12:08:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:08:57.800647 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c5d91-869c-4227-8eae-a9abf650ae0c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:57.854035 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f4489-6f06-4d92-a8b6-980f7bf4cc0a None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:57.891174 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f8a2e-7d80-4705-89ed-d4d454de805d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:57.891893 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f8a2e-7d80-4705-89ed-d4d454de805d None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:57.892173 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f8a2e-7d80-4705-89ed-d4d454de805d None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:57.892442 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f8a2e-7d80-4705-89ed-d4d454de805d None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:57.893169 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8f8a2e-7d80-4705-89ed-d4d454de805d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:57.893570 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8f8a2e-7d80-4705-89ed-d4d454de805d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:57.895004 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8f8a2e-7d80-4705-89ed-d4d454de805d None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:57.914734 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 427/861] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:57.915732 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f8a2e-7d80-4705-89ed-d4d454de805d None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:57.928031 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c5d91-869c-4227-8eae-a9abf650ae0c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:57.969211 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:57.971933 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c1f7e-b193-4f1c-a008-20ef946f04e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:57.972834 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c1f7e-b193-4f1c-a008-20ef946f04e7 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:57.973336 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c1f7e-b193-4f1c-a008-20ef946f04e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:57.974276 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c1f7e-b193-4f1c-a008-20ef946f04e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:58.032243 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f8a2e-7d80-4705-89ed-d4d454de805d None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:58.037114 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:58.074469 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c1f7e-b193-4f1c-a008-20ef946f04e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:58.076131 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c1f7e-b193-4f1c-a008-20ef946f04e7 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:58.091141 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e9565-e0e5-438d-9e1a-53bdf3a7a525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:58.092415 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e9565-e0e5-438d-9e1a-53bdf3a7a525 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:58.092918 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e9565-e0e5-438d-9e1a-53bdf3a7a525 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:58.093382 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e9565-e0e5-438d-9e1a-53bdf3a7a525 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:58.101942 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e9565-e0e5-438d-9e1a-53bdf3a7a525 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:58.103677 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e9565-e0e5-438d-9e1a-53bdf3a7a525 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:58.118854 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-999e9565-e0e5-438d-9e1a-53bdf3a7a525 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:58.118854 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:58.118854 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:58.118854 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:58.118854 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:58.118854 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:58.118854 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:58.118854 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:58.118854 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:58.118854 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:58.118854 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:58.118854 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:58.118854 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:08:58.118854 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:08:58.118854 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:08:58.119794 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:08:58.119794 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:58.119794 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:58.119794 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:58.119794 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:58.119794 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:58.119794 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:58.119794 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:58.119794 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:58.119794 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:58.119794 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:58.119794 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:58.119794 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:58.119794 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:58.119794 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:58.119794 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:58.119794 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:58.120698 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:08:58.120698 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:08:58.120698 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:08:58.120698 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:08:58.120698 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:08:58.120698 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:08:58.120698 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:58.120698 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:58.127747 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 428/862] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jun 29 12:08:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:58.128844 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e9565-e0e5-438d-9e1a-53bdf3a7a525 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:58.192345 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 435/863] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:08:57 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 12:08:58.199547 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c1f7e-b193-4f1c-a008-20ef946f04e7 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:58.266327 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e9565-e0e5-438d-9e1a-53bdf3a7a525 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:58.276767 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:58.286982 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:58.306358 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2edf090-c42c-490b-93ff-e8164eb6ae7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:58.307450 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2edf090-c42c-490b-93ff-e8164eb6ae7f None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:58.308011 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2edf090-c42c-490b-93ff-e8164eb6ae7f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:58.308474 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2edf090-c42c-490b-93ff-e8164eb6ae7f None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:58.309555 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2edf090-c42c-490b-93ff-e8164eb6ae7f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:58.310085 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2edf090-c42c-490b-93ff-e8164eb6ae7f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:58.311899 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2edf090-c42c-490b-93ff-e8164eb6ae7f None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:58.318101 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c1f7e-b193-4f1c-a008-20ef946f04e7 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:58.332183 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 429/864] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jun 29 12:08:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:58.333577 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2edf090-c42c-490b-93ff-e8164eb6ae7f None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:58.359471 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540dcfe5-f7d2-446c-b3bf-5117c54869b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:58.360420 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540dcfe5-f7d2-446c-b3bf-5117c54869b0 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:58.360748 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540dcfe5-f7d2-446c-b3bf-5117c54869b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:58.360992 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540dcfe5-f7d2-446c-b3bf-5117c54869b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:58.375807 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540dcfe5-f7d2-446c-b3bf-5117c54869b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:58.377286 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540dcfe5-f7d2-446c-b3bf-5117c54869b0 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:58.398979 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-540dcfe5-f7d2-446c-b3bf-5117c54869b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:58.398979 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:58.398979 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:58.398979 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:58.398979 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:58.398979 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:58.398979 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:58.398979 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:58.398979 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:58.398979 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:58.398979 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:58.398979 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:58.398979 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:08:58.398979 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:08:58.398979 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:08:58.399970 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:08:58.399970 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:58.399970 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:58.399970 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:58.399970 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:58.399970 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:58.399970 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:58.399970 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:58.399970 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:58.399970 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:58.399970 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:58.399970 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:58.399970 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:58.399970 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:58.399970 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:58.399970 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:58.399970 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:58.400858 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:08:58.400858 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:08:58.400858 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:08:58.400858 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:08:58.405251 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 436/865] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:08:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:08:58.406869 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540dcfe5-f7d2-446c-b3bf-5117c54869b0 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:58.454812 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2edf090-c42c-490b-93ff-e8164eb6ae7f None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:58.494302 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5a333-2925-49f3-82d0-ff8acc7aa4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:58.495401 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5a333-2925-49f3-82d0-ff8acc7aa4e8 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:58.495891 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5a333-2925-49f3-82d0-ff8acc7aa4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:58.496360 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5a333-2925-49f3-82d0-ff8acc7aa4e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:58.497391 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d5a333-2925-49f3-82d0-ff8acc7aa4e8 None admin] RBAC: Adding query filter params (role.id=e0e69ac8a8bf4cc4baa6aa18f2fc9919, scope.project.id=996db30845f84e57865fa40b9a730a05, user.id=cc92f8232bda407c84365eb10ede737f) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:58.498086 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d5a333-2925-49f3-82d0-ff8acc7aa4e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:58.499808 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d5a333-2925-49f3-82d0-ff8acc7aa4e8 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:58.514509 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 430/866] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jun 29 12:08:58 2022] GET /identity/v3/role_assignments?user.id=cc92f8232bda407c84365eb10ede737f&scope.project.id=996db30845f84e57865fa40b9a730a05&role.id=e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:58.528228 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540dcfe5-f7d2-446c-b3bf-5117c54869b0 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:58.557669 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:58.566683 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067936da-1b19-413c-a3c0-4cd07af4a335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:58.567373 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067936da-1b19-413c-a3c0-4cd07af4a335 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:58.567725 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067936da-1b19-413c-a3c0-4cd07af4a335 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:58.568035 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067936da-1b19-413c-a3c0-4cd07af4a335 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:58.568686 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067936da-1b19-413c-a3c0-4cd07af4a335 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:58.569438 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067936da-1b19-413c-a3c0-4cd07af4a335 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:58.571421 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067936da-1b19-413c-a3c0-4cd07af4a335 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:58.590999 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 437/867] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:08:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:58.592439 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5a333-2925-49f3-82d0-ff8acc7aa4e8 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:58.630228 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:58.644138 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb876c-0bbd-4ec2-9838-2cbfe7a6dcd7 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:58.644490 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb876c-0bbd-4ec2-9838-2cbfe7a6dcd7 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:58.644692 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb876c-0bbd-4ec2-9838-2cbfe7a6dcd7 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:58.646542 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 438/868] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:08:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:08:58.652400 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e3de7-0d87-48aa-a40d-c943c5d8a0e1 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:58.652714 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e3de7-0d87-48aa-a40d-c943c5d8a0e1 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:58.652970 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e3de7-0d87-48aa-a40d-c943c5d8a0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:58.671143 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-798e3de7-0d87-48aa-a40d-c943c5d8a0e1 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:58.672420 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-798e3de7-0d87-48aa-a40d-c943c5d8a0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:58.715451 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5a333-2925-49f3-82d0-ff8acc7aa4e8 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:58.756908 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 439/869] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:58 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 12:08:58.760476 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f72dfa5-8406-4f27-b92b-8dfbe6bacca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:58.761291 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72dfa5-8406-4f27-b92b-8dfbe6bacca4 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:58.761574 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72dfa5-8406-4f27-b92b-8dfbe6bacca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:58.761919 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72dfa5-8406-4f27-b92b-8dfbe6bacca4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:58.772572 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f72dfa5-8406-4f27-b92b-8dfbe6bacca4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:58.774236 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f72dfa5-8406-4f27-b92b-8dfbe6bacca4 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:58.782087 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798e3de7-0d87-48aa-a40d-c943c5d8a0e1 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:58.790577 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-4f72dfa5-8406-4f27-b92b-8dfbe6bacca4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:58.790577 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:08:58.790577 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:08:58.790577 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:08:58.790577 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:08:58.790577 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:08:58.790577 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:08:58.790577 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:08:58.790577 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:08:58.790577 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:08:58.790577 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:08:58.790577 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:08:58.790577 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:08:58.790577 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:08:58.790577 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:08:58.791502 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:08:58.791502 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:08:58.791502 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:08:58.791502 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:08:58.791502 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:08:58.791502 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:08:58.791502 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:08:58.791502 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:08:58.791502 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:08:58.791502 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:08:58.791502 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:08:58.791502 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:08:58.791502 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:08:58.791502 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:08:58.791502 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:08:58.791502 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:08:58.791502 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:08:58.792410 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:08:58.792410 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:08:58.792410 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:08:58.792410 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:08:58.792410 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:08:58.792410 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:08:58.792410 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:08:58.792410 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:08:58.797142 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 431/870] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jun 29 12:08:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:08:58.799575 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f72dfa5-8406-4f27-b92b-8dfbe6bacca4 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:58.901703 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:58.911185 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798e3de7-0d87-48aa-a40d-c943c5d8a0e1 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:58.911352 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f72dfa5-8406-4f27-b92b-8dfbe6bacca4 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:58.929236 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:58.947798 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9016aa-a2f6-49df-aec8-aab76a81067a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:58.948467 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9016aa-a2f6-49df-aec8-aab76a81067a None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:58.948840 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9016aa-a2f6-49df-aec8-aab76a81067a None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:58.949115 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9016aa-a2f6-49df-aec8-aab76a81067a None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:58.949350 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64cc5d-376f-4ed8-8e0c-fb86297f681e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:58.949936 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9016aa-a2f6-49df-aec8-aab76a81067a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:58.950037 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64cc5d-376f-4ed8-8e0c-fb86297f681e None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:58.950245 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9016aa-a2f6-49df-aec8-aab76a81067a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:58.950340 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64cc5d-376f-4ed8-8e0c-fb86297f681e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:58.950580 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64cc5d-376f-4ed8-8e0c-fb86297f681e None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:58.951319 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b64cc5d-376f-4ed8-8e0c-fb86297f681e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:58.951689 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9016aa-a2f6-49df-aec8-aab76a81067a None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:58.953038 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b64cc5d-376f-4ed8-8e0c-fb86297f681e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:58.965344 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 432/871] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jun 29 12:08:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:58.966512 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac0a511-1321-4d7d-99b9-2ae8389132d2 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:58.966813 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac0a511-1321-4d7d-99b9-2ae8389132d2 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:58.967077 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac0a511-1321-4d7d-99b9-2ae8389132d2 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:58.968444 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 433/872] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:08:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:08:58.972919 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac0a511-1321-4d7d-99b9-2ae8389132d2 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:58.973405 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 440/873] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Jun 29 12:08:58 2022] POST /identity/v3/services => generated 251 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:08:58.978016 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02792891-d204-4dac-91b0-1becf8cb2e37 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:58.978016 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02792891-d204-4dac-91b0-1becf8cb2e37 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:58.978016 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02792891-d204-4dac-91b0-1becf8cb2e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:58.995140 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-02792891-d204-4dac-91b0-1becf8cb2e37 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:08:58.996553 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-02792891-d204-4dac-91b0-1becf8cb2e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:08:59.098455 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 441/874] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:08:58 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:08:59.116471 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac0a511-1321-4d7d-99b9-2ae8389132d2 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:59.123392 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02792891-d204-4dac-91b0-1becf8cb2e37 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:08:59.168820 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf1cd85-ebd7-470d-9cc8-4b459326739b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:59.169496 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf1cd85-ebd7-470d-9cc8-4b459326739b None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:59.170361 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf1cd85-ebd7-470d-9cc8-4b459326739b None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:59.170361 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf1cd85-ebd7-470d-9cc8-4b459326739b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:59.170969 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf1cd85-ebd7-470d-9cc8-4b459326739b None admin] RBAC: Adding query filter params (role.id=6f63a9619c7b40ebb5b73bde026d606b, scope.project.id=996db30845f84e57865fa40b9a730a05, user.id=cad33601754a462c828566fb54c6e100) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:08:59.171285 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf1cd85-ebd7-470d-9cc8-4b459326739b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:59.173230 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf1cd85-ebd7-470d-9cc8-4b459326739b None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:59.181473 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 434/875] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jun 29 12:08:58 2022] GET /identity/v3/role_assignments?user.id=cad33601754a462c828566fb54c6e100&scope.project.id=996db30845f84e57865fa40b9a730a05&role.id=6f63a9619c7b40ebb5b73bde026d606b => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:08:59.251412 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02792891-d204-4dac-91b0-1becf8cb2e37 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:08:59.253166 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:08:59.291609 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af89f8ab-a527-49e9-8bb0-a5b4150273b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:08:59.292620 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89f8ab-a527-49e9-8bb0-a5b4150273b1 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:08:59.292901 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89f8ab-a527-49e9-8bb0-a5b4150273b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:08:59.293175 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89f8ab-a527-49e9-8bb0-a5b4150273b1 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:08:59.293964 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af89f8ab-a527-49e9-8bb0-a5b4150273b1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:08:59.295376 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af89f8ab-a527-49e9-8bb0-a5b4150273b1 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:08:59.314878 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 442/876] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Jun 29 12:08:59 2022] POST /identity/v3/services => generated 269 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:09:00.638863 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e48499-81ef-4a9a-890e-ca9b7cb19dc3 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:00.639422 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e48499-81ef-4a9a-890e-ca9b7cb19dc3 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:00.639422 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e48499-81ef-4a9a-890e-ca9b7cb19dc3 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:00.641012 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 435/877] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:09:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:09:00.646378 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a3041-af48-4ce4-b4eb-587727aabe48 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:00.646757 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a3041-af48-4ce4-b4eb-587727aabe48 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:00.646936 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a3041-af48-4ce4-b4eb-587727aabe48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:00.663901 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-ee5a3041-af48-4ce4-b4eb-587727aabe48 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:09:00.665087 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ee5a3041-af48-4ce4-b4eb-587727aabe48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:09:00.741013 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 443/878] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:09:00 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:09:00.763292 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e48499-81ef-4a9a-890e-ca9b7cb19dc3 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:00.784053 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:00.884060 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e48499-81ef-4a9a-890e-ca9b7cb19dc3 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:00.919844 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad7b38-d07f-42ba-b732-a360bb066736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:00.920590 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad7b38-d07f-42ba-b732-a360bb066736 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:00.920858 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad7b38-d07f-42ba-b732-a360bb066736 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:00.921125 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad7b38-d07f-42ba-b732-a360bb066736 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:00.921813 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ad7b38-d07f-42ba-b732-a360bb066736 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:00.923193 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ad7b38-d07f-42ba-b732-a360bb066736 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:00.935844 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-88ad7b38-d07f-42ba-b732-a360bb066736 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 12:09:00.935844 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:00.935844 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 12:09:00.935844 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 12:09:00.935844 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 12:09:00.935844 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 12:09:00.935844 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 12:09:00.935844 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:09:00.935844 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 12:09:00.935844 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:09:00.935844 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 12:09:00.935844 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:09:00.935844 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:00.935844 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:00.935844 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:00.935844 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:00.935844 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:00.936854 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:00.936854 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:00.936854 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:00.936854 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:00.936854 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:00.936854 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:00.936854 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 12:09:00.936854 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 12:09:00.936854 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 12:09:00.936854 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 12:09:00.936854 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:00.936854 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:00.936854 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:09:00.936854 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:09:00.936854 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:09:00.936854 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:09:00.937730 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:09:00.937730 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:09:00.937730 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:09:00.937730 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:09:00.937730 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:09:00.937730 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:09:00.937730 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:09:00.937730 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:09:00.937730 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:09:00.937730 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:09:00.937730 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 12:09:00.937730 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:09:00.937730 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 12:09:00.937730 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:09:00.937730 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 436/879] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Jun 29 12:09:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:09:00.943362 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a3041-af48-4ce4-b4eb-587727aabe48 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:01.033462 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:01.045907 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a3041-af48-4ce4-b4eb-587727aabe48 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:01.087248 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04490f9e-c4de-4691-897f-a29b428052e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:01.087932 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04490f9e-c4de-4691-897f-a29b428052e3 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:01.088212 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04490f9e-c4de-4691-897f-a29b428052e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:01.088487 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04490f9e-c4de-4691-897f-a29b428052e3 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:01.089207 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04490f9e-c4de-4691-897f-a29b428052e3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:01.089513 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04490f9e-c4de-4691-897f-a29b428052e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:01.090931 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04490f9e-c4de-4691-897f-a29b428052e3 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:01.096218 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 444/880] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Jun 29 12:09:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:01.102060 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad7b38-d07f-42ba-b732-a360bb066736 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:01.171390 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f16f87-0d24-4258-84ea-ba3621479414 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:01.171662 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f16f87-0d24-4258-84ea-ba3621479414 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:01.171859 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f16f87-0d24-4258-84ea-ba3621479414 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:01.173250 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 445/881] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:09:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:09:01.178290 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f4541-00fc-4aa7-8f98-98e4fb4cb841 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:01.178572 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f4541-00fc-4aa7-8f98-98e4fb4cb841 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:01.178928 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f4541-00fc-4aa7-8f98-98e4fb4cb841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:01.198711 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f40f4541-00fc-4aa7-8f98-98e4fb4cb841 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:09:01.199998 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f40f4541-00fc-4aa7-8f98-98e4fb4cb841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:09:01.205243 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:01.231773 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad7b38-d07f-42ba-b732-a360bb066736 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:01.268548 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df32740-77e5-436e-bcd6-cc630cac3a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:01.269718 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df32740-77e5-436e-bcd6-cc630cac3a61 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:01.270253 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df32740-77e5-436e-bcd6-cc630cac3a61 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:01.270774 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df32740-77e5-436e-bcd6-cc630cac3a61 None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:01.271696 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df32740-77e5-436e-bcd6-cc630cac3a61 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:01.272199 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df32740-77e5-436e-bcd6-cc630cac3a61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:01.274199 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df32740-77e5-436e-bcd6-cc630cac3a61 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:01.279856 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 437/882] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Jun 29 12:09:01 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:01.281590 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 446/883] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:09:01 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 12:09:01.307190 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df32740-77e5-436e-bcd6-cc630cac3a61 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:01.388751 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e3598-32a4-4af5-addc-e8eb62cf2326 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:01.389090 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e3598-32a4-4af5-addc-e8eb62cf2326 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:01.389512 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e3598-32a4-4af5-addc-e8eb62cf2326 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:01.391006 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 447/884] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:09:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:09:01.399811 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b38aed-481d-4ee3-85af-349ced8af091 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:01.400246 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b38aed-481d-4ee3-85af-349ced8af091 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:01.400628 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b38aed-481d-4ee3-85af-349ced8af091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:01.420545 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f7b38aed-481d-4ee3-85af-349ced8af091 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:09:01.421977 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f7b38aed-481d-4ee3-85af-349ced8af091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:09:01.430754 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df32740-77e5-436e-bcd6-cc630cac3a61 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:01.469711 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d6460-a5a6-46f1-b39d-25f69d82edc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:01.470798 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d6460-a5a6-46f1-b39d-25f69d82edc8 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:01.471225 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d6460-a5a6-46f1-b39d-25f69d82edc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:01.471770 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d6460-a5a6-46f1-b39d-25f69d82edc8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:01.472436 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7d6460-a5a6-46f1-b39d-25f69d82edc8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:01.474013 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7d6460-a5a6-46f1-b39d-25f69d82edc8 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:01.488575 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-9e7d6460-a5a6-46f1-b39d-25f69d82edc8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 12:09:01.488575 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:01.488575 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 12:09:01.488575 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 12:09:01.488575 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 12:09:01.488575 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 12:09:01.488575 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 12:09:01.488575 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:09:01.488575 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 12:09:01.488575 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:09:01.488575 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 12:09:01.488575 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:09:01.488575 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:01.488575 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:01.488575 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:01.488575 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:01.488575 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:01.489880 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:01.489880 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:01.489880 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:01.489880 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:01.489880 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:01.489880 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:01.489880 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 12:09:01.489880 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 12:09:01.489880 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 12:09:01.489880 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 12:09:01.489880 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:01.489880 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:01.489880 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:09:01.489880 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:09:01.489880 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:09:01.489880 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:09:01.490948 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:09:01.490948 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:09:01.490948 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:09:01.490948 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:09:01.490948 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:09:01.490948 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:09:01.490948 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:09:01.490948 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:09:01.490948 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:09:01.490948 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:09:01.490948 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 12:09:01.490948 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:09:01.490948 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 12:09:01.490948 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:09:01.490948 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 438/885] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jun 29 12:09:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:09:01.492319 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1becd352-8255-4b74-9af8-7bed58a698b0 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:01.492319 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1becd352-8255-4b74-9af8-7bed58a698b0 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:01.492319 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1becd352-8255-4b74-9af8-7bed58a698b0 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:01.497000 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 439/886] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:09:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:09:01.498039 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1becd352-8255-4b74-9af8-7bed58a698b0 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:01.511227 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:01.521838 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 448/887] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:09:01 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 12:09:01.523789 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86fef7-a2f2-4d12-b484-b7a9feef128f None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:01.524082 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86fef7-a2f2-4d12-b484-b7a9feef128f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:01.524359 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86fef7-a2f2-4d12-b484-b7a9feef128f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:01.551053 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-5a86fef7-a2f2-4d12-b484-b7a9feef128f None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:09:01.553275 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5a86fef7-a2f2-4d12-b484-b7a9feef128f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:09:01.564415 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:01.616558 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1becd352-8255-4b74-9af8-7bed58a698b0 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:01.643418 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 449/888] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:09:01 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:09:01.644297 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86fef7-a2f2-4d12-b484-b7a9feef128f None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:01.661964 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4039d118-1092-41ee-ac92-a692e92c52f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:01.663406 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039d118-1092-41ee-ac92-a692e92c52f4 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:01.663866 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039d118-1092-41ee-ac92-a692e92c52f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:01.664303 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039d118-1092-41ee-ac92-a692e92c52f4 None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:01.665435 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4039d118-1092-41ee-ac92-a692e92c52f4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:01.666389 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4039d118-1092-41ee-ac92-a692e92c52f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:01.667979 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4039d118-1092-41ee-ac92-a692e92c52f4 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:01.674180 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 440/889] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jun 29 12:09:01 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:09:01.679907 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4039d118-1092-41ee-ac92-a692e92c52f4 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:01.755766 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86fef7-a2f2-4d12-b484-b7a9feef128f None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:01.759368 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:01.791995 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb411ab-698e-475c-bff7-4e02191971ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:01.792416 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4039d118-1092-41ee-ac92-a692e92c52f4 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:01.792822 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb411ab-698e-475c-bff7-4e02191971ab None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:01.793105 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb411ab-698e-475c-bff7-4e02191971ab None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:01.793377 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb411ab-698e-475c-bff7-4e02191971ab None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:01.794074 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb411ab-698e-475c-bff7-4e02191971ab None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:01.795456 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb411ab-698e-475c-bff7-4e02191971ab None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:01.808001 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-5fb411ab-698e-475c-bff7-4e02191971ab None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 12:09:01.808001 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:01.808001 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 12:09:01.808001 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 12:09:01.808001 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 12:09:01.808001 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 12:09:01.808001 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 12:09:01.808001 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:09:01.808001 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 12:09:01.808001 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:09:01.808001 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 12:09:01.808001 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:09:01.808001 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:01.808001 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:01.808001 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:01.808001 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:01.809004 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:01.809004 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:01.809004 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:01.809004 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:01.809004 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:01.809004 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:01.809004 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:01.809004 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 12:09:01.809004 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 12:09:01.809004 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 12:09:01.809004 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 12:09:01.809004 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:01.809004 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:01.809004 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:09:01.809004 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:09:01.809004 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:09:01.809910 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:09:01.809910 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:09:01.809910 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:09:01.809910 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:09:01.809910 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:09:01.809910 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:09:01.809910 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:09:01.809910 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:09:01.809910 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:09:01.809910 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:09:01.809910 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:09:01.809910 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 12:09:01.809910 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:09:01.809910 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 12:09:01.809910 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:09:01.809910 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 450/890] 10.222.0.27 () {56 vars in 1132 bytes} [Wed Jun 29 12:09:01 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:09:01.810774 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb411ab-698e-475c-bff7-4e02191971ab None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:01.821869 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:01.835551 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a82ec3-24f8-432e-a058-0cad7d363f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:01.836377 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a82ec3-24f8-432e-a058-0cad7d363f80 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:01.836654 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a82ec3-24f8-432e-a058-0cad7d363f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:01.836978 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a82ec3-24f8-432e-a058-0cad7d363f80 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:01.847570 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a82ec3-24f8-432e-a058-0cad7d363f80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:09:01.855738 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-d6a82ec3-24f8-432e-a058-0cad7d363f80 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 12:09:01.855738 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:01.855738 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:01.855738 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:01.855738 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:01.855738 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:01.855738 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:01.855738 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:01.855738 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:01.855738 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:01.855738 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:01.855738 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:01.855738 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:09:01.855738 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:09:01.855738 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:09:01.855738 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:09:01.856728 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:09:01.856728 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:09:01.856728 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:09:01.856728 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:09:01.856728 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:01.856728 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:01.856728 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:09:01.856728 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:09:01.856728 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:09:01.856728 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:09:01.856728 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:09:01.856728 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:09:01.856728 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:09:01.856728 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:09:01.856728 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:09:01.856728 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:09:01.857627 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:09:01.857627 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:09:01.857627 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:09:01.857627 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:09:01.857627 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:09:01.857627 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:09:01.857627 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:09:01.857627 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:09:01.857627 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:09:01.857627 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:09:01.857627 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 12:09:01.857627 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:09:01.857627 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 441/891] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Jun 29 12:09:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:09:01.858383 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a82ec3-24f8-432e-a058-0cad7d363f80 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:01.944765 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb411ab-698e-475c-bff7-4e02191971ab None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:01.971432 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a82ec3-24f8-432e-a058-0cad7d363f80 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:01.982239 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8608450-5503-42c3-b71c-99f0b09a72db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:01.982815 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8608450-5503-42c3-b71c-99f0b09a72db None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:01.983100 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8608450-5503-42c3-b71c-99f0b09a72db None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:01.983423 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8608450-5503-42c3-b71c-99f0b09a72db None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:01.984090 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8608450-5503-42c3-b71c-99f0b09a72db None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:01.984399 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8608450-5503-42c3-b71c-99f0b09a72db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:01.985802 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8608450-5503-42c3-b71c-99f0b09a72db None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:01.995816 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 451/892] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jun 29 12:09:01 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:01.995816 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8608450-5503-42c3-b71c-99f0b09a72db None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:02.008103 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:02.014562 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c29d584-aeea-495a-af17-feaa2012b9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:02.015238 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29d584-aeea-495a-af17-feaa2012b9d0 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:02.015518 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29d584-aeea-495a-af17-feaa2012b9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:02.015796 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29d584-aeea-495a-af17-feaa2012b9d0 None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:02.016506 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c29d584-aeea-495a-af17-feaa2012b9d0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:02.016811 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c29d584-aeea-495a-af17-feaa2012b9d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:02.018223 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c29d584-aeea-495a-af17-feaa2012b9d0 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:02.023163 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 442/893] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Jun 29 12:09:01 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:02.023961 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c29d584-aeea-495a-af17-feaa2012b9d0 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:02.082771 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:02.116802 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8608450-5503-42c3-b71c-99f0b09a72db None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:02.130327 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c29d584-aeea-495a-af17-feaa2012b9d0 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:02.153049 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca0e8f4-24df-497b-b0b9-d9d6c4dd353a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:02.153854 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0e8f4-24df-497b-b0b9-d9d6c4dd353a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:02.154135 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0e8f4-24df-497b-b0b9-d9d6c4dd353a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:02.154411 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0e8f4-24df-497b-b0b9-d9d6c4dd353a None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:02.155161 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca0e8f4-24df-497b-b0b9-d9d6c4dd353a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:02.155468 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca0e8f4-24df-497b-b0b9-d9d6c4dd353a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:02.157102 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca0e8f4-24df-497b-b0b9-d9d6c4dd353a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:02.164316 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05777f38-4d94-454c-8d20-e24f4a331b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:02.164984 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05777f38-4d94-454c-8d20-e24f4a331b3f None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:02.165268 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05777f38-4d94-454c-8d20-e24f4a331b3f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:02.165543 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05777f38-4d94-454c-8d20-e24f4a331b3f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:02.170779 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 452/894] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Jun 29 12:09:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:02.170928 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05777f38-4d94-454c-8d20-e24f4a331b3f None admin] RBAC: Adding query filter params (interface=public, service_id=8f98e01bd0fc4d68be3e2ec630439fac, region_id=RegionOne) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:02.170928 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05777f38-4d94-454c-8d20-e24f4a331b3f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:02.171081 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca0e8f4-24df-497b-b0b9-d9d6c4dd353a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:02.171153 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05777f38-4d94-454c-8d20-e24f4a331b3f None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:02.178620 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 443/895] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Jun 29 12:09:02 2022] GET /identity/v3/endpoints?service_id=8f98e01bd0fc4d68be3e2ec630439fac&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:02.179462 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05777f38-4d94-454c-8d20-e24f4a331b3f None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:02.247694 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:02.278810 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca0e8f4-24df-497b-b0b9-d9d6c4dd353a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:02.291977 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05777f38-4d94-454c-8d20-e24f4a331b3f None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:02.315124 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:02.322379 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee80438-d7e4-4f7a-8f84-f5744deec374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:02.323214 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee80438-d7e4-4f7a-8f84-f5744deec374 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:02.323798 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee80438-d7e4-4f7a-8f84-f5744deec374 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:02.324087 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee80438-d7e4-4f7a-8f84-f5744deec374 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:02.324960 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee80438-d7e4-4f7a-8f84-f5744deec374 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:02.325255 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee80438-d7e4-4f7a-8f84-f5744deec374 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:02.326662 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee80438-d7e4-4f7a-8f84-f5744deec374 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:02.328877 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d471ca-663e-48d9-8ff0-9ce004513651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:02.330016 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d471ca-663e-48d9-8ff0-9ce004513651 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:02.330392 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d471ca-663e-48d9-8ff0-9ce004513651 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:02.330579 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d471ca-663e-48d9-8ff0-9ce004513651 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:02.337476 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 453/896] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Jun 29 12:09:02 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:02.337476 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee80438-d7e4-4f7a-8f84-f5744deec374 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:02.346895 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d471ca-663e-48d9-8ff0-9ce004513651 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:02.348359 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d471ca-663e-48d9-8ff0-9ce004513651 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:02.365902 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-b3d471ca-663e-48d9-8ff0-9ce004513651 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:09:02.365902 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:02.365902 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:02.365902 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:02.365902 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:02.365902 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:02.365902 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:02.365902 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:02.365902 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:02.365902 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:02.365902 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:02.365902 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:02.365902 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:09:02.365902 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:09:02.365902 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:09:02.367039 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:09:02.367039 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:02.367039 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:02.367039 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:09:02.367039 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:09:02.367039 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:09:02.367039 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:09:02.367039 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:09:02.367039 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:09:02.367039 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:09:02.367039 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:09:02.367039 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:09:02.367039 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:09:02.367039 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:09:02.367039 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:09:02.367039 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:09:02.367039 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:09:02.368170 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:09:02.368170 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:09:02.368170 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:09:02.368170 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:09:02.371897 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 444/897] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:09:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:09:02.372779 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d471ca-663e-48d9-8ff0-9ce004513651 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:02.447739 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee80438-d7e4-4f7a-8f84-f5744deec374 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:02.481864 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7580d5-d1b2-498e-b8ec-8ac771074713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:02.482530 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7580d5-d1b2-498e-b8ec-8ac771074713 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:02.482812 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7580d5-d1b2-498e-b8ec-8ac771074713 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:02.483064 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7580d5-d1b2-498e-b8ec-8ac771074713 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:02.483296 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d471ca-663e-48d9-8ff0-9ce004513651 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:02.483765 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7580d5-d1b2-498e-b8ec-8ac771074713 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:02.485143 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7580d5-d1b2-498e-b8ec-8ac771074713 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:02.502081 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 454/898] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Jun 29 12:09:02 2022] GET /identity/v3/services => generated 1268 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:09:02.502081 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7580d5-d1b2-498e-b8ec-8ac771074713 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:02.508003 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:02.535359 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63773cba-cd74-4fc6-948f-4948a1f2e520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:02.536048 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63773cba-cd74-4fc6-948f-4948a1f2e520 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:02.536329 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63773cba-cd74-4fc6-948f-4948a1f2e520 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:02.536600 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63773cba-cd74-4fc6-948f-4948a1f2e520 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:02.537426 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63773cba-cd74-4fc6-948f-4948a1f2e520 None admin] RBAC: Adding query filter params (interface=public, service_id=2fd461c68ce341319d651c6f3804a774, region_id=RegionOne) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:02.537764 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63773cba-cd74-4fc6-948f-4948a1f2e520 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:02.539456 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63773cba-cd74-4fc6-948f-4948a1f2e520 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:02.548068 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 445/899] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Jun 29 12:09:02 2022] GET /identity/v3/endpoints?service_id=2fd461c68ce341319d651c6f3804a774&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:02.554122 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63773cba-cd74-4fc6-948f-4948a1f2e520 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:02.579754 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:02.634534 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7580d5-d1b2-498e-b8ec-8ac771074713 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:02.688812 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e6524-4872-4992-9d21-3ca20ee9169f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:02.690214 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e6524-4872-4992-9d21-3ca20ee9169f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:02.690707 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e6524-4872-4992-9d21-3ca20ee9169f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:02.691475 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e6524-4872-4992-9d21-3ca20ee9169f None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:02.692550 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e6524-4872-4992-9d21-3ca20ee9169f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:02.693062 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e6524-4872-4992-9d21-3ca20ee9169f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:02.695338 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e6524-4872-4992-9d21-3ca20ee9169f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:02.696340 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63773cba-cd74-4fc6-948f-4948a1f2e520 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:02.712832 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 455/900] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:09:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:02.718495 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e6524-4872-4992-9d21-3ca20ee9169f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:02.743227 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbcdf9b-31bc-4ee9-8b38-5526ca050a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:02.744363 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbcdf9b-31bc-4ee9-8b38-5526ca050a67 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:02.744978 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbcdf9b-31bc-4ee9-8b38-5526ca050a67 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:02.745460 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbcdf9b-31bc-4ee9-8b38-5526ca050a67 None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:02.746371 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbcdf9b-31bc-4ee9-8b38-5526ca050a67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:02.748165 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbcdf9b-31bc-4ee9-8b38-5526ca050a67 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:02.754980 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 446/901] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Jun 29 12:09:02 2022] GET /identity/v3/services => generated 1268 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:09:02.831475 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e6524-4872-4992-9d21-3ca20ee9169f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:02.855870 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:02.871701 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41230a-0af7-4399-8363-391c4051398b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:02.872546 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41230a-0af7-4399-8363-391c4051398b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:02.872828 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41230a-0af7-4399-8363-391c4051398b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:02.873101 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41230a-0af7-4399-8363-391c4051398b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:02.881752 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf41230a-0af7-4399-8363-391c4051398b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:02.883369 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf41230a-0af7-4399-8363-391c4051398b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:02.900348 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-bf41230a-0af7-4399-8363-391c4051398b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 12:09:02.900348 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:02.900348 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:02.900348 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:02.900348 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:02.900348 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:02.900348 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:02.900348 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:02.900348 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:02.900348 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:02.900348 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:02.900348 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:02.900348 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:09:02.900348 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:09:02.900348 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:09:02.900348 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:09:02.901366 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:02.901366 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:02.901366 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:09:02.901366 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:09:02.901366 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:09:02.901366 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:09:02.901366 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:09:02.901366 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:09:02.901366 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:09:02.901366 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:09:02.901366 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:09:02.901366 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:09:02.901366 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:09:02.901366 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:09:02.901366 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:09:02.901366 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:09:02.901366 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:09:02.901366 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:09:02.902343 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:09:02.902343 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:09:02.902343 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:09:02.902343 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:09:02.902343 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:09:02.902343 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:09:02.902343 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:09:02.902343 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:09:02.902343 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 12:09:02.902343 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:09:02.902343 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 456/902] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Jun 29 12:09:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:09:02.909280 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbcdf9b-31bc-4ee9-8b38-5526ca050a67 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:02.965403 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:03.037081 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbcdf9b-31bc-4ee9-8b38-5526ca050a67 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:03.073977 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8287d34-a207-4f88-851d-fe4f90e3f0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:03.074665 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8287d34-a207-4f88-851d-fe4f90e3f0d7 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:03.074995 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8287d34-a207-4f88-851d-fe4f90e3f0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:03.075282 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8287d34-a207-4f88-851d-fe4f90e3f0d7 None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:03.076130 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8287d34-a207-4f88-851d-fe4f90e3f0d7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:03.076437 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8287d34-a207-4f88-851d-fe4f90e3f0d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:03.078291 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8287d34-a207-4f88-851d-fe4f90e3f0d7 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:03.097561 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 447/903] 10.222.0.27 () {56 vars in 1149 bytes} [Wed Jun 29 12:09:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:03.103869 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41230a-0af7-4399-8363-391c4051398b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:03.208929 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41230a-0af7-4399-8363-391c4051398b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:03.245035 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde6978-82ef-45ed-82ed-d86311dfa905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:03.245703 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde6978-82ef-45ed-82ed-d86311dfa905 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:03.245994 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde6978-82ef-45ed-82ed-d86311dfa905 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:03.246266 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde6978-82ef-45ed-82ed-d86311dfa905 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:03.297083 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:03.317640 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bde6978-82ef-45ed-82ed-d86311dfa905 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:03.319174 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bde6978-82ef-45ed-82ed-d86311dfa905 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:03.391821 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb0e3a-835b-41cd-b384-5fd5abdace71 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:03.392247 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb0e3a-835b-41cd-b384-5fd5abdace71 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:03.392661 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb0e3a-835b-41cd-b384-5fd5abdace71 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:03.395387 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 448/904] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:09:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:09:03.400957 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a19dc5-1347-45f0-be14-9a056a25dc89 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:03.401313 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a19dc5-1347-45f0-be14-9a056a25dc89 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:03.401797 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a19dc5-1347-45f0-be14-9a056a25dc89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:03.421987 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-68a19dc5-1347-45f0-be14-9a056a25dc89 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:09:03.423193 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-68a19dc5-1347-45f0-be14-9a056a25dc89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:09:03.424487 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 457/905] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:09:03 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 12:09:03.430689 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde6978-82ef-45ed-82ed-d86311dfa905 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:03.497680 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 449/906] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:09:03 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:09:03.515794 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:03.520841 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a19dc5-1347-45f0-be14-9a056a25dc89 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:03.541285 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde6978-82ef-45ed-82ed-d86311dfa905 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:03.554776 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:03.584459 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ce08f-686d-4e31-916e-2a2e3b9b1256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:03.586301 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ce08f-686d-4e31-916e-2a2e3b9b1256 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:03.586763 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ce08f-686d-4e31-916e-2a2e3b9b1256 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:03.587206 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ce08f-686d-4e31-916e-2a2e3b9b1256 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:03.598266 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4ce08f-686d-4e31-916e-2a2e3b9b1256 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:03.599973 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4ce08f-686d-4e31-916e-2a2e3b9b1256 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:03.625452 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-0c4ce08f-686d-4e31-916e-2a2e3b9b1256 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:09:03.625452 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:03.625452 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:03.625452 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:03.625452 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:03.625452 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:03.625452 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:03.625452 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:03.625452 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:03.625452 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:03.625452 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:03.625452 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:03.625452 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:09:03.625452 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:09:03.625452 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:09:03.626443 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:09:03.626443 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:03.626443 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:03.626443 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:09:03.626443 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:09:03.626443 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:09:03.626443 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:09:03.626443 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:09:03.626443 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:09:03.626443 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:09:03.626443 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:09:03.626443 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:09:03.626443 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:09:03.626443 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:09:03.626443 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:09:03.626443 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:09:03.626443 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:09:03.627363 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:09:03.627363 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:09:03.627363 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:09:03.627363 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:09:03.627588 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a19dc5-1347-45f0-be14-9a056a25dc89 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:03.635382 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 458/907] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:09:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:09:03.636542 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ce08f-686d-4e31-916e-2a2e3b9b1256 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:03.662631 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d1a18b-56d5-40e7-9cb4-541a175cff01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:03.663532 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1a18b-56d5-40e7-9cb4-541a175cff01 None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:03.663938 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1a18b-56d5-40e7-9cb4-541a175cff01 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:03.664305 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1a18b-56d5-40e7-9cb4-541a175cff01 None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:03.665351 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d1a18b-56d5-40e7-9cb4-541a175cff01 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:03.666801 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d1a18b-56d5-40e7-9cb4-541a175cff01 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:03.689717 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 450/908] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Jun 29 12:09:03 2022] POST /identity/v3/services => generated 241 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:09:03.770557 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ce08f-686d-4e31-916e-2a2e3b9b1256 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:03.804226 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:03.818451 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ceedef-1060-4ad0-9f49-42b431e049fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:03.819704 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ceedef-1060-4ad0-9f49-42b431e049fb None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:03.820615 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ceedef-1060-4ad0-9f49-42b431e049fb None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:03.821027 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ceedef-1060-4ad0-9f49-42b431e049fb None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:03.822185 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ceedef-1060-4ad0-9f49-42b431e049fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:03.822865 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ceedef-1060-4ad0-9f49-42b431e049fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:03.824737 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ceedef-1060-4ad0-9f49-42b431e049fb None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:03.838907 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 459/909] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:09:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:03.844992 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d1a18b-56d5-40e7-9cb4-541a175cff01 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:03.941593 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:03.957282 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d1a18b-56d5-40e7-9cb4-541a175cff01 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:03.999007 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61f4f2-4123-4f0e-9501-d887a5a67b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:03.999819 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61f4f2-4123-4f0e-9501-d887a5a67b5e None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:04.000099 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61f4f2-4123-4f0e-9501-d887a5a67b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:04.000373 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61f4f2-4123-4f0e-9501-d887a5a67b5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:04.007462 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d61f4f2-4123-4f0e-9501-d887a5a67b5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:04.008931 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d61f4f2-4123-4f0e-9501-d887a5a67b5e None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:04.024327 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-4d61f4f2-4123-4f0e-9501-d887a5a67b5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:09:04.024327 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:04.024327 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:04.024327 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:04.024327 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:04.024327 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:04.024327 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:04.024327 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:04.024327 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:04.024327 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:04.024327 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:04.024327 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:04.024327 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:09:04.024327 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:09:04.024327 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:09:04.025269 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:09:04.025269 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:04.025269 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:04.025269 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:09:04.025269 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:09:04.025269 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:09:04.025269 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:09:04.025269 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:09:04.025269 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:09:04.025269 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:09:04.025269 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:09:04.025269 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:09:04.025269 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:09:04.025269 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:09:04.025269 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:09:04.025269 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:09:04.025269 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:09:04.026246 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:09:04.026246 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:09:04.026246 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:09:04.026246 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:09:04.026246 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:09:04.026246 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:09:04.026246 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:09:04.026246 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:09:04.026246 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 451/910] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jun 29 12:09:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:09:04.038463 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ceedef-1060-4ad0-9f49-42b431e049fb None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:04.144026 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ceedef-1060-4ad0-9f49-42b431e049fb None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:04.178758 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4170f77-7a41-4a7b-8f7b-6e906eded5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:04.179628 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4170f77-7a41-4a7b-8f7b-6e906eded5e2 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:04.179911 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4170f77-7a41-4a7b-8f7b-6e906eded5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:04.180187 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4170f77-7a41-4a7b-8f7b-6e906eded5e2 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:04.181041 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4170f77-7a41-4a7b-8f7b-6e906eded5e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:04.181354 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4170f77-7a41-4a7b-8f7b-6e906eded5e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:04.182832 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4170f77-7a41-4a7b-8f7b-6e906eded5e2 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:04.195993 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 460/911] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jun 29 12:09:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:04.202437 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61f4f2-4123-4f0e-9501-d887a5a67b5e None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:04.309857 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61f4f2-4123-4f0e-9501-d887a5a67b5e None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:04.344906 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e306f6f-8488-41b6-a72a-a338fbcd5403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:04.345572 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e306f6f-8488-41b6-a72a-a338fbcd5403 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:04.345878 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e306f6f-8488-41b6-a72a-a338fbcd5403 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:04.346154 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e306f6f-8488-41b6-a72a-a338fbcd5403 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:04.346989 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e306f6f-8488-41b6-a72a-a338fbcd5403 None admin] RBAC: Adding query filter params (role.id=21cea97c141c42a18f5c161141c2a781, scope.project.id=996db30845f84e57865fa40b9a730a05, user.id=cad33601754a462c828566fb54c6e100) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:04.347307 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e306f6f-8488-41b6-a72a-a338fbcd5403 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:04.348750 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e306f6f-8488-41b6-a72a-a338fbcd5403 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:04.354815 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 452/912] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jun 29 12:09:04 2022] GET /identity/v3/role_assignments?user.id=cad33601754a462c828566fb54c6e100&scope.project.id=996db30845f84e57865fa40b9a730a05&role.id=21cea97c141c42a18f5c161141c2a781 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:04.696975 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f3bae-53ec-4ed3-9e23-aefffc22bbee None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:04.697408 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f3bae-53ec-4ed3-9e23-aefffc22bbee None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:04.697523 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f3bae-53ec-4ed3-9e23-aefffc22bbee None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:04.699183 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 461/913] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:09:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:09:04.705113 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf7f73-9c1a-4e97-b03d-c024b610bcf7 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:04.705635 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf7f73-9c1a-4e97-b03d-c024b610bcf7 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:04.706159 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf7f73-9c1a-4e97-b03d-c024b610bcf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:04.723652 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-9dbf7f73-9c1a-4e97-b03d-c024b610bcf7 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:09:04.725159 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-9dbf7f73-9c1a-4e97-b03d-c024b610bcf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:09:04.733491 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:04.796704 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 453/914] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:09:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:09:04.819702 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8f3bae-53ec-4ed3-9e23-aefffc22bbee None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:04.875012 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:04.924972 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7475dc-8344-4002-ada8-2c8b20e2309f None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:04.925533 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7475dc-8344-4002-ada8-2c8b20e2309f None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:04.925533 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7475dc-8344-4002-ada8-2c8b20e2309f None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:04.927073 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 454/915] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:09:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:09:04.932425 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80431467-ed39-42fb-9872-8d69b1f9bcb4 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:04.932705 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80431467-ed39-42fb-9872-8d69b1f9bcb4 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:04.932978 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80431467-ed39-42fb-9872-8d69b1f9bcb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:04.935116 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8f3bae-53ec-4ed3-9e23-aefffc22bbee None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:04.950329 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-80431467-ed39-42fb-9872-8d69b1f9bcb4 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:09:04.951441 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-80431467-ed39-42fb-9872-8d69b1f9bcb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:09:04.973733 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a5223f-9994-4323-a0cc-b372208bf8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:04.974030 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5223f-9994-4323-a0cc-b372208bf8b1 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:04.974447 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5223f-9994-4323-a0cc-b372208bf8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:04.975042 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5223f-9994-4323-a0cc-b372208bf8b1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:04.975880 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a5223f-9994-4323-a0cc-b372208bf8b1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:04.977642 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a5223f-9994-4323-a0cc-b372208bf8b1 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:04.990538 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-62a5223f-9994-4323-a0cc-b372208bf8b1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 12:09:04.990538 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:04.990538 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 12:09:04.990538 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 12:09:04.990538 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 12:09:04.990538 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 12:09:04.990538 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 12:09:04.990538 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:09:04.990538 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 12:09:04.990538 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:09:04.990538 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 12:09:04.990538 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:09:04.990538 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:04.990538 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:04.990538 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:04.990538 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:04.990538 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:04.991974 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:04.991974 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:04.991974 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:04.991974 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:04.991974 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:04.991974 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:04.991974 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 12:09:04.991974 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 12:09:04.991974 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 12:09:04.991974 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 12:09:04.991974 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:04.991974 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:04.991974 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:09:04.991974 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:09:04.991974 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:09:04.991974 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:09:04.993172 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:09:04.993172 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:09:04.993172 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:09:04.993172 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:09:04.993172 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:09:04.993172 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:09:04.993172 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:09:04.993172 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:09:04.993172 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:09:04.993172 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:09:04.993172 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 12:09:04.993172 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:09:04.993172 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 12:09:04.993172 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:09:04.995733 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 462/916] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jun 29 12:09:04 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:09:05.002055 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a5223f-9994-4323-a0cc-b372208bf8b1 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:05.031103 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 455/917] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:09:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:09:05.058793 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80431467-ed39-42fb-9872-8d69b1f9bcb4 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:05.122787 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a5223f-9994-4323-a0cc-b372208bf8b1 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:05.137083 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:05.143006 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:05.162710 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0534a67-ab45-4800-9583-ad1b4908d18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:05.163720 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0534a67-ab45-4800-9583-ad1b4908d18a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:05.164197 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0534a67-ab45-4800-9583-ad1b4908d18a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:05.164671 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0534a67-ab45-4800-9583-ad1b4908d18a None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:05.165672 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0534a67-ab45-4800-9583-ad1b4908d18a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:05.166200 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0534a67-ab45-4800-9583-ad1b4908d18a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:05.167760 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0534a67-ab45-4800-9583-ad1b4908d18a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:05.173761 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 463/918] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jun 29 12:09:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:05.180048 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0534a67-ab45-4800-9583-ad1b4908d18a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:05.184120 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80431467-ed39-42fb-9872-8d69b1f9bcb4 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:05.227395 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf5f74e-b20c-418e-a184-5c432bac2c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:05.228535 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5f74e-b20c-418e-a184-5c432bac2c55 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:05.229008 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5f74e-b20c-418e-a184-5c432bac2c55 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:05.229925 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5f74e-b20c-418e-a184-5c432bac2c55 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:05.230794 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf5f74e-b20c-418e-a184-5c432bac2c55 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:05.232737 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf5f74e-b20c-418e-a184-5c432bac2c55 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:05.248849 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-dbf5f74e-b20c-418e-a184-5c432bac2c55 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 12:09:05.248849 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:05.248849 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 12:09:05.248849 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 12:09:05.248849 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 12:09:05.248849 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 12:09:05.248849 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 12:09:05.248849 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:09:05.248849 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 12:09:05.248849 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:09:05.248849 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 12:09:05.248849 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:09:05.248849 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:05.248849 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:05.248849 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:05.248849 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:05.249899 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:05.249899 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:05.249899 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:05.249899 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:05.249899 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:05.249899 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:05.249899 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:05.249899 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 12:09:05.249899 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 12:09:05.249899 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 12:09:05.249899 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 12:09:05.249899 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:05.249899 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:05.249899 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:09:05.249899 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:09:05.249899 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:09:05.250764 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:09:05.250764 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:09:05.250764 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:09:05.250764 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:09:05.250764 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:09:05.250764 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:09:05.250764 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:09:05.250764 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:09:05.250764 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:09:05.250764 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:09:05.250764 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:09:05.250764 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 12:09:05.250764 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:09:05.250764 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 12:09:05.250764 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:09:05.251593 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 456/919] 10.222.0.27 () {56 vars in 1132 bytes} [Wed Jun 29 12:09:05 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:09:05.257187 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf5f74e-b20c-418e-a184-5c432bac2c55 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:05.303192 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0534a67-ab45-4800-9583-ad1b4908d18a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:05.343157 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b256c399-8bb5-4f40-913e-be3ec64bc98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:05.343827 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256c399-8bb5-4f40-913e-be3ec64bc98a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:05.344112 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256c399-8bb5-4f40-913e-be3ec64bc98a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:05.344389 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256c399-8bb5-4f40-913e-be3ec64bc98a None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:05.345114 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b256c399-8bb5-4f40-913e-be3ec64bc98a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:05.345425 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b256c399-8bb5-4f40-913e-be3ec64bc98a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:05.346859 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b256c399-8bb5-4f40-913e-be3ec64bc98a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:05.352553 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 464/920] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jun 29 12:09:05 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:09:05.357893 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b256c399-8bb5-4f40-913e-be3ec64bc98a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:05.392664 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf5f74e-b20c-418e-a184-5c432bac2c55 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:05.410972 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:05.442698 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd15533-5878-41b6-8ec8-668945217bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:05.444041 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd15533-5878-41b6-8ec8-668945217bc6 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:05.444643 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd15533-5878-41b6-8ec8-668945217bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:05.445531 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd15533-5878-41b6-8ec8-668945217bc6 None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:05.447366 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd15533-5878-41b6-8ec8-668945217bc6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:05.447909 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd15533-5878-41b6-8ec8-668945217bc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:05.449588 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd15533-5878-41b6-8ec8-668945217bc6 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:05.452853 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:05.463241 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 457/921] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Jun 29 12:09:05 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:09:05.465653 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd15533-5878-41b6-8ec8-668945217bc6 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:05.486699 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b256c399-8bb5-4f40-913e-be3ec64bc98a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:05.533422 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec045cb5-df97-4240-b508-eab45e85f756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:05.534371 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec045cb5-df97-4240-b508-eab45e85f756 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:05.534655 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec045cb5-df97-4240-b508-eab45e85f756 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:05.534929 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec045cb5-df97-4240-b508-eab45e85f756 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:05.536092 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec045cb5-df97-4240-b508-eab45e85f756 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:05.537493 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec045cb5-df97-4240-b508-eab45e85f756 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:05.568352 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 465/922] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Jun 29 12:09:05 2022] POST /identity/v3/endpoints => generated 346 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:09:05.598456 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd15533-5878-41b6-8ec8-668945217bc6 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:05.651602 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a4f41-76f0-4c84-ad21-a6ee21830c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:05.652339 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a4f41-76f0-4c84-ad21-a6ee21830c32 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:05.652625 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a4f41-76f0-4c84-ad21-a6ee21830c32 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:05.652894 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a4f41-76f0-4c84-ad21-a6ee21830c32 None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:05.653666 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a4f41-76f0-4c84-ad21-a6ee21830c32 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:05.654006 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a4f41-76f0-4c84-ad21-a6ee21830c32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:05.655397 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a4f41-76f0-4c84-ad21-a6ee21830c32 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:05.661755 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 458/923] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Jun 29 12:09:05 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:09:05.668038 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec045cb5-df97-4240-b508-eab45e85f756 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:05.773493 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:05.780897 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec045cb5-df97-4240-b508-eab45e85f756 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:05.820528 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d470840-1bcb-4a4a-9aff-27ae68f34f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:05.821192 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d470840-1bcb-4a4a-9aff-27ae68f34f92 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:05.821477 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d470840-1bcb-4a4a-9aff-27ae68f34f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:05.821769 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d470840-1bcb-4a4a-9aff-27ae68f34f92 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:05.822525 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d470840-1bcb-4a4a-9aff-27ae68f34f92 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:05.823903 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d470840-1bcb-4a4a-9aff-27ae68f34f92 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:05.847250 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 466/924] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Jun 29 12:09:05 2022] POST /identity/v3/endpoints => generated 347 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:09:05.866964 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa02d0-9c20-4153-a466-a498200c2405 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:05.867340 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa02d0-9c20-4153-a466-a498200c2405 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:05.867631 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa02d0-9c20-4153-a466-a498200c2405 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:05.869409 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 459/925] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:09:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:09:05.875296 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d84b5-ba2f-4097-aa1f-7af706f6e5d6 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:05.875849 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d84b5-ba2f-4097-aa1f-7af706f6e5d6 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:05.875849 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d84b5-ba2f-4097-aa1f-7af706f6e5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:05.894126 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-7e1d84b5-ba2f-4097-aa1f-7af706f6e5d6 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:09:05.895400 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7e1d84b5-ba2f-4097-aa1f-7af706f6e5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:09:05.980924 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 467/926] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:09:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:09:06.004582 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfa02d0-9c20-4153-a466-a498200c2405 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:06.077499 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:06.122219 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfa02d0-9c20-4153-a466-a498200c2405 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:06.158069 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c95dbb-8a61-48a7-877c-39e78ef6500b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:06.158895 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c95dbb-8a61-48a7-877c-39e78ef6500b None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:06.159175 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c95dbb-8a61-48a7-877c-39e78ef6500b None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:06.159444 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c95dbb-8a61-48a7-877c-39e78ef6500b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:06.160157 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c95dbb-8a61-48a7-877c-39e78ef6500b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:06.161582 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c95dbb-8a61-48a7-877c-39e78ef6500b None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:06.174408 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-98c95dbb-8a61-48a7-877c-39e78ef6500b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 12:09:06.174408 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:06.174408 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 12:09:06.174408 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 12:09:06.174408 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 12:09:06.174408 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 12:09:06.174408 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 12:09:06.174408 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:09:06.174408 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 12:09:06.174408 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:09:06.174408 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 12:09:06.174408 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:09:06.174408 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:06.174408 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:06.174408 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:06.174408 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:06.174408 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:06.175468 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:06.175468 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:06.175468 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:06.175468 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:06.175468 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:06.175468 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:06.175468 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 12:09:06.175468 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 12:09:06.175468 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 12:09:06.175468 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 12:09:06.175468 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:06.175468 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:06.175468 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:09:06.175468 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:09:06.175468 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:09:06.175468 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:09:06.176317 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:09:06.176317 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:09:06.176317 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:09:06.176317 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:09:06.176317 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:09:06.176317 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:09:06.176317 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:09:06.176317 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:09:06.176317 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:09:06.176317 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:09:06.176317 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 12:09:06.176317 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:09:06.176317 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 12:09:06.176317 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:09:06.176317 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 460/927] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Jun 29 12:09:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:09:06.183997 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d84b5-ba2f-4097-aa1f-7af706f6e5d6 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:06.266477 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:06.292390 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d84b5-ba2f-4097-aa1f-7af706f6e5d6 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:06.331744 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11203f7-be81-49b0-82aa-e7ad0a118a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:06.332415 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11203f7-be81-49b0-82aa-e7ad0a118a70 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:06.332696 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11203f7-be81-49b0-82aa-e7ad0a118a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:06.332970 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11203f7-be81-49b0-82aa-e7ad0a118a70 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:06.333823 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11203f7-be81-49b0-82aa-e7ad0a118a70 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:06.334133 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11203f7-be81-49b0-82aa-e7ad0a118a70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:06.335824 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11203f7-be81-49b0-82aa-e7ad0a118a70 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:06.341288 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 468/928] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Jun 29 12:09:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:09:06.347393 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c95dbb-8a61-48a7-877c-39e78ef6500b None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:06.437795 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75580b-6b6b-410b-a9dd-7d5244509426 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:06.438156 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75580b-6b6b-410b-a9dd-7d5244509426 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:06.438371 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75580b-6b6b-410b-a9dd-7d5244509426 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:06.440180 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 469/929] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:09:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:09:06.445209 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1abc65e-c071-47ac-980c-ce71b5bee7e2 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:06.445468 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1abc65e-c071-47ac-980c-ce71b5bee7e2 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:06.445788 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1abc65e-c071-47ac-980c-ce71b5bee7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:06.457102 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c95dbb-8a61-48a7-877c-39e78ef6500b None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:06.466950 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-b1abc65e-c071-47ac-980c-ce71b5bee7e2 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:09:06.468796 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b1abc65e-c071-47ac-980c-ce71b5bee7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:09:06.483378 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:06.496654 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e8c6d-7526-44a6-89c3-bddbbbbb2b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:06.497916 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e8c6d-7526-44a6-89c3-bddbbbbb2b91 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:06.498537 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e8c6d-7526-44a6-89c3-bddbbbbb2b91 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:06.499031 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e8c6d-7526-44a6-89c3-bddbbbbb2b91 None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:06.500512 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4e8c6d-7526-44a6-89c3-bddbbbbb2b91 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:06.501051 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4e8c6d-7526-44a6-89c3-bddbbbbb2b91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:06.503280 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4e8c6d-7526-44a6-89c3-bddbbbbb2b91 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:06.509926 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 461/930] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Jun 29 12:09:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:06.516437 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e8c6d-7526-44a6-89c3-bddbbbbb2b91 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:06.561793 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 470/931] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:09:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 12:09:06.584071 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1abc65e-c071-47ac-980c-ce71b5bee7e2 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:06.637252 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e8c6d-7526-44a6-89c3-bddbbbbb2b91 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:06.661170 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:06.672271 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923bef35-0a84-421f-b87a-22f46ccf3d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:06.672943 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923bef35-0a84-421f-b87a-22f46ccf3d4e None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:06.673226 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923bef35-0a84-421f-b87a-22f46ccf3d4e None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:06.673500 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923bef35-0a84-421f-b87a-22f46ccf3d4e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:06.674336 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923bef35-0a84-421f-b87a-22f46ccf3d4e None admin] RBAC: Adding query filter params (interface=public, service_id=d5bfde01ad6340f6a570d26f0437daef, region_id=RegionOne) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:06.674651 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923bef35-0a84-421f-b87a-22f46ccf3d4e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:06.676153 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923bef35-0a84-421f-b87a-22f46ccf3d4e None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:06.687610 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 462/932] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Jun 29 12:09:06 2022] GET /identity/v3/endpoints?service_id=d5bfde01ad6340f6a570d26f0437daef&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:06.688366 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923bef35-0a84-421f-b87a-22f46ccf3d4e None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:06.707477 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1abc65e-c071-47ac-980c-ce71b5bee7e2 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:06.751009 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551884a-83cf-4c89-84ea-2ffbdc406882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:06.751838 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551884a-83cf-4c89-84ea-2ffbdc406882 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:06.752123 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551884a-83cf-4c89-84ea-2ffbdc406882 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:06.752398 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551884a-83cf-4c89-84ea-2ffbdc406882 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:06.758352 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:06.766674 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c551884a-83cf-4c89-84ea-2ffbdc406882 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:09:06.778968 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-c551884a-83cf-4c89-84ea-2ffbdc406882 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 12:09:06.778968 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:06.778968 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:06.778968 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:06.778968 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:06.778968 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:06.778968 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:06.778968 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:06.778968 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:06.778968 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:06.778968 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:06.778968 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:06.778968 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:09:06.778968 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:09:06.778968 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:09:06.778968 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:09:06.780183 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:09:06.780183 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:09:06.780183 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:09:06.780183 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:09:06.780183 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:06.780183 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:06.780183 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:09:06.780183 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:09:06.780183 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:09:06.780183 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:09:06.780183 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:09:06.780183 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:09:06.780183 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:09:06.780183 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:09:06.780183 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:09:06.780183 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:09:06.781264 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:09:06.781264 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:09:06.781264 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:09:06.781264 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:09:06.781264 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:09:06.781264 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:09:06.781264 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:09:06.781264 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:09:06.781264 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:09:06.781264 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:09:06.781264 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 12:09:06.781264 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:09:06.785415 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 471/933] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Jun 29 12:09:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:09:06.786358 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551884a-83cf-4c89-84ea-2ffbdc406882 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:06.844707 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923bef35-0a84-421f-b87a-22f46ccf3d4e None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:06.889413 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e5b58-97f3-4c08-95ae-6c991b339783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:06.890275 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e5b58-97f3-4c08-95ae-6c991b339783 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:06.890656 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e5b58-97f3-4c08-95ae-6c991b339783 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:06.891028 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e5b58-97f3-4c08-95ae-6c991b339783 None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:06.891818 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e5b58-97f3-4c08-95ae-6c991b339783 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:06.893294 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e5b58-97f3-4c08-95ae-6c991b339783 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:06.896185 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551884a-83cf-4c89-84ea-2ffbdc406882 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:06.906005 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 463/934] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Jun 29 12:09:06 2022] GET /identity/v3/services => generated 1497 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:09:06.930868 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:06.936879 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef2f66-3615-4363-a9bb-b53dd4df1387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:06.937996 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef2f66-3615-4363-a9bb-b53dd4df1387 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:06.938527 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef2f66-3615-4363-a9bb-b53dd4df1387 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:06.939065 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef2f66-3615-4363-a9bb-b53dd4df1387 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:06.939843 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ef2f66-3615-4363-a9bb-b53dd4df1387 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:06.940157 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ef2f66-3615-4363-a9bb-b53dd4df1387 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:06.941594 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ef2f66-3615-4363-a9bb-b53dd4df1387 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:06.951651 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 472/935] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Jun 29 12:09:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:06.957988 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e5b58-97f3-4c08-95ae-6c991b339783 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:07.074470 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e5b58-97f3-4c08-95ae-6c991b339783 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:07.095306 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:07.114874 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d73486-c1fc-45f8-88a1-150b3a280705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:07.115689 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d73486-c1fc-45f8-88a1-150b3a280705 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:07.115968 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d73486-c1fc-45f8-88a1-150b3a280705 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:07.116266 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d73486-c1fc-45f8-88a1-150b3a280705 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:07.128445 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d73486-c1fc-45f8-88a1-150b3a280705 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:07.129940 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d73486-c1fc-45f8-88a1-150b3a280705 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:07.152217 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-d9d73486-c1fc-45f8-88a1-150b3a280705 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:09:07.152217 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:07.152217 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:07.152217 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:07.152217 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:07.152217 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:07.152217 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:07.152217 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:07.152217 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:07.152217 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:07.152217 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:07.152217 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:07.152217 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:09:07.152217 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:09:07.152217 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:09:07.153285 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:09:07.153285 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:07.153285 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:07.153285 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:09:07.153285 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:09:07.153285 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:09:07.153285 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:09:07.153285 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:09:07.153285 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:09:07.153285 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:09:07.153285 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:09:07.153285 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:09:07.153285 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:09:07.153285 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:09:07.153285 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:09:07.153285 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:09:07.153285 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:09:07.154240 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:09:07.154240 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:09:07.154240 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:09:07.154240 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:09:07.154240 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 464/936] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:09:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:09:07.160799 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef2f66-3615-4363-a9bb-b53dd4df1387 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:07.270376 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef2f66-3615-4363-a9bb-b53dd4df1387 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:07.306398 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99273473-4fcc-4240-b343-4a7bc1fca62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:07.307446 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99273473-4fcc-4240-b343-4a7bc1fca62b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:07.307969 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99273473-4fcc-4240-b343-4a7bc1fca62b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:07.308442 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99273473-4fcc-4240-b343-4a7bc1fca62b None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:07.309370 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99273473-4fcc-4240-b343-4a7bc1fca62b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:07.309922 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99273473-4fcc-4240-b343-4a7bc1fca62b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:07.311506 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99273473-4fcc-4240-b343-4a7bc1fca62b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:07.324622 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 473/937] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:09:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:07.331059 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d73486-c1fc-45f8-88a1-150b3a280705 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:07.438172 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d73486-c1fc-45f8-88a1-150b3a280705 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:07.475003 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898a541-02af-42d7-b590-8923620b78a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:07.476203 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898a541-02af-42d7-b590-8923620b78a2 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:07.476617 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898a541-02af-42d7-b590-8923620b78a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:07.476894 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898a541-02af-42d7-b590-8923620b78a2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:07.485199 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d898a541-02af-42d7-b590-8923620b78a2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:07.486681 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d898a541-02af-42d7-b590-8923620b78a2 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:07.501928 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-d898a541-02af-42d7-b590-8923620b78a2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 12:09:07.501928 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:07.501928 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:07.501928 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:07.501928 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:07.501928 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:07.501928 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:07.501928 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:07.501928 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:07.501928 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:07.501928 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:07.501928 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:07.501928 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:09:07.501928 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:09:07.501928 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:09:07.501928 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:09:07.502945 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:07.502945 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:07.502945 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:09:07.502945 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:09:07.502945 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:09:07.502945 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:09:07.502945 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:09:07.502945 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:09:07.502945 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:09:07.502945 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:09:07.502945 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:09:07.502945 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:09:07.502945 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:09:07.502945 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:09:07.502945 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:09:07.502945 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:09:07.502945 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:09:07.502945 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:09:07.503955 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:09:07.503955 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:09:07.503955 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:09:07.503955 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:09:07.503955 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:09:07.503955 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:09:07.503955 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:09:07.503955 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:09:07.503955 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 12:09:07.503955 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:09:07.503955 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 465/938] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Jun 29 12:09:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:09:07.511022 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99273473-4fcc-4240-b343-4a7bc1fca62b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:07.570582 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:07.618077 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99273473-4fcc-4240-b343-4a7bc1fca62b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:07.653955 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bfb756-51fd-4d75-a68a-b7335c8089ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:07.654637 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bfb756-51fd-4d75-a68a-b7335c8089ee None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:07.654920 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bfb756-51fd-4d75-a68a-b7335c8089ee None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:07.655193 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bfb756-51fd-4d75-a68a-b7335c8089ee None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:07.656044 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bfb756-51fd-4d75-a68a-b7335c8089ee None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:07.656356 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bfb756-51fd-4d75-a68a-b7335c8089ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:07.657828 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bfb756-51fd-4d75-a68a-b7335c8089ee None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:07.676487 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 474/939] 10.222.0.27 () {56 vars in 1149 bytes} [Wed Jun 29 12:09:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:07.683338 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898a541-02af-42d7-b590-8923620b78a2 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:07.716698 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:07.781522 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857dee28-e2e4-4dcb-affb-e5a4113bb275 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:07.781898 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857dee28-e2e4-4dcb-affb-e5a4113bb275 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:07.782128 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857dee28-e2e4-4dcb-affb-e5a4113bb275 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:07.784794 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 475/940] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:09:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:09:07.788895 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727dfe54-6374-411b-8658-5f3ad4586083 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:07.789056 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727dfe54-6374-411b-8658-5f3ad4586083 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:07.789230 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727dfe54-6374-411b-8658-5f3ad4586083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:07.798603 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898a541-02af-42d7-b590-8923620b78a2 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:07.808490 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-727dfe54-6374-411b-8658-5f3ad4586083 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:09:07.810169 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-727dfe54-6374-411b-8658-5f3ad4586083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:09:07.837390 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b00cd6-02c8-4ccb-9e4b-22ee4ae906f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:07.838627 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b00cd6-02c8-4ccb-9e4b-22ee4ae906f8 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:07.839101 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b00cd6-02c8-4ccb-9e4b-22ee4ae906f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:07.839579 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b00cd6-02c8-4ccb-9e4b-22ee4ae906f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:07.851936 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b00cd6-02c8-4ccb-9e4b-22ee4ae906f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:07.853393 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b00cd6-02c8-4ccb-9e4b-22ee4ae906f8 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:07.871815 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-b5b00cd6-02c8-4ccb-9e4b-22ee4ae906f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:09:07.871815 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:07.871815 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:07.871815 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:07.871815 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:07.871815 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:07.871815 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:07.871815 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:07.871815 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:07.871815 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:07.871815 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:07.871815 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:07.871815 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:09:07.871815 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:09:07.871815 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:09:07.872799 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:09:07.872799 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:07.872799 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:07.872799 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:09:07.872799 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:09:07.872799 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:09:07.872799 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:09:07.872799 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:09:07.872799 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:09:07.872799 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:09:07.872799 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:09:07.872799 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:09:07.872799 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:09:07.872799 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:09:07.872799 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:09:07.872799 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:09:07.872799 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:09:07.873935 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:09:07.873935 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:09:07.873935 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:09:07.873935 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:09:07.873935 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 466/941] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:09:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:09:07.878709 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b00cd6-02c8-4ccb-9e4b-22ee4ae906f8 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:07.905725 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 476/942] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:09:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 12:09:07.926767 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727dfe54-6374-411b-8658-5f3ad4586083 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:07.971899 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:07.984464 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:08.005637 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b00cd6-02c8-4ccb-9e4b-22ee4ae906f8 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:08.035304 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727dfe54-6374-411b-8658-5f3ad4586083 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:08.052708 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1edd56-f316-4364-a91c-9bbc541e40da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:08.053739 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1edd56-f316-4364-a91c-9bbc541e40da None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:08.054290 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1edd56-f316-4364-a91c-9bbc541e40da None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:08.054856 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1edd56-f316-4364-a91c-9bbc541e40da None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:08.055803 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1edd56-f316-4364-a91c-9bbc541e40da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:08.056366 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1edd56-f316-4364-a91c-9bbc541e40da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:08.058012 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1edd56-f316-4364-a91c-9bbc541e40da None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:08.071018 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df42a0dd-69e3-4b43-b608-0ee27f47fe42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:08.071677 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42a0dd-69e3-4b43-b608-0ee27f47fe42 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:08.071955 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42a0dd-69e3-4b43-b608-0ee27f47fe42 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:08.076716 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42a0dd-69e3-4b43-b608-0ee27f47fe42 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:08.077194 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 467/943] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:09:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:08.077626 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df42a0dd-69e3-4b43-b608-0ee27f47fe42 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:08.077751 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24d93f-12e5-4c92-9c34-12f5602ab646 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:08.077751 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24d93f-12e5-4c92-9c34-12f5602ab646 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:08.077902 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df42a0dd-69e3-4b43-b608-0ee27f47fe42 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:08.077975 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24d93f-12e5-4c92-9c34-12f5602ab646 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:08.078043 dv-cinder-797608-38-smb devstack@keystone.service[80135]: WARNING keystone.server.flask.common [None req-df42a0dd-69e3-4b43-b608-0ee27f47fe42 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 29 12:09:08.078127 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 468/944] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:09:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:09:08.078127 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d24d93f-12e5-4c92-9c34-12f5602ab646 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:08.098622 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.sql.core [None req-df42a0dd-69e3-4b43-b608-0ee27f47fe42 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 29 12:09:08.098622 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 29 12:09:08.098622 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [parameters: {'id': '569e6fb976544c969ddf81c3a2175226', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 29 12:09:08.098622 dv-cinder-797608-38-smb devstack@keystone.service[80135]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80135) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 29 12:09:08.107288 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-df42a0dd-69e3-4b43-b608-0ee27f47fe42 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 569e6fb976544c969ddf81c3a2175226.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 569e6fb976544c969ddf81c3a2175226. Jun 29 12:09:08.107288 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:08.107288 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 29 12:09:08.107288 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 29 12:09:08.107288 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 29 12:09:08.107288 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 29 12:09:08.107288 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 29 12:09:08.107288 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application result = self._query(query) Jun 29 12:09:08.107288 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 29 12:09:08.107288 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application conn.query(q) Jun 29 12:09:08.107288 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 29 12:09:08.107288 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 29 12:09:08.107288 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 29 12:09:08.108098 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application result.read() Jun 29 12:09:08.108098 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 29 12:09:08.108098 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 29 12:09:08.108098 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 29 12:09:08.108098 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 29 12:09:08.108098 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 29 12:09:08.108098 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 29 12:09:08.108098 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 29 12:09:08.108098 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 29 12:09:08.108098 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 29 12:09:08.108098 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:09:08.108098 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 29 12:09:08.108098 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:09:08.108098 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:08.108098 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 29 12:09:08.108098 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 29 12:09:08.108098 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 29 12:09:08.108098 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 29 12:09:08.109067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 29 12:09:08.109067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application next(self.gen) Jun 29 12:09:08.109067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 29 12:09:08.109067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application yield resource Jun 29 12:09:08.109067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 29 12:09:08.109067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application next(self.gen) Jun 29 12:09:08.109067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 29 12:09:08.109067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self.session.rollback() Jun 29 12:09:08.109067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 29 12:09:08.109067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self.force_reraise() Jun 29 12:09:08.109067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 29 12:09:08.109067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise self.value Jun 29 12:09:08.109067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 29 12:09:08.109067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 29 12:09:08.109067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 29 12:09:08.109067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application session.commit() Jun 29 12:09:08.109067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 29 12:09:08.110002 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 29 12:09:08.110002 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 29 12:09:08.110002 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._prepare_impl() Jun 29 12:09:08.110002 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 29 12:09:08.110002 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self.session.flush() Jun 29 12:09:08.110002 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 29 12:09:08.110002 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._flush(objects) Jun 29 12:09:08.110002 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 29 12:09:08.110002 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 29 12:09:08.110002 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 29 12:09:08.110002 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application compat.raise_( Jun 29 12:09:08.110002 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 29 12:09:08.110002 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception Jun 29 12:09:08.110002 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 29 12:09:08.110002 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application flush_context.execute() Jun 29 12:09:08.110002 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 29 12:09:08.110002 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rec.execute(self) Jun 29 12:09:08.110964 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 29 12:09:08.110964 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 29 12:09:08.110964 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 29 12:09:08.110964 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 29 12:09:08.110964 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 29 12:09:08.110964 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 29 12:09:08.110964 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 29 12:09:08.110964 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 29 12:09:08.110964 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jun 29 12:09:08.110964 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 29 12:09:08.110964 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 29 12:09:08.110964 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 29 12:09:08.110964 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 29 12:09:08.110964 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 29 12:09:08.110964 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 29 12:09:08.111763 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 29 12:09:08.111763 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 29 12:09:08.111763 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception Jun 29 12:09:08.111763 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 29 12:09:08.111763 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 29 12:09:08.111763 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 29 12:09:08.111763 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 29 12:09:08.111763 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 29 12:09:08.111763 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application result = self._query(query) Jun 29 12:09:08.111763 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 29 12:09:08.111763 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application conn.query(q) Jun 29 12:09:08.111763 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 29 12:09:08.111763 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 29 12:09:08.111763 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 29 12:09:08.111763 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application result.read() Jun 29 12:09:08.111763 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 29 12:09:08.111763 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 29 12:09:08.113114 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 29 12:09:08.113114 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 29 12:09:08.113114 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 29 12:09:08.113114 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 29 12:09:08.113114 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 29 12:09:08.113114 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 29 12:09:08.113114 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 29 12:09:08.113114 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 29 12:09:08.113114 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [parameters: {'id': '569e6fb976544c969ddf81c3a2175226', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 29 12:09:08.113114 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 29 12:09:08.113114 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:09:08.113114 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 12:09:08.113114 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:09:08.113114 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:08.113114 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 29 12:09:08.114209 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 29 12:09:08.114209 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 29 12:09:08.114209 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 29 12:09:08.114209 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 29 12:09:08.114209 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:09:08.114209 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 12:09:08.114209 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:09:08.114209 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:08.114209 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:08.114209 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:08.114209 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:08.114209 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:08.114209 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:08.114209 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:08.114209 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:08.114209 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:08.114209 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:08.115295 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:08.115295 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 29 12:09:08.115295 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 29 12:09:08.115295 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:08.115295 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:08.115295 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 29 12:09:08.115295 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 29 12:09:08.115295 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 569e6fb976544c969ddf81c3a2175226. Jun 29 12:09:08.115295 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:09:08.117345 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 477/945] 10.222.0.27 () {60 vars in 1140 bytes} [Wed Jun 29 12:09:07 2022] POST /identity/v3/projects => generated 262 bytes in 191 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:09:08.119075 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090f04c-d85b-482a-936a-3d6ea94569c4 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:08.119488 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090f04c-d85b-482a-936a-3d6ea94569c4 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:08.119903 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090f04c-d85b-482a-936a-3d6ea94569c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:08.138252 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-8090f04c-d85b-482a-936a-3d6ea94569c4 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:09:08.139807 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8090f04c-d85b-482a-936a-3d6ea94569c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:09:08.196111 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d24d93f-12e5-4c92-9c34-12f5602ab646 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:08.219432 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 478/946] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:09:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:09:08.220368 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8090f04c-d85b-482a-936a-3d6ea94569c4 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:08.244395 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118782a6-f655-4c30-a6a2-a0310407fcd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:08.245284 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118782a6-f655-4c30-a6a2-a0310407fcd7 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:08.245938 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118782a6-f655-4c30-a6a2-a0310407fcd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:08.246226 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118782a6-f655-4c30-a6a2-a0310407fcd7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:08.248722 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:08.255504 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118782a6-f655-4c30-a6a2-a0310407fcd7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:08.258208 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118782a6-f655-4c30-a6a2-a0310407fcd7 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:08.260788 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:08.274338 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-118782a6-f655-4c30-a6a2-a0310407fcd7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:09:08.274338 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:08.274338 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:08.274338 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:08.274338 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:08.274338 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:08.274338 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:08.274338 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:08.274338 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:08.274338 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:08.274338 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:08.274338 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:08.274338 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:09:08.274338 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:09:08.274338 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:09:08.275280 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:09:08.275280 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:08.275280 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:08.275280 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:09:08.275280 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:09:08.275280 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:09:08.275280 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:09:08.275280 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:09:08.275280 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:09:08.275280 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:09:08.275280 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:09:08.275280 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:09:08.275280 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:09:08.275280 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:09:08.275280 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:09:08.275280 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:09:08.275280 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:09:08.276198 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:09:08.276198 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:09:08.276198 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:09:08.276198 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:09:08.276198 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:09:08.276198 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:09:08.276198 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:09:08.276198 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:09:08.276198 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 469/947] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jun 29 12:09:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:09:08.277298 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118782a6-f655-4c30-a6a2-a0310407fcd7 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:08.335876 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8090f04c-d85b-482a-936a-3d6ea94569c4 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:08.370817 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1af6c4-3bdd-429e-a814-c98118ab58b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:08.371621 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1af6c4-3bdd-429e-a814-c98118ab58b7 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:08.371889 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1af6c4-3bdd-429e-a814-c98118ab58b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:08.372158 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1af6c4-3bdd-429e-a814-c98118ab58b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:08.379324 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1af6c4-3bdd-429e-a814-c98118ab58b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:08.381003 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1af6c4-3bdd-429e-a814-c98118ab58b7 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:08.381130 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118782a6-f655-4c30-a6a2-a0310407fcd7 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:08.395559 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-0e1af6c4-3bdd-429e-a814-c98118ab58b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:09:08.395559 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:08.395559 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:08.395559 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:08.395559 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:08.395559 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:08.395559 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:08.395559 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:08.395559 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:08.395559 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:08.395559 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:08.395559 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:08.395559 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:09:08.395559 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:09:08.395559 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:09:08.396479 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:09:08.396479 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:08.396479 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:08.396479 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:09:08.396479 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:09:08.396479 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:09:08.396479 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:09:08.396479 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:09:08.396479 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:09:08.396479 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:09:08.396479 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:09:08.396479 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:09:08.396479 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:09:08.396479 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:09:08.396479 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:09:08.396479 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:09:08.396479 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:09:08.397374 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:09:08.397374 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:09:08.397374 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:09:08.397374 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:09:08.397374 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:09:08.397374 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:09:08.397374 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:09:08.397374 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:09:08.397374 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 479/948] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jun 29 12:09:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:09:08.398107 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1af6c4-3bdd-429e-a814-c98118ab58b7 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:08.425054 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df062a-10d2-4a7f-a043-dbba1fd80d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:08.426176 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df062a-10d2-4a7f-a043-dbba1fd80d28 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:08.426455 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df062a-10d2-4a7f-a043-dbba1fd80d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:08.426724 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df062a-10d2-4a7f-a043-dbba1fd80d28 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:08.427376 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3df062a-10d2-4a7f-a043-dbba1fd80d28 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:08.428840 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3df062a-10d2-4a7f-a043-dbba1fd80d28 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:08.440665 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-b3df062a-10d2-4a7f-a043-dbba1fd80d28 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 12:09:08.440665 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:08.440665 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 12:09:08.440665 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 12:09:08.440665 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 12:09:08.440665 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 12:09:08.440665 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 12:09:08.440665 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:09:08.440665 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 12:09:08.440665 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:09:08.440665 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 12:09:08.440665 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:09:08.440665 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:08.440665 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:08.440665 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:08.440665 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:08.440665 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:08.441684 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:08.441684 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:08.441684 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:08.441684 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:08.441684 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:08.441684 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:08.441684 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 12:09:08.441684 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 12:09:08.441684 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 12:09:08.441684 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 12:09:08.441684 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:08.441684 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:08.441684 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:09:08.441684 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:09:08.441684 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:09:08.441684 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:09:08.442859 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:09:08.442859 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:09:08.442859 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:09:08.442859 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:09:08.442859 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:09:08.442859 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:09:08.442859 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:09:08.442859 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:09:08.442859 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:09:08.442859 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:09:08.442859 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 12:09:08.442859 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:09:08.442859 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 12:09:08.442859 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:09:08.442859 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 470/949] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jun 29 12:09:08 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:09:08.443702 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df062a-10d2-4a7f-a043-dbba1fd80d28 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:08.501400 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:08.508282 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:08.516324 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1af6c4-3bdd-429e-a814-c98118ab58b7 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:08.548909 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df062a-10d2-4a7f-a043-dbba1fd80d28 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:08.551295 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203e1414-d465-4d21-85ae-9b6c5f7796b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:08.552059 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e1414-d465-4d21-85ae-9b6c5f7796b3 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:08.552341 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e1414-d465-4d21-85ae-9b6c5f7796b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:08.552613 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e1414-d465-4d21-85ae-9b6c5f7796b3 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:08.553408 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203e1414-d465-4d21-85ae-9b6c5f7796b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:08.553761 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203e1414-d465-4d21-85ae-9b6c5f7796b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:08.555363 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203e1414-d465-4d21-85ae-9b6c5f7796b3 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:08.575820 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 480/950] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jun 29 12:09:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:08.575820 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203e1414-d465-4d21-85ae-9b6c5f7796b3 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:08.590363 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ed6a30-e939-4404-9c32-d0ab45d843c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:08.591039 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ed6a30-e939-4404-9c32-d0ab45d843c9 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:08.591307 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ed6a30-e939-4404-9c32-d0ab45d843c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:08.591583 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ed6a30-e939-4404-9c32-d0ab45d843c9 None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:08.592349 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ed6a30-e939-4404-9c32-d0ab45d843c9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:08.592662 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ed6a30-e939-4404-9c32-d0ab45d843c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:08.594157 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ed6a30-e939-4404-9c32-d0ab45d843c9 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:08.611843 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 471/951] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Jun 29 12:09:08 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:08.612648 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ed6a30-e939-4404-9c32-d0ab45d843c9 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:08.694631 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203e1414-d465-4d21-85ae-9b6c5f7796b3 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:08.746167 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74cb793-61cd-4470-af13-fdec42aaee43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:08.746991 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74cb793-61cd-4470-af13-fdec42aaee43 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:08.747275 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74cb793-61cd-4470-af13-fdec42aaee43 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:08.747552 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74cb793-61cd-4470-af13-fdec42aaee43 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:08.748567 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74cb793-61cd-4470-af13-fdec42aaee43 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:08.748881 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74cb793-61cd-4470-af13-fdec42aaee43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:08.750994 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74cb793-61cd-4470-af13-fdec42aaee43 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:08.756518 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ed6a30-e939-4404-9c32-d0ab45d843c9 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:08.761747 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 481/952] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Jun 29 12:09:08 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:08.766412 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74cb793-61cd-4470-af13-fdec42aaee43 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:08.786815 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:08.790626 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:08.809449 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5aeba8-2589-4982-8c70-a3fbb2210d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:08.810431 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5aeba8-2589-4982-8c70-a3fbb2210d65 None admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:08.810714 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5aeba8-2589-4982-8c70-a3fbb2210d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:08.810986 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5aeba8-2589-4982-8c70-a3fbb2210d65 None admin] PATH_INFO: `/v3/projects/996db30845f84e57865fa40b9a730a05/users/cad33601754a462c828566fb54c6e100/roles/21cea97c141c42a18f5c161141c2a781` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:08.813620 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5aeba8-2589-4982-8c70-a3fbb2210d65 None admin] RBAC: Authorizing `identity:create_grant(project_id=996db30845f84e57865fa40b9a730a05, user_id=cad33601754a462c828566fb54c6e100, role_id=21cea97c141c42a18f5c161141c2a781)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:08.815117 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5aeba8-2589-4982-8c70-a3fbb2210d65 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:08.830951 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 472/953] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jun 29 12:09:08 2022] PUT /identity/v3/projects/996db30845f84e57865fa40b9a730a05/users/cad33601754a462c828566fb54c6e100/roles/21cea97c141c42a18f5c161141c2a781 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:09:08.899438 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74cb793-61cd-4470-af13-fdec42aaee43 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:08.938970 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9545825-f381-4e37-a99a-92adff75e3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:08.940349 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9545825-f381-4e37-a99a-92adff75e3db None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:08.940816 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9545825-f381-4e37-a99a-92adff75e3db None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:08.941281 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9545825-f381-4e37-a99a-92adff75e3db None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:08.942283 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9545825-f381-4e37-a99a-92adff75e3db None admin] RBAC: Adding query filter params (type=compute) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:08.942737 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9545825-f381-4e37-a99a-92adff75e3db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:08.944436 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9545825-f381-4e37-a99a-92adff75e3db None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:08.950859 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 482/954] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Jun 29 12:09:08 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:09.099211 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775cbaed-1aa6-4bd9-89c3-02d6e4fb5fd0 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:09.099779 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775cbaed-1aa6-4bd9-89c3-02d6e4fb5fd0 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:09.099779 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775cbaed-1aa6-4bd9-89c3-02d6e4fb5fd0 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:09.102048 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 473/955] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:09:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:09:09.107794 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d203c-7d9d-4fdd-98e9-d6b917d71527 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:09.108086 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d203c-7d9d-4fdd-98e9-d6b917d71527 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:09.108372 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d203c-7d9d-4fdd-98e9-d6b917d71527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:09.126397 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-d55d203c-7d9d-4fdd-98e9-d6b917d71527 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:09:09.127613 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d55d203c-7d9d-4fdd-98e9-d6b917d71527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:09:09.200262 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 483/956] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:09:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:09:09.224018 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775cbaed-1aa6-4bd9-89c3-02d6e4fb5fd0 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:09.328868 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775cbaed-1aa6-4bd9-89c3-02d6e4fb5fd0 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:09.363821 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668bce54-39c0-4164-8492-1df2ca661a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:09.364696 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668bce54-39c0-4164-8492-1df2ca661a4f None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:09.364977 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668bce54-39c0-4164-8492-1df2ca661a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:09.365303 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668bce54-39c0-4164-8492-1df2ca661a4f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:09.365994 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668bce54-39c0-4164-8492-1df2ca661a4f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:09.367536 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668bce54-39c0-4164-8492-1df2ca661a4f None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:09.380266 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-668bce54-39c0-4164-8492-1df2ca661a4f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 12:09:09.380266 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:09.380266 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 12:09:09.380266 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 12:09:09.380266 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 12:09:09.380266 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 12:09:09.380266 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 12:09:09.380266 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:09:09.380266 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 12:09:09.380266 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:09:09.380266 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 12:09:09.380266 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:09:09.380266 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:09.380266 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:09.380266 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:09.380266 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:09.380266 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:09.381447 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:09.381447 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:09.381447 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:09.381447 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:09.381447 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:09.381447 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:09.381447 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 12:09:09.381447 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 12:09:09.381447 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 12:09:09.381447 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 12:09:09.381447 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:09.381447 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:09.381447 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:09:09.381447 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:09:09.381447 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:09:09.381447 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:09:09.382979 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:09:09.382979 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:09:09.382979 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:09:09.382979 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:09:09.382979 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:09:09.382979 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:09:09.382979 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:09:09.382979 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:09:09.382979 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:09:09.382979 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:09:09.382979 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 12:09:09.382979 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:09:09.382979 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 12:09:09.382979 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:09:09.382979 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 474/957] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Jun 29 12:09:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:09:09.391728 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d203c-7d9d-4fdd-98e9-d6b917d71527 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:09.400575 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:09.497326 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d203c-7d9d-4fdd-98e9-d6b917d71527 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:09.532844 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee173ed0-6c95-4ef7-88b1-111c417bea96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:09.533511 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee173ed0-6c95-4ef7-88b1-111c417bea96 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:09.533817 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee173ed0-6c95-4ef7-88b1-111c417bea96 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:09.534089 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee173ed0-6c95-4ef7-88b1-111c417bea96 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:09.534852 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee173ed0-6c95-4ef7-88b1-111c417bea96 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:09.535161 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee173ed0-6c95-4ef7-88b1-111c417bea96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:09.536564 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee173ed0-6c95-4ef7-88b1-111c417bea96 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:09.541802 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 484/958] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Jun 29 12:09:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:09.547508 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668bce54-39c0-4164-8492-1df2ca661a4f None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:09.599910 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:09.652674 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668bce54-39c0-4164-8492-1df2ca661a4f None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:09.687106 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e83ef11-84ac-47ee-98aa-4c7cf9fec5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:09.687779 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83ef11-84ac-47ee-98aa-4c7cf9fec5c8 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:09.688061 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83ef11-84ac-47ee-98aa-4c7cf9fec5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:09.688321 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83ef11-84ac-47ee-98aa-4c7cf9fec5c8 None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:09.689037 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e83ef11-84ac-47ee-98aa-4c7cf9fec5c8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:09.689383 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e83ef11-84ac-47ee-98aa-4c7cf9fec5c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:09.690791 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e83ef11-84ac-47ee-98aa-4c7cf9fec5c8 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:09.696366 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 475/959] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Jun 29 12:09:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:09.702220 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee173ed0-6c95-4ef7-88b1-111c417bea96 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:09.776513 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:09.807599 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee173ed0-6c95-4ef7-88b1-111c417bea96 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:09.844990 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9ed04-65be-4f80-b8dc-7868794a3eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:09.845656 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9ed04-65be-4f80-b8dc-7868794a3eb8 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:09.845972 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9ed04-65be-4f80-b8dc-7868794a3eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:09.846249 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9ed04-65be-4f80-b8dc-7868794a3eb8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:09.847019 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba9ed04-65be-4f80-b8dc-7868794a3eb8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:09.848404 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba9ed04-65be-4f80-b8dc-7868794a3eb8 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:09.871746 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 485/960] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Jun 29 12:09:09 2022] POST /identity/v3/endpoints => generated 349 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:09:10.835734 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c2ca1-57da-42af-b637-2e6ccacbc55b None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:10.836491 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c2ca1-57da-42af-b637-2e6ccacbc55b None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:10.836491 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c2ca1-57da-42af-b637-2e6ccacbc55b None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:10.837903 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 476/961] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:09:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:09:10.843400 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade24de5-8b8d-44d8-bcd8-5005ea98016d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:10.843857 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade24de5-8b8d-44d8-bcd8-5005ea98016d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:10.844056 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade24de5-8b8d-44d8-bcd8-5005ea98016d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:10.861756 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-ade24de5-8b8d-44d8-bcd8-5005ea98016d None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:09:10.863283 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ade24de5-8b8d-44d8-bcd8-5005ea98016d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:09:10.941042 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 486/962] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:09:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:09:10.943803 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f38800-a0f1-47d0-98d8-e3b2be2e0f5d None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:10.944407 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f38800-a0f1-47d0-98d8-e3b2be2e0f5d None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:10.945060 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f38800-a0f1-47d0-98d8-e3b2be2e0f5d None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:10.946664 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 477/963] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:09:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:09:10.952369 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d54c28-8751-41e9-a931-9facf516b839 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:10.952941 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d54c28-8751-41e9-a931-9facf516b839 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:10.953436 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d54c28-8751-41e9-a931-9facf516b839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:10.966839 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f38800-a0f1-47d0-98d8-e3b2be2e0f5d None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:10.971791 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-01d54c28-8751-41e9-a931-9facf516b839 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:09:10.972441 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-01d54c28-8751-41e9-a931-9facf516b839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:09:11.023279 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:11.048098 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 487/964] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:09:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:09:11.071953 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d54c28-8751-41e9-a931-9facf516b839 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:11.096849 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f38800-a0f1-47d0-98d8-e3b2be2e0f5d None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:11.114542 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:11.138792 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65c412e-16c2-4215-adb2-f0335019fbd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:11.139616 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c412e-16c2-4215-adb2-f0335019fbd8 None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:11.140091 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c412e-16c2-4215-adb2-f0335019fbd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:11.140459 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c412e-16c2-4215-adb2-f0335019fbd8 None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:11.141345 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65c412e-16c2-4215-adb2-f0335019fbd8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:11.143080 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65c412e-16c2-4215-adb2-f0335019fbd8 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:11.144671 dv-cinder-797608-38-smb devstack@keystone.service[80134]: WARNING keystone.server.flask.common [None req-b65c412e-16c2-4215-adb2-f0335019fbd8 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 29 12:09:11.159936 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.sql.core [None req-b65c412e-16c2-4215-adb2-f0335019fbd8 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 29 12:09:11.159936 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 29 12:09:11.159936 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [parameters: {'user_id': '751b1bf3edbe4520b011f2c393d6ca29', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 29 12:09:11.159936 dv-cinder-797608-38-smb devstack@keystone.service[80134]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80134) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 29 12:09:11.178151 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-b65c412e-16c2-4215-adb2-f0335019fbd8 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 29 12:09:11.178151 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:11.178151 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 29 12:09:11.178151 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 29 12:09:11.178151 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 29 12:09:11.178151 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 29 12:09:11.178151 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 29 12:09:11.178151 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application result = self._query(query) Jun 29 12:09:11.178151 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 29 12:09:11.178151 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application conn.query(q) Jun 29 12:09:11.178151 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 29 12:09:11.178151 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 29 12:09:11.178151 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 29 12:09:11.178151 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application result.read() Jun 29 12:09:11.178151 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 29 12:09:11.179163 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 29 12:09:11.179163 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 29 12:09:11.179163 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 29 12:09:11.179163 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 29 12:09:11.179163 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 29 12:09:11.179163 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 29 12:09:11.179163 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 29 12:09:11.179163 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 29 12:09:11.179163 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:09:11.179163 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 29 12:09:11.179163 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:09:11.179163 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:11.179163 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 29 12:09:11.179163 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 29 12:09:11.179163 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 29 12:09:11.179163 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 29 12:09:11.179163 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 29 12:09:11.179163 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application next(self.gen) Jun 29 12:09:11.180200 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 29 12:09:11.180200 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application yield resource Jun 29 12:09:11.180200 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 29 12:09:11.180200 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application next(self.gen) Jun 29 12:09:11.180200 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 29 12:09:11.180200 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application self.session.rollback() Jun 29 12:09:11.180200 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 29 12:09:11.180200 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application self.force_reraise() Jun 29 12:09:11.180200 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 29 12:09:11.180200 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise self.value Jun 29 12:09:11.180200 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 29 12:09:11.180200 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 29 12:09:11.180200 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 29 12:09:11.180200 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application session.commit() Jun 29 12:09:11.180200 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 29 12:09:11.180200 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 29 12:09:11.180200 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 29 12:09:11.181346 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._prepare_impl() Jun 29 12:09:11.181346 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 29 12:09:11.181346 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application self.session.flush() Jun 29 12:09:11.181346 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 29 12:09:11.181346 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._flush(objects) Jun 29 12:09:11.181346 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 29 12:09:11.181346 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 29 12:09:11.181346 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 29 12:09:11.181346 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application compat.raise_( Jun 29 12:09:11.181346 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 29 12:09:11.181346 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception Jun 29 12:09:11.181346 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 29 12:09:11.181346 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application flush_context.execute() Jun 29 12:09:11.181346 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 29 12:09:11.181346 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rec.execute(self) Jun 29 12:09:11.181346 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 29 12:09:11.181346 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 29 12:09:11.182311 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 29 12:09:11.182311 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 29 12:09:11.182311 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 29 12:09:11.182311 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 29 12:09:11.182311 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 29 12:09:11.182311 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 29 12:09:11.182311 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jun 29 12:09:11.182311 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 29 12:09:11.182311 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 29 12:09:11.182311 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 29 12:09:11.182311 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 29 12:09:11.182311 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 29 12:09:11.182311 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 29 12:09:11.182311 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 29 12:09:11.182311 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 29 12:09:11.182311 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception Jun 29 12:09:11.183171 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 29 12:09:11.183171 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 29 12:09:11.183171 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 29 12:09:11.183171 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 29 12:09:11.183171 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 29 12:09:11.183171 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application result = self._query(query) Jun 29 12:09:11.183171 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 29 12:09:11.183171 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application conn.query(q) Jun 29 12:09:11.183171 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 29 12:09:11.183171 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 29 12:09:11.183171 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 29 12:09:11.183171 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application result.read() Jun 29 12:09:11.183171 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 29 12:09:11.183171 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 29 12:09:11.183171 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 29 12:09:11.183171 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 29 12:09:11.184027 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 29 12:09:11.184027 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 29 12:09:11.184027 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 29 12:09:11.184027 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 29 12:09:11.184027 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 29 12:09:11.184027 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 29 12:09:11.184027 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [parameters: {'user_id': '751b1bf3edbe4520b011f2c393d6ca29', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 29 12:09:11.184027 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 29 12:09:11.184027 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:09:11.184027 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 12:09:11.184027 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:09:11.184027 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:11.184027 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:11.184027 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:11.184027 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:11.188001 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:11.188001 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:11.188001 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:11.188001 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:11.188001 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:11.188001 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:11.188001 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:11.188001 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 29 12:09:11.188001 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 29 12:09:11.188001 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:11.188001 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:11.188001 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:09:11.188001 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:09:11.188001 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:09:11.188001 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:09:11.188001 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 29 12:09:11.188001 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 29 12:09:11.194922 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 29 12:09:11.194922 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 29 12:09:11.194922 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 29 12:09:11.194922 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 29 12:09:11.194922 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 29 12:09:11.194922 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:09:11.196146 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d54c28-8751-41e9-a931-9facf516b839 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:11.196325 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 478/965] 10.222.0.27 () {60 vars in 1131 bytes} [Wed Jun 29 12:09:10 2022] POST /identity/v3/users => generated 160 bytes in 215 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:09:11.196325 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db277e-3ac9-493a-848d-65be0b99a33c None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:11.196325 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db277e-3ac9-493a-848d-65be0b99a33c None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:11.196325 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db277e-3ac9-493a-848d-65be0b99a33c None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:11.196325 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 479/966] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:09:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:09:11.196325 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db277e-3ac9-493a-848d-65be0b99a33c None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:11.229966 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff9d98-a686-4a36-85ce-4cf4d22cd272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:11.231652 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff9d98-a686-4a36-85ce-4cf4d22cd272 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:11.231935 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff9d98-a686-4a36-85ce-4cf4d22cd272 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:11.232211 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff9d98-a686-4a36-85ce-4cf4d22cd272 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:11.246996 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ff9d98-a686-4a36-85ce-4cf4d22cd272 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:09:11.258310 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-50ff9d98-a686-4a36-85ce-4cf4d22cd272 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 12:09:11.258310 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:11.258310 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:11.258310 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:11.258310 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:11.258310 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:11.258310 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:11.258310 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:11.258310 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:11.258310 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:11.258310 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:11.258310 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:11.258310 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:09:11.258310 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:09:11.258310 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:09:11.258310 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:09:11.260508 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:09:11.260508 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:09:11.260508 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:09:11.260508 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:09:11.260508 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:11.260508 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:11.260508 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:09:11.260508 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:09:11.260508 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:09:11.260508 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:09:11.260508 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:09:11.260508 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:09:11.260508 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:09:11.260508 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:09:11.260508 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:09:11.260508 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:09:11.262896 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:09:11.262896 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:09:11.262896 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:09:11.262896 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:09:11.262896 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:09:11.262896 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:09:11.262896 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:09:11.262896 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:09:11.262896 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:09:11.262896 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:09:11.262896 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 12:09:11.262896 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:09:11.262896 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 488/967] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Jun 29 12:09:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:09:11.262896 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f46e0-bc77-4dd5-be47-6fda154785f3 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:11.264977 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f46e0-bc77-4dd5-be47-6fda154785f3 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:11.264977 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f46e0-bc77-4dd5-be47-6fda154785f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:11.283438 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-ea5f46e0-bc77-4dd5-be47-6fda154785f3 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:09:11.285516 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ea5f46e0-bc77-4dd5-be47-6fda154785f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:09:11.303842 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db277e-3ac9-493a-848d-65be0b99a33c None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:11.332537 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:11.341533 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d35f99-4878-400d-86ca-4e77f013a888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:11.342379 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d35f99-4878-400d-86ca-4e77f013a888 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:11.342653 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d35f99-4878-400d-86ca-4e77f013a888 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:11.342931 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d35f99-4878-400d-86ca-4e77f013a888 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:11.350806 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d35f99-4878-400d-86ca-4e77f013a888 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:11.352420 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d35f99-4878-400d-86ca-4e77f013a888 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:11.367186 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-00d35f99-4878-400d-86ca-4e77f013a888 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 12:09:11.367186 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:11.367186 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:11.367186 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:11.367186 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:11.367186 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:11.367186 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:11.367186 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:11.367186 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:11.367186 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:11.367186 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:11.367186 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:11.367186 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:09:11.367186 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:09:11.367186 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:09:11.367186 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:09:11.368185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:11.368185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:11.368185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:09:11.368185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:09:11.368185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:09:11.368185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:09:11.368185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:09:11.368185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:09:11.368185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:09:11.368185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:09:11.368185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:09:11.368185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:09:11.368185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:09:11.368185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:09:11.368185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:09:11.368185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:09:11.368185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:09:11.368185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:09:11.369231 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:09:11.369231 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:09:11.369231 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:09:11.369231 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:09:11.369231 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:09:11.369231 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:09:11.369231 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:09:11.369231 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:09:11.369231 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 12:09:11.369231 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:09:11.369231 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 480/968] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:09:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:09:11.369231 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d35f99-4878-400d-86ca-4e77f013a888 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:11.370212 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 489/969] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:09:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:09:11.383951 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f46e0-bc77-4dd5-be47-6fda154785f3 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:11.419966 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:11.500011 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f46e0-bc77-4dd5-be47-6fda154785f3 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:11.500784 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d35f99-4878-400d-86ca-4e77f013a888 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:11.536043 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e0f84-f54f-49aa-9aff-dfb58455b496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:11.536720 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e0f84-f54f-49aa-9aff-dfb58455b496 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:11.536999 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e0f84-f54f-49aa-9aff-dfb58455b496 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:11.537262 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e0f84-f54f-49aa-9aff-dfb58455b496 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:11.538227 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804e0f84-f54f-49aa-9aff-dfb58455b496 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:11.538586 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804e0f84-f54f-49aa-9aff-dfb58455b496 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:11.539053 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c01e4e-b9d8-4456-9623-ea74c5dfa340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:11.539790 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c01e4e-b9d8-4456-9623-ea74c5dfa340 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:11.540074 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c01e4e-b9d8-4456-9623-ea74c5dfa340 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:11.540183 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804e0f84-f54f-49aa-9aff-dfb58455b496 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:11.540338 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c01e4e-b9d8-4456-9623-ea74c5dfa340 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:11.541087 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c01e4e-b9d8-4456-9623-ea74c5dfa340 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:11.541391 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c01e4e-b9d8-4456-9623-ea74c5dfa340 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:11.542826 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c01e4e-b9d8-4456-9623-ea74c5dfa340 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:11.556387 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 481/970] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Jun 29 12:09:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:11.556387 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c01e4e-b9d8-4456-9623-ea74c5dfa340 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:11.585727 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 490/971] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jun 29 12:09:11 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:11.585727 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e0f84-f54f-49aa-9aff-dfb58455b496 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:11.620084 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:11.699174 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:11.700986 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e0f84-f54f-49aa-9aff-dfb58455b496 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:11.711419 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c01e4e-b9d8-4456-9623-ea74c5dfa340 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:11.740772 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b17a0-233b-4e8c-b39e-a0ab6edbf208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:11.741937 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b17a0-233b-4e8c-b39e-a0ab6edbf208 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:11.742464 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b17a0-233b-4e8c-b39e-a0ab6edbf208 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:11.742753 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b17a0-233b-4e8c-b39e-a0ab6edbf208 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:11.755128 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259b17a0-233b-4e8c-b39e-a0ab6edbf208 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:11.756610 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259b17a0-233b-4e8c-b39e-a0ab6edbf208 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:11.758067 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b3f3ca-10b5-4f98-bf70-73c0ff0287b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:11.759165 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3f3ca-10b5-4f98-bf70-73c0ff0287b9 None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:11.759582 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3f3ca-10b5-4f98-bf70-73c0ff0287b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:11.760451 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3f3ca-10b5-4f98-bf70-73c0ff0287b9 None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:11.761299 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b3f3ca-10b5-4f98-bf70-73c0ff0287b9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:11.762955 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b3f3ca-10b5-4f98-bf70-73c0ff0287b9 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:11.776737 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-259b17a0-233b-4e8c-b39e-a0ab6edbf208 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:09:11.776737 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:11.776737 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:11.776737 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:11.776737 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:11.776737 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:11.776737 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:11.776737 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:11.776737 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:11.776737 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:11.776737 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:11.776737 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:11.776737 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:09:11.776737 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:09:11.776737 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:09:11.777782 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:09:11.777782 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:11.777782 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:11.777782 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:09:11.777782 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:09:11.777782 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:09:11.777782 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:09:11.777782 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:09:11.777782 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:09:11.777782 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:09:11.777782 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:09:11.777782 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:09:11.777782 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:09:11.777782 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:09:11.777782 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:09:11.777782 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:09:11.777782 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:09:11.778731 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:09:11.778731 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:09:11.778731 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:09:11.778731 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:09:11.779244 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 491/972] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:09:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:09:11.785142 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 482/973] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Jun 29 12:09:11 2022] POST /identity/v3/services => generated 242 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:09:11.790432 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b17a0-233b-4e8c-b39e-a0ab6edbf208 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:11.894915 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:11.917640 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b17a0-233b-4e8c-b39e-a0ab6edbf208 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:11.968219 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b05f17-9595-45aa-9b56-395144d46108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:11.968893 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b05f17-9595-45aa-9b56-395144d46108 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:11.969173 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b05f17-9595-45aa-9b56-395144d46108 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:11.969442 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b05f17-9595-45aa-9b56-395144d46108 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:11.970383 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b05f17-9595-45aa-9b56-395144d46108 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:11.970676 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b05f17-9595-45aa-9b56-395144d46108 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:11.972050 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b05f17-9595-45aa-9b56-395144d46108 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:11.984303 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 492/974] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:09:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:09:11.990209 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b3f3ca-10b5-4f98-bf70-73c0ff0287b9 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:12.004701 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2543b56-5b51-4596-a4af-20b410d8456e None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:12.004987 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2543b56-5b51-4596-a4af-20b410d8456e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:12.005266 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2543b56-5b51-4596-a4af-20b410d8456e None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:12.006825 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 493/975] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:09:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:09:12.011995 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e575e89-908e-45aa-9a92-abc33d35298a None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:12.012277 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e575e89-908e-45aa-9a92-abc33d35298a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:12.012552 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e575e89-908e-45aa-9a92-abc33d35298a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:12.030019 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-4e575e89-908e-45aa-9a92-abc33d35298a None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:09:12.031225 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4e575e89-908e-45aa-9a92-abc33d35298a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:09:12.104109 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b3f3ca-10b5-4f98-bf70-73c0ff0287b9 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:12.106165 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 494/976] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:09:12 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 12:09:12.128822 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e575e89-908e-45aa-9a92-abc33d35298a None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:12.141052 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151db38d-77d9-42d2-9b0e-b753dae35d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:12.141671 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151db38d-77d9-42d2-9b0e-b753dae35d74 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:12.141979 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151db38d-77d9-42d2-9b0e-b753dae35d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:12.142261 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151db38d-77d9-42d2-9b0e-b753dae35d74 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:12.150565 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151db38d-77d9-42d2-9b0e-b753dae35d74 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:12.151958 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151db38d-77d9-42d2-9b0e-b753dae35d74 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:12.167339 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-151db38d-77d9-42d2-9b0e-b753dae35d74 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 12:09:12.167339 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:12.167339 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:12.167339 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:12.167339 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:12.167339 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:12.167339 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:12.167339 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:12.167339 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:12.167339 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:12.167339 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:12.167339 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:12.167339 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:09:12.167339 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:09:12.167339 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:09:12.167339 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:09:12.168544 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:12.168544 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:12.168544 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:09:12.168544 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:09:12.168544 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:09:12.168544 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:09:12.168544 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:09:12.168544 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:09:12.168544 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:09:12.168544 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:09:12.168544 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:09:12.168544 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:09:12.168544 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:09:12.168544 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:09:12.168544 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:09:12.168544 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:09:12.168544 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:09:12.168544 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:09:12.169975 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:09:12.169975 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:09:12.169975 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:09:12.169975 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:09:12.169975 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:09:12.169975 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:09:12.169975 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:09:12.169975 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:09:12.169975 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 12:09:12.169975 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:09:12.173462 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 483/977] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Jun 29 12:09:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:09:12.174301 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151db38d-77d9-42d2-9b0e-b753dae35d74 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:12.194048 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:12.201181 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:12.240018 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e575e89-908e-45aa-9a92-abc33d35298a None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:12.279486 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e25dd6-923e-4424-80af-05aa78aad961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:12.280287 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e25dd6-923e-4424-80af-05aa78aad961 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:12.280566 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e25dd6-923e-4424-80af-05aa78aad961 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:12.280840 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e25dd6-923e-4424-80af-05aa78aad961 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:12.281500 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e25dd6-923e-4424-80af-05aa78aad961 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:12.282914 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e25dd6-923e-4424-80af-05aa78aad961 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:12.287005 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151db38d-77d9-42d2-9b0e-b753dae35d74 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:12.295220 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-75e25dd6-923e-4424-80af-05aa78aad961 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 12:09:12.295220 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:12.295220 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 12:09:12.295220 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 12:09:12.295220 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 12:09:12.295220 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 12:09:12.295220 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 12:09:12.295220 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:09:12.295220 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 12:09:12.295220 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:09:12.295220 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 12:09:12.295220 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:09:12.295220 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:12.295220 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:12.295220 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:12.295220 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:12.295220 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:12.296266 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:12.296266 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:12.296266 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:12.296266 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:12.296266 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:12.296266 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:12.296266 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 12:09:12.296266 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 12:09:12.296266 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 12:09:12.296266 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 12:09:12.296266 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:12.296266 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:12.296266 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:09:12.296266 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:09:12.296266 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:09:12.296266 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:09:12.297135 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:09:12.297135 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:09:12.297135 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:09:12.297135 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:09:12.297135 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:09:12.297135 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:09:12.297135 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:09:12.297135 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:09:12.297135 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:09:12.297135 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:09:12.297135 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 12:09:12.297135 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:09:12.297135 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 12:09:12.297135 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:09:12.301542 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 495/978] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Jun 29 12:09:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:09:12.302316 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e25dd6-923e-4424-80af-05aa78aad961 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:12.325276 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f25147-4927-4a61-b2aa-8c4311008cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:12.326650 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f25147-4927-4a61-b2aa-8c4311008cd6 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:12.327441 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f25147-4927-4a61-b2aa-8c4311008cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:12.327716 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f25147-4927-4a61-b2aa-8c4311008cd6 None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:12.328561 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f25147-4927-4a61-b2aa-8c4311008cd6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:12.328879 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f25147-4927-4a61-b2aa-8c4311008cd6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:12.330335 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f25147-4927-4a61-b2aa-8c4311008cd6 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:12.349473 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 484/979] 10.222.0.27 () {56 vars in 1149 bytes} [Wed Jun 29 12:09:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:12.355428 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f25147-4927-4a61-b2aa-8c4311008cd6 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:12.410841 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e25dd6-923e-4424-80af-05aa78aad961 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:12.436371 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:12.441516 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:12.447596 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6373b2cc-941a-49bc-9d1f-ca3dcc4c7488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:12.448548 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373b2cc-941a-49bc-9d1f-ca3dcc4c7488 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:12.448839 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373b2cc-941a-49bc-9d1f-ca3dcc4c7488 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:12.449115 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373b2cc-941a-49bc-9d1f-ca3dcc4c7488 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:12.449861 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6373b2cc-941a-49bc-9d1f-ca3dcc4c7488 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:12.450170 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6373b2cc-941a-49bc-9d1f-ca3dcc4c7488 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:12.452399 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6373b2cc-941a-49bc-9d1f-ca3dcc4c7488 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:12.463111 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 496/980] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Jun 29 12:09:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:09:12.464175 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6373b2cc-941a-49bc-9d1f-ca3dcc4c7488 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:12.466361 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f25147-4927-4a61-b2aa-8c4311008cd6 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:12.503656 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a085a-2e42-44a4-9bb9-b5d456f97709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:12.504314 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a085a-2e42-44a4-9bb9-b5d456f97709 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:12.504592 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a085a-2e42-44a4-9bb9-b5d456f97709 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:12.505286 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a085a-2e42-44a4-9bb9-b5d456f97709 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:12.569525 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6373b2cc-941a-49bc-9d1f-ca3dcc4c7488 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:12.577365 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45a085a-2e42-44a4-9bb9-b5d456f97709 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:12.578945 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45a085a-2e42-44a4-9bb9-b5d456f97709 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:12.610264 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b71800-d6ac-4401-8eac-86115cd96e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:12.611195 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b71800-d6ac-4401-8eac-86115cd96e07 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:12.611898 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b71800-d6ac-4401-8eac-86115cd96e07 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:12.612168 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b71800-d6ac-4401-8eac-86115cd96e07 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:12.613149 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b71800-d6ac-4401-8eac-86115cd96e07 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:12.613464 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b71800-d6ac-4401-8eac-86115cd96e07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:12.615959 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b71800-d6ac-4401-8eac-86115cd96e07 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:12.625855 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 497/981] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Jun 29 12:09:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:09:12.628449 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b71800-d6ac-4401-8eac-86115cd96e07 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:12.662601 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:12.689654 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:12.694124 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 485/982] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:09:12 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 12:09:12.699793 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a085a-2e42-44a4-9bb9-b5d456f97709 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:12.738156 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b71800-d6ac-4401-8eac-86115cd96e07 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:12.771281 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd703391-ad49-4d52-9bcb-703bc5c56988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:12.771943 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd703391-ad49-4d52-9bcb-703bc5c56988 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:12.772225 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd703391-ad49-4d52-9bcb-703bc5c56988 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:12.772556 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd703391-ad49-4d52-9bcb-703bc5c56988 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:12.773381 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd703391-ad49-4d52-9bcb-703bc5c56988 None admin] RBAC: Adding query filter params (interface=admin, service_id=d5bfde01ad6340f6a570d26f0437daef, region_id=RegionOne) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:12.773719 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd703391-ad49-4d52-9bcb-703bc5c56988 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:12.775111 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd703391-ad49-4d52-9bcb-703bc5c56988 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:12.780381 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 498/983] 10.222.0.27 () {56 vars in 1249 bytes} [Wed Jun 29 12:09:12 2022] GET /identity/v3/endpoints?service_id=d5bfde01ad6340f6a570d26f0437daef&interface=admin®ion_id=RegionOne => generated 193 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:09:12.785606 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd703391-ad49-4d52-9bcb-703bc5c56988 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:12.809003 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a085a-2e42-44a4-9bb9-b5d456f97709 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:12.846865 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4e8c8-420a-40cc-b952-54af9c6457b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:12.847684 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4e8c8-420a-40cc-b952-54af9c6457b3 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:12.847950 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4e8c8-420a-40cc-b952-54af9c6457b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:12.848221 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4e8c8-420a-40cc-b952-54af9c6457b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:12.858327 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa4e8c8-420a-40cc-b952-54af9c6457b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:12.859780 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa4e8c8-420a-40cc-b952-54af9c6457b3 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:12.878047 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-5fa4e8c8-420a-40cc-b952-54af9c6457b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:09:12.878047 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:12.878047 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:12.878047 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:12.878047 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:12.878047 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:12.878047 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:12.878047 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:12.878047 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:12.878047 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:12.878047 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:12.878047 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:12.878047 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:09:12.878047 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:09:12.878047 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:09:12.878996 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:09:12.878996 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:12.878996 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:12.878996 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:09:12.878996 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:09:12.878996 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:09:12.878996 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:09:12.878996 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:09:12.878996 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:09:12.878996 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:09:12.878996 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:09:12.878996 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:09:12.878996 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:09:12.878996 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:09:12.878996 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:09:12.878996 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:09:12.878996 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:09:12.879943 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:09:12.879943 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:09:12.879943 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:09:12.879943 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:09:12.879943 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 486/984] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:09:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:09:12.885541 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4e8c8-420a-40cc-b952-54af9c6457b3 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:12.903124 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd703391-ad49-4d52-9bcb-703bc5c56988 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:12.915320 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:12.931880 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:12.944321 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c505e80-a1e7-4b42-820a-ebb220fb28d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:12.945062 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c505e80-a1e7-4b42-820a-ebb220fb28d7 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:12.945345 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c505e80-a1e7-4b42-820a-ebb220fb28d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:12.945638 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c505e80-a1e7-4b42-820a-ebb220fb28d7 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:12.946374 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c505e80-a1e7-4b42-820a-ebb220fb28d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:12.947760 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c505e80-a1e7-4b42-820a-ebb220fb28d7 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:12.955537 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 499/985] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Jun 29 12:09:12 2022] GET /identity/v3/services => generated 1727 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:09:13.007643 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4e8c8-420a-40cc-b952-54af9c6457b3 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:13.051064 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df338fd8-5c23-444a-baf9-6c75ea1172a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:13.052198 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df338fd8-5c23-444a-baf9-6c75ea1172a0 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:13.052198 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df338fd8-5c23-444a-baf9-6c75ea1172a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:13.052336 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df338fd8-5c23-444a-baf9-6c75ea1172a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:13.053048 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df338fd8-5c23-444a-baf9-6c75ea1172a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:13.053354 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df338fd8-5c23-444a-baf9-6c75ea1172a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:13.054949 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df338fd8-5c23-444a-baf9-6c75ea1172a0 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:13.073005 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 487/986] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:09:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:09:13.074431 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c505e80-a1e7-4b42-820a-ebb220fb28d7 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:13.183253 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c505e80-a1e7-4b42-820a-ebb220fb28d7 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:13.218742 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4c885-1160-4401-8424-fc954663ef2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:13.219535 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4c885-1160-4401-8424-fc954663ef2d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:13.219816 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4c885-1160-4401-8424-fc954663ef2d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:13.220089 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4c885-1160-4401-8424-fc954663ef2d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:13.227218 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d4c885-1160-4401-8424-fc954663ef2d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:13.228660 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d4c885-1160-4401-8424-fc954663ef2d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:13.243399 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-c7d4c885-1160-4401-8424-fc954663ef2d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:09:13.243399 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:13.243399 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:13.243399 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:13.243399 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:13.243399 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:13.243399 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:13.243399 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:13.243399 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:13.243399 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:13.243399 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:13.243399 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:13.243399 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:09:13.243399 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:09:13.243399 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:09:13.244320 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:09:13.244320 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:13.244320 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:13.244320 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:09:13.244320 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:09:13.244320 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:09:13.244320 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:09:13.244320 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:09:13.244320 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:09:13.244320 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:09:13.244320 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:09:13.244320 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:09:13.244320 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:09:13.244320 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:09:13.244320 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:09:13.244320 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:09:13.244320 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:09:13.245235 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:09:13.245235 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:09:13.245235 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:09:13.245235 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:09:13.245235 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:09:13.245235 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:09:13.245235 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:09:13.245235 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:09:13.245235 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 500/987] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jun 29 12:09:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:09:13.252427 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df338fd8-5c23-444a-baf9-6c75ea1172a0 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:13.343865 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:13.360586 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df338fd8-5c23-444a-baf9-6c75ea1172a0 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:13.394769 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a59db-d5b7-434e-b00e-c25ab7f7f66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:13.395441 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a59db-d5b7-434e-b00e-c25ab7f7f66d None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:13.395719 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a59db-d5b7-434e-b00e-c25ab7f7f66d None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:13.395990 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a59db-d5b7-434e-b00e-c25ab7f7f66d None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:13.396785 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a59db-d5b7-434e-b00e-c25ab7f7f66d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:13.397094 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a59db-d5b7-434e-b00e-c25ab7f7f66d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:13.398808 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a59db-d5b7-434e-b00e-c25ab7f7f66d None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:13.418101 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 488/988] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jun 29 12:09:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:09:13.419668 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4c885-1160-4401-8424-fc954663ef2d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:13.473911 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:13.527515 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4c885-1160-4401-8424-fc954663ef2d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:13.563357 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a310ee82-6c0c-491f-9d52-d420ea0a9b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:13.564011 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310ee82-6c0c-491f-9d52-d420ea0a9b44 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:13.564291 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310ee82-6c0c-491f-9d52-d420ea0a9b44 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:13.564563 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310ee82-6c0c-491f-9d52-d420ea0a9b44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:13.565385 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a310ee82-6c0c-491f-9d52-d420ea0a9b44 None admin] RBAC: Adding query filter params (role.id=21cea97c141c42a18f5c161141c2a781, scope.project.id=996db30845f84e57865fa40b9a730a05, user.id=cad33601754a462c828566fb54c6e100) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:13.565705 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a310ee82-6c0c-491f-9d52-d420ea0a9b44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:13.567149 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a310ee82-6c0c-491f-9d52-d420ea0a9b44 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:13.573500 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 501/989] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jun 29 12:09:13 2022] GET /identity/v3/role_assignments?user.id=cad33601754a462c828566fb54c6e100&scope.project.id=996db30845f84e57865fa40b9a730a05&role.id=21cea97c141c42a18f5c161141c2a781 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:13.845604 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f4766-cf8d-4aff-a856-cdefcc4febe5 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:13.846033 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f4766-cf8d-4aff-a856-cdefcc4febe5 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:13.846207 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f4766-cf8d-4aff-a856-cdefcc4febe5 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:13.847743 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 489/990] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:09:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:09:13.853119 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac166c-67ff-46a2-b8ea-017447bfa4bc None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:13.853377 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac166c-67ff-46a2-b8ea-017447bfa4bc None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:13.853675 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac166c-67ff-46a2-b8ea-017447bfa4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:13.871253 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f9ac166c-67ff-46a2-b8ea-017447bfa4bc None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:09:13.872448 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f9ac166c-67ff-46a2-b8ea-017447bfa4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:09:13.943347 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 502/991] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:09:13 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 12:09:13.966741 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f4766-cf8d-4aff-a856-cdefcc4febe5 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:14.083150 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f4766-cf8d-4aff-a856-cdefcc4febe5 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:14.118632 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc8494e-34dc-495d-b820-71da3d6b0c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:14.119391 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc8494e-34dc-495d-b820-71da3d6b0c87 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:14.119673 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc8494e-34dc-495d-b820-71da3d6b0c87 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:14.119926 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc8494e-34dc-495d-b820-71da3d6b0c87 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:14.120649 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc8494e-34dc-495d-b820-71da3d6b0c87 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:14.122058 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc8494e-34dc-495d-b820-71da3d6b0c87 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:14.134401 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-3fc8494e-34dc-495d-b820-71da3d6b0c87 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 12:09:14.134401 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:14.134401 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 12:09:14.134401 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 12:09:14.134401 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 12:09:14.134401 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 12:09:14.134401 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 12:09:14.134401 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:09:14.134401 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 12:09:14.134401 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:09:14.134401 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 12:09:14.134401 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:09:14.134401 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:14.134401 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:14.134401 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:14.134401 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:14.134401 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:14.135465 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:14.135465 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:14.135465 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:14.135465 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:14.135465 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:14.135465 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:14.135465 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 12:09:14.135465 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 12:09:14.135465 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 12:09:14.135465 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 12:09:14.135465 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:14.135465 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:14.135465 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:09:14.135465 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:09:14.135465 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:09:14.135465 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:09:14.136330 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:09:14.136330 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:09:14.136330 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:09:14.136330 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:09:14.136330 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:09:14.136330 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:09:14.136330 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:09:14.136330 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:09:14.136330 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:09:14.136330 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:09:14.136330 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 12:09:14.136330 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:09:14.136330 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 12:09:14.136330 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:09:14.138039 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 490/992] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jun 29 12:09:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:09:14.141849 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac166c-67ff-46a2-b8ea-017447bfa4bc None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:14.187012 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:14.246076 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac166c-67ff-46a2-b8ea-017447bfa4bc None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:14.280439 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83876b-5dc2-499d-9463-4f6edc440f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:14.281102 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83876b-5dc2-499d-9463-4f6edc440f92 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:14.281378 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83876b-5dc2-499d-9463-4f6edc440f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:14.281649 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83876b-5dc2-499d-9463-4f6edc440f92 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:14.282400 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b83876b-5dc2-499d-9463-4f6edc440f92 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:14.282707 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b83876b-5dc2-499d-9463-4f6edc440f92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:14.284127 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b83876b-5dc2-499d-9463-4f6edc440f92 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:14.293607 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 503/993] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Jun 29 12:09:14 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:14.294825 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc8494e-34dc-495d-b820-71da3d6b0c87 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:14.308446 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:14.404972 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc8494e-34dc-495d-b820-71da3d6b0c87 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:14.439159 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff4c0c6-683b-465a-96cc-eb8a595d1319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:14.439816 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4c0c6-683b-465a-96cc-eb8a595d1319 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:14.440098 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4c0c6-683b-465a-96cc-eb8a595d1319 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:14.440371 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4c0c6-683b-465a-96cc-eb8a595d1319 None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:14.441075 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff4c0c6-683b-465a-96cc-eb8a595d1319 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:14.441375 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff4c0c6-683b-465a-96cc-eb8a595d1319 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:14.442792 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff4c0c6-683b-465a-96cc-eb8a595d1319 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:14.453072 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 491/994] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Jun 29 12:09:14 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:09:14.454327 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83876b-5dc2-499d-9463-4f6edc440f92 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:14.560270 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83876b-5dc2-499d-9463-4f6edc440f92 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:14.568967 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:14.598229 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ea85b3-df72-4ead-ac79-bce0fc9dfa5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:14.598886 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea85b3-df72-4ead-ac79-bce0fc9dfa5d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:14.599165 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea85b3-df72-4ead-ac79-bce0fc9dfa5d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:14.599432 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea85b3-df72-4ead-ac79-bce0fc9dfa5d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:14.600228 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ea85b3-df72-4ead-ac79-bce0fc9dfa5d None admin] RBAC: Adding query filter params (interface=public, service_id=65575fa40d8540dfad073aea5667f84d, region_id=RegionOne) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:14.600536 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ea85b3-df72-4ead-ac79-bce0fc9dfa5d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:14.602102 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ea85b3-df72-4ead-ac79-bce0fc9dfa5d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:14.612074 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 504/995] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Jun 29 12:09:14 2022] GET /identity/v3/endpoints?service_id=65575fa40d8540dfad073aea5667f84d&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:09:14.613194 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff4c0c6-683b-465a-96cc-eb8a595d1319 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:14.691632 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:14.719566 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff4c0c6-683b-465a-96cc-eb8a595d1319 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:14.759086 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b656934-9646-4830-b2a1-83368a17a237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:14.759857 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b656934-9646-4830-b2a1-83368a17a237 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:14.760137 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b656934-9646-4830-b2a1-83368a17a237 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:14.760411 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b656934-9646-4830-b2a1-83368a17a237 None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:14.761096 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b656934-9646-4830-b2a1-83368a17a237 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:14.762505 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b656934-9646-4830-b2a1-83368a17a237 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:14.777725 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 492/996] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Jun 29 12:09:14 2022] GET /identity/v3/services => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:09:14.990099 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c74090-186e-4783-aeeb-e12194504b36 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:14.990627 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c74090-186e-4783-aeeb-e12194504b36 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:14.990627 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c74090-186e-4783-aeeb-e12194504b36 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:14.992317 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 505/997] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:09:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:09:14.997351 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d49aef-1623-44ee-b2c0-80926ca6332f None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:14.997605 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d49aef-1623-44ee-b2c0-80926ca6332f None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:14.997915 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d49aef-1623-44ee-b2c0-80926ca6332f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:15.015204 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-31d49aef-1623-44ee-b2c0-80926ca6332f None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:09:15.016711 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-31d49aef-1623-44ee-b2c0-80926ca6332f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:09:15.098784 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 493/998] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:09:14 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:09:15.122390 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c74090-186e-4783-aeeb-e12194504b36 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:15.231440 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c74090-186e-4783-aeeb-e12194504b36 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:15.267290 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a84a8f1-706c-4b03-a739-7af8f2603ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:15.268010 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84a8f1-706c-4b03-a739-7af8f2603ed0 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:15.268286 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84a8f1-706c-4b03-a739-7af8f2603ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:15.268554 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84a8f1-706c-4b03-a739-7af8f2603ed0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:15.269202 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a84a8f1-706c-4b03-a739-7af8f2603ed0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:15.270610 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a84a8f1-706c-4b03-a739-7af8f2603ed0 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:15.282848 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-9a84a8f1-706c-4b03-a739-7af8f2603ed0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 12:09:15.282848 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:15.282848 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 12:09:15.282848 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 12:09:15.282848 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 12:09:15.282848 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 12:09:15.282848 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 12:09:15.282848 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:09:15.282848 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 12:09:15.282848 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:09:15.282848 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 12:09:15.282848 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:09:15.282848 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:15.282848 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:15.282848 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:15.282848 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:15.282848 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:15.283866 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:15.283866 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:15.283866 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:15.283866 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:15.283866 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:15.283866 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:15.283866 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 12:09:15.283866 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 12:09:15.283866 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 12:09:15.283866 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 12:09:15.283866 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:15.283866 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:15.283866 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:09:15.283866 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:09:15.283866 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:09:15.283866 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:09:15.284718 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:09:15.284718 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:09:15.284718 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:09:15.284718 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:09:15.284718 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:09:15.284718 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:09:15.284718 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:09:15.284718 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:09:15.284718 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:09:15.284718 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:09:15.284718 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 12:09:15.284718 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:09:15.284718 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 12:09:15.284718 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:09:15.289589 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 506/999] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Jun 29 12:09:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:09:15.290892 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d49aef-1623-44ee-b2c0-80926ca6332f None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:15.362245 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:15.398372 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d49aef-1623-44ee-b2c0-80926ca6332f None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:15.434156 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff60dc-f542-478f-bd23-24d7dff154ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:15.434818 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff60dc-f542-478f-bd23-24d7dff154ad None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:15.435093 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff60dc-f542-478f-bd23-24d7dff154ad None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:15.435358 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff60dc-f542-478f-bd23-24d7dff154ad None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:15.436068 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff60dc-f542-478f-bd23-24d7dff154ad None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:15.436369 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff60dc-f542-478f-bd23-24d7dff154ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:15.437743 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff60dc-f542-478f-bd23-24d7dff154ad None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:15.443099 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 494/1000] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Jun 29 12:09:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:09:15.448823 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a84a8f1-706c-4b03-a739-7af8f2603ed0 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:15.484346 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:15.553811 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a84a8f1-706c-4b03-a739-7af8f2603ed0 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:15.589739 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0a9bd-3872-4809-b892-ead389659e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:15.590421 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0a9bd-3872-4809-b892-ead389659e1c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:15.590702 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0a9bd-3872-4809-b892-ead389659e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:15.590974 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0a9bd-3872-4809-b892-ead389659e1c None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:15.591677 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d0a9bd-3872-4809-b892-ead389659e1c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:15.591977 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d0a9bd-3872-4809-b892-ead389659e1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:15.593340 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d0a9bd-3872-4809-b892-ead389659e1c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:15.598550 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 507/1001] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Jun 29 12:09:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:15.604192 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff60dc-f542-478f-bd23-24d7dff154ad None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:15.648959 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b4864-640f-4aa2-9664-05ef6b125727 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:15.649299 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b4864-640f-4aa2-9664-05ef6b125727 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:15.649519 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b4864-640f-4aa2-9664-05ef6b125727 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:15.651173 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 508/1002] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:09:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:09:15.655936 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e6e80-45ea-4d32-81c4-d527454b231f None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:15.656226 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e6e80-45ea-4d32-81c4-d527454b231f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:15.656495 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e6e80-45ea-4d32-81c4-d527454b231f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:15.673078 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-042e6e80-45ea-4d32-81c4-d527454b231f None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:09:15.674314 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-042e6e80-45ea-4d32-81c4-d527454b231f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:09:15.707711 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff60dc-f542-478f-bd23-24d7dff154ad None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:15.738258 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:15.744531 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 509/1003] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:09:15 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 12:09:15.744699 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c057efc8-53b4-4410-8ee8-91f2e43e40d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:15.745192 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057efc8-53b4-4410-8ee8-91f2e43e40d3 None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:15.745471 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057efc8-53b4-4410-8ee8-91f2e43e40d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:15.745856 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057efc8-53b4-4410-8ee8-91f2e43e40d3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:15.746519 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c057efc8-53b4-4410-8ee8-91f2e43e40d3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:15.747899 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c057efc8-53b4-4410-8ee8-91f2e43e40d3 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:15.763645 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 495/1004] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Jun 29 12:09:15 2022] POST /identity/v3/endpoints => generated 325 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:09:15.773107 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e6e80-45ea-4d32-81c4-d527454b231f None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:15.807781 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:15.896630 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e6e80-45ea-4d32-81c4-d527454b231f None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:15.944751 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f1f98c-fef8-49d1-9bea-fd715186447c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:15.945654 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1f98c-fef8-49d1-9bea-fd715186447c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:15.946077 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1f98c-fef8-49d1-9bea-fd715186447c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:15.946347 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1f98c-fef8-49d1-9bea-fd715186447c None admin] PATH_INFO: `/v3/services/image` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:15.946991 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f1f98c-fef8-49d1-9bea-fd715186447c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:15.948370 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f1f98c-fef8-49d1-9bea-fd715186447c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:15.961031 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-53f1f98c-fef8-49d1-9bea-fd715186447c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 12:09:15.961031 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:15.961031 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 12:09:15.961031 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 12:09:15.961031 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 12:09:15.961031 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 12:09:15.961031 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 12:09:15.961031 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:09:15.961031 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 12:09:15.961031 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:09:15.961031 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 12:09:15.961031 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:09:15.961031 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:15.961031 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:15.961031 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:15.961031 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:15.961031 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:15.962285 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:15.962285 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:15.962285 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:15.962285 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:15.962285 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:15.962285 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:15.962285 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 12:09:15.962285 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 12:09:15.962285 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 12:09:15.962285 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 12:09:15.962285 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:15.962285 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:15.962285 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:09:15.962285 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:09:15.962285 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:09:15.962285 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:09:15.963314 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:09:15.963314 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:09:15.963314 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:09:15.963314 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:09:15.963314 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:09:15.963314 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:09:15.963314 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:09:15.963314 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:09:15.963314 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:09:15.963314 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:09:15.963314 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 12:09:15.963314 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:09:15.963314 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 12:09:15.963314 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:09:15.963314 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 510/1005] 10.222.0.27 () {56 vars in 1105 bytes} [Wed Jun 29 12:09:15 2022] GET /identity/v3/services/image => generated 86 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:09:15.969580 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c057efc8-53b4-4410-8ee8-91f2e43e40d3 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:16.077075 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c057efc8-53b4-4410-8ee8-91f2e43e40d3 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:16.111159 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe05600-86c2-46cc-8e05-22ab23658f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:16.111812 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe05600-86c2-46cc-8e05-22ab23658f2e None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:16.112097 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe05600-86c2-46cc-8e05-22ab23658f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:16.112368 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe05600-86c2-46cc-8e05-22ab23658f2e None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:16.113079 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe05600-86c2-46cc-8e05-22ab23658f2e None admin] RBAC: Adding query filter params (name=image) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:16.113379 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe05600-86c2-46cc-8e05-22ab23658f2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:16.114793 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe05600-86c2-46cc-8e05-22ab23658f2e None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:16.120697 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 496/1006] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:09:15 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:16.126594 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f1f98c-fef8-49d1-9bea-fd715186447c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:16.225560 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:16.239399 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f1f98c-fef8-49d1-9bea-fd715186447c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:16.277826 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b392c-d878-48e5-8b09-a1e7539f7e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:16.278500 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b392c-d878-48e5-8b09-a1e7539f7e4c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:16.278780 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b392c-d878-48e5-8b09-a1e7539f7e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:16.279055 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b392c-d878-48e5-8b09-a1e7539f7e4c None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:16.279768 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36b392c-d878-48e5-8b09-a1e7539f7e4c None admin] RBAC: Adding query filter params (type=image) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:16.280075 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36b392c-d878-48e5-8b09-a1e7539f7e4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:16.281508 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36b392c-d878-48e5-8b09-a1e7539f7e4c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:16.286482 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 511/1007] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:09:16 2022] GET /identity/v3/services?type=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:16.815777 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb820d9-c4db-48b5-ac5e-3e490aa1e521 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:16.816145 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb820d9-c4db-48b5-ac5e-3e490aa1e521 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:16.816432 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb820d9-c4db-48b5-ac5e-3e490aa1e521 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:16.817912 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 497/1008] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:09:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:09:16.823483 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb9a10-2c47-44f4-aacb-633b3cd62c4b None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:16.823783 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb9a10-2c47-44f4-aacb-633b3cd62c4b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:16.824021 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb9a10-2c47-44f4-aacb-633b3cd62c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:16.841815 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-bbcb9a10-2c47-44f4-aacb-633b3cd62c4b None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:09:16.843004 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-bbcb9a10-2c47-44f4-aacb-633b3cd62c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:09:16.913222 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 512/1009] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:09:16 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 12:09:16.936421 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb820d9-c4db-48b5-ac5e-3e490aa1e521 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:17.001167 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:17.060634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb820d9-c4db-48b5-ac5e-3e490aa1e521 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:17.099778 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a73bc-2a83-4e52-a588-1780634a44e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:17.100520 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a73bc-2a83-4e52-a588-1780634a44e7 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:17.100841 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a73bc-2a83-4e52-a588-1780634a44e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:17.101306 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a73bc-2a83-4e52-a588-1780634a44e7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:17.102051 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9a73bc-2a83-4e52-a588-1780634a44e7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:17.103458 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9a73bc-2a83-4e52-a588-1780634a44e7 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:17.116028 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-2d9a73bc-2a83-4e52-a588-1780634a44e7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 12:09:17.116028 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:17.116028 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 12:09:17.116028 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 12:09:17.116028 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 12:09:17.116028 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 12:09:17.116028 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 12:09:17.116028 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:09:17.116028 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 12:09:17.116028 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:09:17.116028 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 12:09:17.116028 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:09:17.116028 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:17.116028 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:17.116028 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:17.116028 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:17.116028 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:17.117634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:17.117634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:17.117634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:17.117634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:17.117634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:17.117634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:17.117634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 12:09:17.117634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 12:09:17.117634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 12:09:17.117634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 12:09:17.117634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:17.117634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:17.117634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:09:17.117634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:09:17.117634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:09:17.117634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:09:17.118562 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:09:17.118562 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:09:17.118562 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:09:17.118562 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:09:17.118562 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:09:17.118562 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:09:17.118562 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:09:17.118562 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:09:17.118562 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:09:17.118562 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:09:17.118562 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 12:09:17.118562 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:09:17.118562 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 12:09:17.118562 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:09:17.118562 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 498/1010] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jun 29 12:09:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:09:17.126165 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb9a10-2c47-44f4-aacb-633b3cd62c4b None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:17.213822 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:17.233215 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb9a10-2c47-44f4-aacb-633b3cd62c4b None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:17.269334 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c5998-58fd-41f8-9188-0d056410fadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:17.270030 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c5998-58fd-41f8-9188-0d056410fadd None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:17.270310 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c5998-58fd-41f8-9188-0d056410fadd None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:17.270582 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c5998-58fd-41f8-9188-0d056410fadd None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:17.271296 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87c5998-58fd-41f8-9188-0d056410fadd None admin] RBAC: Adding query filter params (name=compute) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:17.271605 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87c5998-58fd-41f8-9188-0d056410fadd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:17.273054 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87c5998-58fd-41f8-9188-0d056410fadd None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:17.278435 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 513/1011] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Jun 29 12:09:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:17.283922 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a73bc-2a83-4e52-a588-1780634a44e7 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:17.387644 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a73bc-2a83-4e52-a588-1780634a44e7 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:17.413141 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:17.431242 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd258c1-8c56-4f65-af72-47dfde189e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:17.431931 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd258c1-8c56-4f65-af72-47dfde189e38 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:17.432210 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd258c1-8c56-4f65-af72-47dfde189e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:17.432482 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd258c1-8c56-4f65-af72-47dfde189e38 None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:17.433210 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd258c1-8c56-4f65-af72-47dfde189e38 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:17.433513 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd258c1-8c56-4f65-af72-47dfde189e38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:17.434957 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd258c1-8c56-4f65-af72-47dfde189e38 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:17.440836 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 499/1012] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Jun 29 12:09:17 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:17.446693 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c5998-58fd-41f8-9188-0d056410fadd None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:17.558444 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c5998-58fd-41f8-9188-0d056410fadd None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:17.594447 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c78df7-e248-4ae1-9062-e6a41dae6ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:17.595109 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c78df7-e248-4ae1-9062-e6a41dae6ebe None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:17.595390 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c78df7-e248-4ae1-9062-e6a41dae6ebe None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:17.595660 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c78df7-e248-4ae1-9062-e6a41dae6ebe None admin] PATH_INFO: `/v3/endpoints` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:17.596401 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c78df7-e248-4ae1-9062-e6a41dae6ebe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:17.597804 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c78df7-e248-4ae1-9062-e6a41dae6ebe None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:17.620846 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 514/1013] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Jun 29 12:09:17 2022] POST /identity/v3/endpoints => generated 334 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:09:17.889079 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d893147-5516-4327-a949-e32d36397876 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:17.889482 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d893147-5516-4327-a949-e32d36397876 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:17.889665 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d893147-5516-4327-a949-e32d36397876 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:17.891048 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 500/1014] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:09:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:09:17.896324 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abfc730-646f-4f93-8307-52faca1dd32c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:17.896608 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abfc730-646f-4f93-8307-52faca1dd32c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:17.896885 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abfc730-646f-4f93-8307-52faca1dd32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:17.902732 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:17.916390 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-5abfc730-646f-4f93-8307-52faca1dd32c None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:09:17.917580 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5abfc730-646f-4f93-8307-52faca1dd32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:09:17.995176 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 515/1015] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:09:17 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:09:18.018637 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d893147-5516-4327-a949-e32d36397876 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:18.132587 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d893147-5516-4327-a949-e32d36397876 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:18.168300 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75717f8-580a-49d4-a32b-d78f4b4a31ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:18.169002 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75717f8-580a-49d4-a32b-d78f4b4a31ee None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:18.169275 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75717f8-580a-49d4-a32b-d78f4b4a31ee None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:18.169542 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75717f8-580a-49d4-a32b-d78f4b4a31ee None admin] PATH_INFO: `/v3/domains/default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:18.172483 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75717f8-580a-49d4-a32b-d78f4b4a31ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:18.172483 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75717f8-580a-49d4-a32b-d78f4b4a31ee None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:18.173992 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 501/1016] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:09:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:18.179886 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abfc730-646f-4f93-8307-52faca1dd32c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:18.286029 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abfc730-646f-4f93-8307-52faca1dd32c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:18.314330 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:18.324599 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfac301-8c40-4c3e-9793-a4c47715b611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:18.325271 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfac301-8c40-4c3e-9793-a4c47715b611 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:18.325556 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfac301-8c40-4c3e-9793-a4c47715b611 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:18.325864 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfac301-8c40-4c3e-9793-a4c47715b611 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:18.326595 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfac301-8c40-4c3e-9793-a4c47715b611 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:18.328417 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfac301-8c40-4c3e-9793-a4c47715b611 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:18.353528 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417cbea-1001-4229-aa14-8491bafb2021 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:18.353898 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417cbea-1001-4229-aa14-8491bafb2021 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:18.354114 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417cbea-1001-4229-aa14-8491bafb2021 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:18.355659 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 502/1017] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:09:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:09:18.361937 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 516/1018] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Jun 29 12:09:18 2022] POST /identity/v3/projects => generated 311 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:09:18.362142 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01dccc8-128d-42d3-930a-cb4c1bfbefa5 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:18.362142 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01dccc8-128d-42d3-930a-cb4c1bfbefa5 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:18.362142 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01dccc8-128d-42d3-930a-cb4c1bfbefa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:18.379900 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-c01dccc8-128d-42d3-930a-cb4c1bfbefa5 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:09:18.381292 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-c01dccc8-128d-42d3-930a-cb4c1bfbefa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:09:18.436442 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:18.461735 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 503/1019] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:09:18 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (3 switches on core 0) Jun 29 12:09:18.484944 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfac301-8c40-4c3e-9793-a4c47715b611 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:18.592458 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfac301-8c40-4c3e-9793-a4c47715b611 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:18.627249 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e79c3-6d01-422d-a969-5e49447002a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:18.628009 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e79c3-6d01-422d-a969-5e49447002a6 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:18.628295 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e79c3-6d01-422d-a969-5e49447002a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:18.628571 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e79c3-6d01-422d-a969-5e49447002a6 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:18.629315 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4e79c3-6d01-422d-a969-5e49447002a6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:18.630787 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4e79c3-6d01-422d-a969-5e49447002a6 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:18.653734 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 517/1020] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Jun 29 12:09:18 2022] POST /identity/v3/services => generated 242 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:09:19.749269 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c5638-6d27-4e29-bb5c-04028d888217 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:19.749821 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c5638-6d27-4e29-bb5c-04028d888217 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:19.749821 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c5638-6d27-4e29-bb5c-04028d888217 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:19.751293 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 504/1021] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:09:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:09:19.756748 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e53af-b639-4e4f-b91c-372f277febbc None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:19.757205 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e53af-b639-4e4f-b91c-372f277febbc None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:19.757286 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e53af-b639-4e4f-b91c-372f277febbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:19.775066 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c56e53af-b639-4e4f-b91c-372f277febbc None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:09:19.776261 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c56e53af-b639-4e4f-b91c-372f277febbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:09:19.815589 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:19.858074 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 518/1022] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:09:19 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:09:19.881595 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c5638-6d27-4e29-bb5c-04028d888217 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:19.991138 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c5638-6d27-4e29-bb5c-04028d888217 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:20.034532 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd375991-b917-439a-9a5b-fd357bbee2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:20.035285 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd375991-b917-439a-9a5b-fd357bbee2db None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:20.035562 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd375991-b917-439a-9a5b-fd357bbee2db None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:20.035832 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd375991-b917-439a-9a5b-fd357bbee2db None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:20.049260 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd375991-b917-439a-9a5b-fd357bbee2db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:09:20.054866 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-dd375991-b917-439a-9a5b-fd357bbee2db None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 12:09:20.054866 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:20.054866 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:20.054866 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:20.054866 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:20.054866 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:20.054866 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:20.054866 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:20.054866 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:20.054866 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:20.054866 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:20.054866 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:20.054866 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:09:20.054866 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:09:20.054866 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:09:20.054866 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:09:20.055816 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:09:20.055816 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:09:20.055816 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:09:20.055816 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:09:20.055816 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:20.055816 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:20.055816 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:09:20.055816 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:09:20.055816 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:09:20.055816 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:09:20.055816 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:09:20.055816 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:09:20.055816 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:09:20.055816 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:09:20.055816 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:09:20.055816 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:09:20.057185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:09:20.057185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:09:20.057185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:09:20.057185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:09:20.057185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:09:20.057185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:09:20.057185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:09:20.057185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:09:20.057185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:09:20.057185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:09:20.057185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 12:09:20.057185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:09:20.057185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 505/1023] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Jun 29 12:09:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:09:20.062500 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56e53af-b639-4e4f-b91c-372f277febbc None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:20.168900 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56e53af-b639-4e4f-b91c-372f277febbc None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:20.206209 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0976a-f901-4088-824c-0b96d87b91de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:20.206881 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0976a-f901-4088-824c-0b96d87b91de None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:20.207163 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0976a-f901-4088-824c-0b96d87b91de None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:20.207433 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0976a-f901-4088-824c-0b96d87b91de None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:20.208178 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd0976a-f901-4088-824c-0b96d87b91de None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:20.208481 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd0976a-f901-4088-824c-0b96d87b91de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:20.209919 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd0976a-f901-4088-824c-0b96d87b91de None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:20.218688 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 519/1024] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Jun 29 12:09:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:20.224420 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd375991-b917-439a-9a5b-fd357bbee2db None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:20.273310 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:20.336207 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd375991-b917-439a-9a5b-fd357bbee2db None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:20.371794 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405d862-1d1d-4a2d-9db1-ce56d60772df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:20.372605 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405d862-1d1d-4a2d-9db1-ce56d60772df None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:20.372887 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405d862-1d1d-4a2d-9db1-ce56d60772df None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:20.373163 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405d862-1d1d-4a2d-9db1-ce56d60772df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:20.384179 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a405d862-1d1d-4a2d-9db1-ce56d60772df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:20.385658 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a405d862-1d1d-4a2d-9db1-ce56d60772df None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:20.403302 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-a405d862-1d1d-4a2d-9db1-ce56d60772df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:09:20.403302 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:20.403302 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:20.403302 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:20.403302 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:20.403302 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:20.403302 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:20.403302 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:20.403302 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:20.403302 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:20.403302 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:20.403302 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:20.403302 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:09:20.403302 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:09:20.403302 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:09:20.404257 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:09:20.404257 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:20.404257 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:20.404257 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:09:20.404257 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:09:20.404257 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:09:20.404257 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:09:20.404257 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:09:20.404257 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:09:20.404257 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:09:20.404257 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:09:20.404257 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:09:20.404257 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:09:20.404257 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:09:20.404257 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:09:20.404257 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:09:20.404257 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:09:20.410056 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:09:20.410056 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:09:20.410056 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:09:20.410056 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:09:20.410056 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 506/1025] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:09:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:09:20.412011 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0976a-f901-4088-824c-0b96d87b91de None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:20.442773 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:20.479589 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d532f07-16df-4d34-9460-81268539b012 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:20.479947 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d532f07-16df-4d34-9460-81268539b012 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:20.480111 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d532f07-16df-4d34-9460-81268539b012 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:20.485170 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 507/1026] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:09:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:09:20.487333 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55064000-6e80-4455-8db0-25af97569757 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:20.487659 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55064000-6e80-4455-8db0-25af97569757 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:20.487904 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55064000-6e80-4455-8db0-25af97569757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:20.508715 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-55064000-6e80-4455-8db0-25af97569757 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:09:20.510410 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-55064000-6e80-4455-8db0-25af97569757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:09:20.521916 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0976a-f901-4088-824c-0b96d87b91de None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:20.559039 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3dd222-86a0-404f-9255-df6e45a8ad04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:20.559759 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3dd222-86a0-404f-9255-df6e45a8ad04 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:20.560062 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3dd222-86a0-404f-9255-df6e45a8ad04 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:20.560333 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3dd222-86a0-404f-9255-df6e45a8ad04 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:20.561059 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3dd222-86a0-404f-9255-df6e45a8ad04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:20.561360 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3dd222-86a0-404f-9255-df6e45a8ad04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:20.562766 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3dd222-86a0-404f-9255-df6e45a8ad04 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:20.576051 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 520/1027] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:09:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:09:20.581937 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3dd222-86a0-404f-9255-df6e45a8ad04 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:20.582391 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 508/1028] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:09:20 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 12:09:20.608268 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55064000-6e80-4455-8db0-25af97569757 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:20.634352 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:20.683008 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:20.697267 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3dd222-86a0-404f-9255-df6e45a8ad04 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:20.720858 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55064000-6e80-4455-8db0-25af97569757 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:20.732328 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c80305-7ba8-46ad-9642-dfb956b1c0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:20.733133 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c80305-7ba8-46ad-9642-dfb956b1c0be None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:20.733410 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c80305-7ba8-46ad-9642-dfb956b1c0be None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:20.733680 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c80305-7ba8-46ad-9642-dfb956b1c0be None admin] PATH_INFO: `/v3/users/nova` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:20.741820 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c80305-7ba8-46ad-9642-dfb956b1c0be None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:20.743281 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c80305-7ba8-46ad-9642-dfb956b1c0be None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:20.755360 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d1e29-fa06-431e-9ea2-765a6c86a5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:20.756153 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d1e29-fa06-431e-9ea2-765a6c86a5fe None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:20.756431 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d1e29-fa06-431e-9ea2-765a6c86a5fe None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:20.756796 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d1e29-fa06-431e-9ea2-765a6c86a5fe None admin] PATH_INFO: `/v3/domains/default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:20.757712 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-c6c80305-7ba8-46ad-9642-dfb956b1c0be None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 12:09:20.757712 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:20.757712 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:20.757712 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:20.757712 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:20.757712 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:20.757712 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:20.757712 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:20.757712 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:20.757712 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:20.757712 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:20.757712 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:20.757712 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:09:20.757712 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:09:20.757712 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:09:20.757712 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:09:20.759107 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:20.759107 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:20.759107 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:09:20.759107 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:09:20.759107 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:09:20.759107 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:09:20.759107 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:09:20.759107 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:09:20.759107 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:09:20.759107 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:09:20.759107 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:09:20.759107 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:09:20.759107 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:09:20.759107 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:09:20.759107 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:09:20.759107 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:09:20.759107 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:09:20.759107 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:09:20.760229 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:09:20.760229 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:09:20.760229 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:09:20.760229 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:09:20.760229 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:09:20.760229 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:09:20.760229 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:09:20.760229 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:09:20.760229 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 12:09:20.760229 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:09:20.760229 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 521/1029] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Jun 29 12:09:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:09:20.760229 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2a478-b9c7-438c-84e4-27d4b95e301c None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:20.760916 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2a478-b9c7-438c-84e4-27d4b95e301c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:20.760916 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2a478-b9c7-438c-84e4-27d4b95e301c None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:20.761049 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28d1e29-fa06-431e-9ea2-765a6c86a5fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:20.762110 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 522/1030] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:09:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:09:20.762320 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28d1e29-fa06-431e-9ea2-765a6c86a5fe None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:20.764210 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 509/1031] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:09:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:09:20.766697 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f2a478-b9c7-438c-84e4-27d4b95e301c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:20.767240 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720557be-dcbb-458f-a75e-7d8a07f6e383 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:20.767521 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720557be-dcbb-458f-a75e-7d8a07f6e383 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:20.767792 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720557be-dcbb-458f-a75e-7d8a07f6e383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:20.784711 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-720557be-dcbb-458f-a75e-7d8a07f6e383 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:09:20.785951 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-720557be-dcbb-458f-a75e-7d8a07f6e383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:09:20.855574 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 510/1032] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:09:20 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:09:20.856469 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720557be-dcbb-458f-a75e-7d8a07f6e383 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:20.869776 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f2a478-b9c7-438c-84e4-27d4b95e301c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:20.881415 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:20.907427 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41239e87-e655-4a67-8362-227de7f02458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:20.908100 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41239e87-e655-4a67-8362-227de7f02458 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:20.908414 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41239e87-e655-4a67-8362-227de7f02458 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:20.908660 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41239e87-e655-4a67-8362-227de7f02458 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:20.909490 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41239e87-e655-4a67-8362-227de7f02458 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:20.909826 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41239e87-e655-4a67-8362-227de7f02458 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:20.911253 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41239e87-e655-4a67-8362-227de7f02458 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:20.928259 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 523/1033] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Jun 29 12:09:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:20.929049 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41239e87-e655-4a67-8362-227de7f02458 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:20.941249 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:20.961062 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720557be-dcbb-458f-a75e-7d8a07f6e383 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:20.997076 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea6618-d217-473d-814d-e00d7524da2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:20.997771 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea6618-d217-473d-814d-e00d7524da2a None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:20.998048 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea6618-d217-473d-814d-e00d7524da2a None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:20.998317 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea6618-d217-473d-814d-e00d7524da2a None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:20.999017 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ea6618-d217-473d-814d-e00d7524da2a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:21.000456 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ea6618-d217-473d-814d-e00d7524da2a None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:21.022889 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 511/1034] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Jun 29 12:09:20 2022] POST /identity/v3/users => generated 285 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:09:21.023726 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea6618-d217-473d-814d-e00d7524da2a None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:21.038673 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41239e87-e655-4a67-8362-227de7f02458 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:21.084152 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc7606-f05d-4545-a88c-75a590d7dc8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:21.085596 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc7606-f05d-4545-a88c-75a590d7dc8e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:21.086160 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc7606-f05d-4545-a88c-75a590d7dc8e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:21.086576 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc7606-f05d-4545-a88c-75a590d7dc8e None admin] PATH_INFO: `/v3/services/image` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:21.087420 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bc7606-f05d-4545-a88c-75a590d7dc8e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:21.088978 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bc7606-f05d-4545-a88c-75a590d7dc8e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:21.102166 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-d6bc7606-f05d-4545-a88c-75a590d7dc8e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 12:09:21.102166 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:21.102166 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 12:09:21.102166 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 12:09:21.102166 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 12:09:21.102166 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 12:09:21.102166 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 12:09:21.102166 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:09:21.102166 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 12:09:21.102166 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:09:21.102166 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 12:09:21.102166 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:09:21.102166 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:21.102166 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:21.102166 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:21.102166 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:21.102166 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:21.103448 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:21.103448 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:21.103448 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:21.103448 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:21.103448 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:21.103448 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:21.103448 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 12:09:21.103448 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 12:09:21.103448 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 12:09:21.103448 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 12:09:21.103448 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:21.103448 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:21.103448 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:09:21.103448 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:09:21.103448 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:09:21.103448 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:09:21.104515 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:09:21.104515 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:09:21.104515 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:09:21.104515 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:09:21.104515 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:09:21.104515 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:09:21.104515 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:09:21.104515 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:09:21.104515 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:09:21.104515 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:09:21.104515 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 12:09:21.104515 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:09:21.104515 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 12:09:21.104515 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:09:21.106802 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 524/1035] 10.222.0.27 () {56 vars in 1105 bytes} [Wed Jun 29 12:09:20 2022] GET /identity/v3/services/image => generated 86 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:09:21.113061 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc7606-f05d-4545-a88c-75a590d7dc8e None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:21.119674 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:21.146610 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea6618-d217-473d-814d-e00d7524da2a None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:21.184219 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a90d84-9a86-4af0-a656-eabe5474f31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:21.184896 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a90d84-9a86-4af0-a656-eabe5474f31c None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:21.185181 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a90d84-9a86-4af0-a656-eabe5474f31c None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:21.185457 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a90d84-9a86-4af0-a656-eabe5474f31c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:21.196353 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:21.234137 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc7606-f05d-4545-a88c-75a590d7dc8e None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:21.264743 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a90d84-9a86-4af0-a656-eabe5474f31c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:21.266400 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a90d84-9a86-4af0-a656-eabe5474f31c None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:21.270939 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc7efe-109e-485d-aa5b-cecd646678ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:21.271617 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc7efe-109e-485d-aa5b-cecd646678ff None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:21.271901 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc7efe-109e-485d-aa5b-cecd646678ff None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:21.272175 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc7efe-109e-485d-aa5b-cecd646678ff None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:21.272936 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc7efe-109e-485d-aa5b-cecd646678ff None admin] RBAC: Adding query filter params (name=image) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:21.273244 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc7efe-109e-485d-aa5b-cecd646678ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:21.274788 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc7efe-109e-485d-aa5b-cecd646678ff None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:21.280442 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 525/1036] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:09:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:21.286317 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc7efe-109e-485d-aa5b-cecd646678ff None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:21.349368 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:21.374015 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 512/1037] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:09:21 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 12:09:21.382386 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a90d84-9a86-4af0-a656-eabe5474f31c None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:21.394731 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc7efe-109e-485d-aa5b-cecd646678ff None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:21.430130 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab757e3b-2807-406b-a124-ddff0e070283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:21.430721 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab757e3b-2807-406b-a124-ddff0e070283 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:21.431007 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab757e3b-2807-406b-a124-ddff0e070283 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:21.431281 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab757e3b-2807-406b-a124-ddff0e070283 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:21.431994 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab757e3b-2807-406b-a124-ddff0e070283 None admin] RBAC: Adding query filter params (type=image) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:21.432297 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab757e3b-2807-406b-a124-ddff0e070283 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:21.433671 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab757e3b-2807-406b-a124-ddff0e070283 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:21.435411 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:21.444905 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 526/1038] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:09:21 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:09:21.446192 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab757e3b-2807-406b-a124-ddff0e070283 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:21.496156 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a90d84-9a86-4af0-a656-eabe5474f31c None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:21.532911 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51737400-af5d-4127-a423-0467de82ea16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:21.534119 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51737400-af5d-4127-a423-0467de82ea16 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:21.534400 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51737400-af5d-4127-a423-0467de82ea16 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:21.534675 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51737400-af5d-4127-a423-0467de82ea16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:21.546017 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51737400-af5d-4127-a423-0467de82ea16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:21.547488 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51737400-af5d-4127-a423-0467de82ea16 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:21.552086 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab757e3b-2807-406b-a124-ddff0e070283 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:21.565159 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-51737400-af5d-4127-a423-0467de82ea16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:09:21.565159 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:21.565159 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:21.565159 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:21.565159 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:21.565159 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:21.565159 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:21.565159 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:21.565159 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:21.565159 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:21.565159 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:21.565159 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:21.565159 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:09:21.565159 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:09:21.565159 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:09:21.566178 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:09:21.566178 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:21.566178 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:21.566178 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:09:21.566178 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:09:21.566178 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:09:21.566178 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:09:21.566178 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:09:21.566178 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:09:21.566178 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:09:21.566178 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:09:21.566178 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:09:21.566178 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:09:21.566178 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:09:21.566178 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:09:21.566178 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:09:21.566178 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:09:21.567934 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:09:21.567934 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:09:21.567934 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:09:21.567934 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:09:21.567934 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 513/1039] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:09:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:09:21.571993 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51737400-af5d-4127-a423-0467de82ea16 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:21.589897 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef50212a-e050-4fc6-9594-cd235c33b34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:21.590561 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50212a-e050-4fc6-9594-cd235c33b34c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:21.590851 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50212a-e050-4fc6-9594-cd235c33b34c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:21.591127 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50212a-e050-4fc6-9594-cd235c33b34c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:21.591933 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef50212a-e050-4fc6-9594-cd235c33b34c None admin] RBAC: Adding query filter params (interface=public, service_id=4724935ed4144c4a89ee40a68c013aee, region_id=RegionOne) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:21.592246 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef50212a-e050-4fc6-9594-cd235c33b34c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:21.593629 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef50212a-e050-4fc6-9594-cd235c33b34c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:21.603674 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 527/1040] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Jun 29 12:09:21 2022] GET /identity/v3/endpoints?service_id=4724935ed4144c4a89ee40a68c013aee&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:09:21.604124 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:21.604562 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef50212a-e050-4fc6-9594-cd235c33b34c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:21.670180 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:21.679380 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51737400-af5d-4127-a423-0467de82ea16 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:21.714157 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef50212a-e050-4fc6-9594-cd235c33b34c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:21.718881 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc8b34-b412-47a3-b21b-a97b36db6f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:21.719557 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc8b34-b412-47a3-b21b-a97b36db6f64 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:21.719837 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc8b34-b412-47a3-b21b-a97b36db6f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:21.720106 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc8b34-b412-47a3-b21b-a97b36db6f64 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:21.720826 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fc8b34-b412-47a3-b21b-a97b36db6f64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:21.721130 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fc8b34-b412-47a3-b21b-a97b36db6f64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:21.722965 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fc8b34-b412-47a3-b21b-a97b36db6f64 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:21.741915 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 514/1041] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:09:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:09:21.743453 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc8b34-b412-47a3-b21b-a97b36db6f64 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:21.747904 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf23b9-2469-451f-b91c-0a697b4de966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:21.748578 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf23b9-2469-451f-b91c-0a697b4de966 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:21.748861 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf23b9-2469-451f-b91c-0a697b4de966 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:21.749146 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf23b9-2469-451f-b91c-0a697b4de966 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:21.749867 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf23b9-2469-451f-b91c-0a697b4de966 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:21.751241 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf23b9-2469-451f-b91c-0a697b4de966 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:21.757891 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 528/1042] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Jun 29 12:09:21 2022] GET /identity/v3/services => generated 1957 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:09:21.856045 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:21.868908 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc8b34-b412-47a3-b21b-a97b36db6f64 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:21.905372 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53b2e0-063e-4e4d-9ca3-c79b4f0bfa55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:21.906229 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53b2e0-063e-4e4d-9ca3-c79b4f0bfa55 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:21.906508 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53b2e0-063e-4e4d-9ca3-c79b4f0bfa55 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:21.906777 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53b2e0-063e-4e4d-9ca3-c79b4f0bfa55 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:21.914678 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d53b2e0-063e-4e4d-9ca3-c79b4f0bfa55 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:21.916137 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d53b2e0-063e-4e4d-9ca3-c79b4f0bfa55 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:21.930936 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-1d53b2e0-063e-4e4d-9ca3-c79b4f0bfa55 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:09:21.930936 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:21.930936 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:21.930936 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:21.930936 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:21.930936 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:21.930936 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:21.930936 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:21.930936 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:21.930936 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:21.930936 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:21.930936 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:21.930936 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:09:21.930936 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:09:21.930936 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:09:21.931884 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:09:21.931884 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:21.931884 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:21.931884 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:09:21.931884 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:09:21.931884 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:09:21.931884 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:09:21.931884 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:09:21.931884 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:09:21.931884 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:09:21.931884 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:09:21.931884 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:09:21.931884 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:09:21.931884 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:09:21.931884 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:09:21.931884 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:09:21.931884 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:09:21.932803 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:09:21.932803 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:09:21.932803 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:09:21.932803 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:09:21.932803 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:09:21.932803 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:09:21.932803 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:09:21.932803 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:09:21.932803 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 515/1043] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jun 29 12:09:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:09:21.938219 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf23b9-2469-451f-b91c-0a697b4de966 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:22.049134 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf23b9-2469-451f-b91c-0a697b4de966 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:22.075439 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:22.086526 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31e2ed-2ca1-4215-b1c1-ced614731b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:22.087351 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31e2ed-2ca1-4215-b1c1-ced614731b62 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:22.087737 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31e2ed-2ca1-4215-b1c1-ced614731b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:22.088140 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31e2ed-2ca1-4215-b1c1-ced614731b62 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:22.089044 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c31e2ed-2ca1-4215-b1c1-ced614731b62 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:22.089462 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c31e2ed-2ca1-4215-b1c1-ced614731b62 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:22.091030 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c31e2ed-2ca1-4215-b1c1-ced614731b62 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:22.108903 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 529/1044] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jun 29 12:09:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:22.110579 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53b2e0-063e-4e4d-9ca3-c79b4f0bfa55 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:22.220643 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53b2e0-063e-4e4d-9ca3-c79b4f0bfa55 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:22.257090 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d785e0-fc4f-4b65-9d51-8f0c782d0f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:22.257749 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d785e0-fc4f-4b65-9d51-8f0c782d0f04 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:22.258049 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d785e0-fc4f-4b65-9d51-8f0c782d0f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:22.258322 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d785e0-fc4f-4b65-9d51-8f0c782d0f04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:22.259152 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d785e0-fc4f-4b65-9d51-8f0c782d0f04 None admin] RBAC: Adding query filter params (role.id=21cea97c141c42a18f5c161141c2a781, scope.project.id=996db30845f84e57865fa40b9a730a05, user.id=7adaa2ef440941aa8214f2b2fd49b54e) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:22.259461 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d785e0-fc4f-4b65-9d51-8f0c782d0f04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:22.260913 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d785e0-fc4f-4b65-9d51-8f0c782d0f04 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:22.267051 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 516/1045] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jun 29 12:09:22 2022] GET /identity/v3/role_assignments?user.id=7adaa2ef440941aa8214f2b2fd49b54e&scope.project.id=996db30845f84e57865fa40b9a730a05&role.id=21cea97c141c42a18f5c161141c2a781 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:23.146097 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c38446-e3e2-498f-8f60-a6267ac45d54 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:23.146622 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c38446-e3e2-498f-8f60-a6267ac45d54 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:23.146622 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c38446-e3e2-498f-8f60-a6267ac45d54 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:23.148446 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 530/1046] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:09:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:09:23.154001 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5da9a-764a-4e8c-af6c-19cba6b15210 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:23.154437 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5da9a-764a-4e8c-af6c-19cba6b15210 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:23.154530 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5da9a-764a-4e8c-af6c-19cba6b15210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:23.172272 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-8ab5da9a-764a-4e8c-af6c-19cba6b15210 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:09:23.173476 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-8ab5da9a-764a-4e8c-af6c-19cba6b15210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:09:23.188196 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:23.274061 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 517/1047] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:09:23 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:09:23.291609 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c38446-e3e2-498f-8f60-a6267ac45d54 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:23.402182 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c38446-e3e2-498f-8f60-a6267ac45d54 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:23.443730 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f83e21e-8b9c-4a15-ab59-a979000c4445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:23.445470 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83e21e-8b9c-4a15-ab59-a979000c4445 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:23.445778 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83e21e-8b9c-4a15-ab59-a979000c4445 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:23.446054 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83e21e-8b9c-4a15-ab59-a979000c4445 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:23.458142 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f83e21e-8b9c-4a15-ab59-a979000c4445 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:09:23.469424 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-4f83e21e-8b9c-4a15-ab59-a979000c4445 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:09:23.469424 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:23.469424 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:23.469424 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:23.469424 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:23.469424 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:23.469424 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:23.469424 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:23.469424 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:23.469424 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:23.469424 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:23.469424 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:23.469424 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:09:23.469424 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:09:23.469424 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:09:23.469424 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:09:23.470436 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:09:23.470436 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:09:23.470436 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:09:23.470436 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:09:23.470436 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:23.470436 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:23.470436 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:09:23.470436 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:09:23.470436 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:09:23.470436 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:09:23.470436 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:09:23.470436 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:09:23.470436 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:09:23.470436 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:09:23.470436 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:09:23.470436 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:09:23.471296 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:09:23.471296 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:09:23.471296 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:09:23.471296 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:09:23.471296 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:09:23.471296 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:09:23.471296 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:09:23.471296 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:09:23.471296 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:09:23.471296 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:09:23.471296 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:09:23.471296 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:09:23.473943 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 531/1048] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jun 29 12:09:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:09:23.477628 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab5da9a-764a-4e8c-af6c-19cba6b15210 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:23.590084 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab5da9a-764a-4e8c-af6c-19cba6b15210 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:23.625672 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc4f36-263b-405c-b8fd-d05b7d1b1c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:23.626369 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc4f36-263b-405c-b8fd-d05b7d1b1c49 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:23.626645 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc4f36-263b-405c-b8fd-d05b7d1b1c49 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:23.626917 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc4f36-263b-405c-b8fd-d05b7d1b1c49 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:23.627667 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcc4f36-263b-405c-b8fd-d05b7d1b1c49 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:23.627967 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcc4f36-263b-405c-b8fd-d05b7d1b1c49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:23.629335 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcc4f36-263b-405c-b8fd-d05b7d1b1c49 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:23.638473 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 518/1049] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:09:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:23.644067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f83e21e-8b9c-4a15-ab59-a979000c4445 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:23.696211 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:23.754681 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f83e21e-8b9c-4a15-ab59-a979000c4445 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:23.790019 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7ae1f-7b0f-4001-80a3-5cb30c97fbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:23.790901 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7ae1f-7b0f-4001-80a3-5cb30c97fbcf None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:23.791174 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7ae1f-7b0f-4001-80a3-5cb30c97fbcf None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:23.791446 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7ae1f-7b0f-4001-80a3-5cb30c97fbcf None admin] PATH_INFO: `/v3/users/75e5b85bd9824ea0ab28bed0ccf460fa` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:23.805683 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e7ae1f-7b0f-4001-80a3-5cb30c97fbcf None admin] RBAC: Authorizing `identity:get_user(user_id=75e5b85bd9824ea0ab28bed0ccf460fa)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:23.807157 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e7ae1f-7b0f-4001-80a3-5cb30c97fbcf None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:23.809030 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 532/1050] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jun 29 12:09:23 2022] GET /identity/v3/users/75e5b85bd9824ea0ab28bed0ccf460fa => generated 285 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:23.814666 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc4f36-263b-405c-b8fd-d05b7d1b1c49 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:23.824452 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:23.861631 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779ee2e-a8ae-4cc4-a19c-9c2e8b0926d3 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:23.862006 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779ee2e-a8ae-4cc4-a19c-9c2e8b0926d3 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:23.862246 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779ee2e-a8ae-4cc4-a19c-9c2e8b0926d3 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:23.863955 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 533/1051] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:09:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:09:23.869101 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c4fb2-8acf-48bf-8f2b-605fc56eec45 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:23.869357 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c4fb2-8acf-48bf-8f2b-605fc56eec45 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:23.869650 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c4fb2-8acf-48bf-8f2b-605fc56eec45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:23.887603 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-893c4fb2-8acf-48bf-8f2b-605fc56eec45 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:09:23.888794 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-893c4fb2-8acf-48bf-8f2b-605fc56eec45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:09:23.925171 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc4f36-263b-405c-b8fd-d05b7d1b1c49 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:23.961235 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26a1a03-22a0-4a83-b0b4-8d41eb7b1e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:23.961891 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a1a03-22a0-4a83-b0b4-8d41eb7b1e71 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:23.962174 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a1a03-22a0-4a83-b0b4-8d41eb7b1e71 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:23.962443 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a1a03-22a0-4a83-b0b4-8d41eb7b1e71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:23.974118 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 534/1052] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:09:23 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 12:09:23.990166 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c4fb2-8acf-48bf-8f2b-605fc56eec45 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:24.035944 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26a1a03-22a0-4a83-b0b4-8d41eb7b1e71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:24.036709 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:24.038183 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26a1a03-22a0-4a83-b0b4-8d41eb7b1e71 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:24.046381 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:24.117294 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c4fb2-8acf-48bf-8f2b-605fc56eec45 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:24.143286 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 519/1053] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:09:23 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 12:09:24.149609 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26a1a03-22a0-4a83-b0b4-8d41eb7b1e71 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:24.161048 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c3b500-be04-48cc-9973-673537dd9c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:24.162655 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c3b500-be04-48cc-9973-673537dd9c34 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:24.163149 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c3b500-be04-48cc-9973-673537dd9c34 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:24.163695 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c3b500-be04-48cc-9973-673537dd9c34 None admin] PATH_INFO: `/v3/services/image` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:24.164870 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c3b500-be04-48cc-9973-673537dd9c34 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:24.166903 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c3b500-be04-48cc-9973-673537dd9c34 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:24.181994 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-47c3b500-be04-48cc-9973-673537dd9c34 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 12:09:24.181994 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:24.181994 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 12:09:24.181994 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 12:09:24.181994 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 12:09:24.181994 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 12:09:24.181994 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 12:09:24.181994 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:09:24.181994 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 12:09:24.181994 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:09:24.181994 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 12:09:24.181994 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:09:24.181994 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:24.181994 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:24.181994 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:24.181994 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:24.181994 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:24.183267 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:24.183267 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:24.183267 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:24.183267 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:24.183267 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:24.183267 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:24.183267 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 12:09:24.183267 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 12:09:24.183267 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 12:09:24.183267 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 12:09:24.183267 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:24.183267 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:24.183267 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:09:24.183267 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:09:24.183267 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:09:24.183267 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:09:24.184336 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:09:24.184336 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:09:24.184336 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:09:24.184336 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:09:24.184336 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:09:24.184336 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:09:24.184336 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:09:24.184336 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:09:24.184336 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:09:24.184336 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:09:24.184336 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 12:09:24.184336 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:09:24.184336 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 12:09:24.184336 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:09:24.192614 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 535/1054] 10.222.0.27 () {56 vars in 1105 bytes} [Wed Jun 29 12:09:23 2022] GET /identity/v3/services/image => generated 86 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:09:24.193305 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c3b500-be04-48cc-9973-673537dd9c34 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:24.258500 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26a1a03-22a0-4a83-b0b4-8d41eb7b1e71 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:24.266637 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:24.293343 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac76b8-9911-44b6-841a-dd16ce43f7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:24.293594 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:24.294319 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac76b8-9911-44b6-841a-dd16ce43f7f3 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:24.294700 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac76b8-9911-44b6-841a-dd16ce43f7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:24.294967 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac76b8-9911-44b6-841a-dd16ce43f7f3 None admin] PATH_INFO: `/v3/projects/fba748115e844a2e9477cdbf52b94ee8` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:24.296233 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ac76b8-9911-44b6-841a-dd16ce43f7f3 None admin] RBAC: Authorizing `identity:get_project(project_id=fba748115e844a2e9477cdbf52b94ee8)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:24.297670 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ac76b8-9911-44b6-841a-dd16ce43f7f3 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:24.297808 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c3b500-be04-48cc-9973-673537dd9c34 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:24.299476 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 520/1055] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jun 29 12:09:24 2022] GET /identity/v3/projects/fba748115e844a2e9477cdbf52b94ee8 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:24.300642 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b08bda-0041-47dd-86a3-32c7ed215d98 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:24.300919 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b08bda-0041-47dd-86a3-32c7ed215d98 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:24.301196 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b08bda-0041-47dd-86a3-32c7ed215d98 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:24.302593 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 521/1056] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:09:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:09:24.306570 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b08bda-0041-47dd-86a3-32c7ed215d98 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:24.333594 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f286bb-f39e-43ef-9a46-b06e3786a2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:24.334286 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f286bb-f39e-43ef-9a46-b06e3786a2a2 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:24.334564 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f286bb-f39e-43ef-9a46-b06e3786a2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:24.334852 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f286bb-f39e-43ef-9a46-b06e3786a2a2 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:24.335704 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f286bb-f39e-43ef-9a46-b06e3786a2a2 None admin] RBAC: Adding query filter params (name=image) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:24.336063 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f286bb-f39e-43ef-9a46-b06e3786a2a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:24.337429 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f286bb-f39e-43ef-9a46-b06e3786a2a2 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:24.342411 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 536/1057] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:09:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:09:24.343607 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b8efc-5a45-4492-a4c9-17c9e7d52929 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:24.343895 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b8efc-5a45-4492-a4c9-17c9e7d52929 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:24.344174 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b8efc-5a45-4492-a4c9-17c9e7d52929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:24.360100 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-1f1b8efc-5a45-4492-a4c9-17c9e7d52929 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:09:24.361304 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1f1b8efc-5a45-4492-a4c9-17c9e7d52929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:09:24.412512 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b08bda-0041-47dd-86a3-32c7ed215d98 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:24.426698 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 537/1058] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:09:24 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:09:24.427528 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b8efc-5a45-4492-a4c9-17c9e7d52929 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:24.447410 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008b1595-d17b-4ed5-b022-8515f504a7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:24.448290 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b1595-d17b-4ed5-b022-8515f504a7b1 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:24.448731 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b1595-d17b-4ed5-b022-8515f504a7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:24.449009 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b1595-d17b-4ed5-b022-8515f504a7b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:24.449885 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008b1595-d17b-4ed5-b022-8515f504a7b1 None admin] RBAC: Adding query filter params (role.id=e0e69ac8a8bf4cc4baa6aa18f2fc9919, scope.project.id=fba748115e844a2e9477cdbf52b94ee8, user.id=75e5b85bd9824ea0ab28bed0ccf460fa) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:24.450203 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008b1595-d17b-4ed5-b022-8515f504a7b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:24.451998 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008b1595-d17b-4ed5-b022-8515f504a7b1 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:24.465732 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 522/1059] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jun 29 12:09:24 2022] GET /identity/v3/role_assignments?user.id=75e5b85bd9824ea0ab28bed0ccf460fa&scope.project.id=fba748115e844a2e9477cdbf52b94ee8&role.id=e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:24.465732 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008b1595-d17b-4ed5-b022-8515f504a7b1 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:24.506058 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:24.540052 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:24.552648 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b8efc-5a45-4492-a4c9-17c9e7d52929 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:24.582428 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008b1595-d17b-4ed5-b022-8515f504a7b1 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:24.592791 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b560d83-0ce7-43c4-ad17-3d5b23296ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:24.593585 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b560d83-0ce7-43c4-ad17-3d5b23296ef0 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:24.593899 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b560d83-0ce7-43c4-ad17-3d5b23296ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:24.594174 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b560d83-0ce7-43c4-ad17-3d5b23296ef0 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:24.594939 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b560d83-0ce7-43c4-ad17-3d5b23296ef0 None admin] RBAC: Adding query filter params (type=image) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:24.595304 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b560d83-0ce7-43c4-ad17-3d5b23296ef0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:24.596719 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b560d83-0ce7-43c4-ad17-3d5b23296ef0 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:24.607720 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 538/1060] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:09:24 2022] GET /identity/v3/services?type=image => generated 350 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:24.608882 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b560d83-0ce7-43c4-ad17-3d5b23296ef0 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:24.624536 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d661cf68-9017-457e-a2cb-7344f5d227a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:24.625723 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661cf68-9017-457e-a2cb-7344f5d227a0 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:24.625723 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661cf68-9017-457e-a2cb-7344f5d227a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:24.625918 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661cf68-9017-457e-a2cb-7344f5d227a0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:24.637111 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d661cf68-9017-457e-a2cb-7344f5d227a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:09:24.645386 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-d661cf68-9017-457e-a2cb-7344f5d227a0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 12:09:24.645386 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:24.645386 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:24.645386 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:24.645386 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:24.645386 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:24.645386 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:24.645386 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:24.645386 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:24.645386 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:24.645386 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:24.645386 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:24.645386 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:09:24.645386 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:09:24.645386 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:09:24.645386 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:09:24.646583 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:09:24.646583 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:09:24.646583 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:09:24.646583 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:09:24.646583 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:24.646583 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:24.646583 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:09:24.646583 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:09:24.646583 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:09:24.646583 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:09:24.646583 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:09:24.646583 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:09:24.646583 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:09:24.646583 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:09:24.646583 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:09:24.646583 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:09:24.647765 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:09:24.647765 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:09:24.647765 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:09:24.647765 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:09:24.647765 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:09:24.647765 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:09:24.647765 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:09:24.647765 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:09:24.647765 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:09:24.647765 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:09:24.647765 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 12:09:24.647765 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:09:24.647765 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 523/1061] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Jun 29 12:09:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:09:24.654424 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d661cf68-9017-457e-a2cb-7344f5d227a0 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:24.720205 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b560d83-0ce7-43c4-ad17-3d5b23296ef0 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:24.754612 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:24.755638 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da1ce0-92b8-48cb-b44e-251c5e1e1685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:24.756282 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da1ce0-92b8-48cb-b44e-251c5e1e1685 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:24.756666 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da1ce0-92b8-48cb-b44e-251c5e1e1685 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:24.757075 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da1ce0-92b8-48cb-b44e-251c5e1e1685 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:24.758448 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2da1ce0-92b8-48cb-b44e-251c5e1e1685 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:24.759744 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2da1ce0-92b8-48cb-b44e-251c5e1e1685 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:24.761289 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d661cf68-9017-457e-a2cb-7344f5d227a0 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:24.779918 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 539/1062] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Jun 29 12:09:24 2022] POST /identity/v3/endpoints => generated 327 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:09:24.828083 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60d6bc9-d019-4993-a70a-eb9dcb32b7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:24.828763 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d6bc9-d019-4993-a70a-eb9dcb32b7d2 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:24.829039 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d6bc9-d019-4993-a70a-eb9dcb32b7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:24.829307 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d6bc9-d019-4993-a70a-eb9dcb32b7d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:24.830116 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60d6bc9-d019-4993-a70a-eb9dcb32b7d2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:24.830420 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60d6bc9-d019-4993-a70a-eb9dcb32b7d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:24.831831 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60d6bc9-d019-4993-a70a-eb9dcb32b7d2 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:24.850264 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 524/1063] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Jun 29 12:09:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:09:24.853073 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da1ce0-92b8-48cb-b44e-251c5e1e1685 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:24.871988 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:24.975575 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da1ce0-92b8-48cb-b44e-251c5e1e1685 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:25.013264 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1129195-a586-4d8b-828f-0bcacde660bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:25.013264 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1129195-a586-4d8b-828f-0bcacde660bd None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:25.013580 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1129195-a586-4d8b-828f-0bcacde660bd None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:25.013580 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1129195-a586-4d8b-828f-0bcacde660bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:25.025625 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1129195-a586-4d8b-828f-0bcacde660bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:25.027131 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1129195-a586-4d8b-828f-0bcacde660bd None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:25.051653 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-a1129195-a586-4d8b-828f-0bcacde660bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:09:25.051653 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:25.051653 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:25.051653 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:25.051653 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:25.051653 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:25.051653 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:25.051653 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:25.051653 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:25.051653 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:25.051653 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:25.051653 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:25.051653 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:09:25.051653 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:09:25.051653 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:09:25.052715 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:09:25.052715 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:25.052715 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:25.052715 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:09:25.052715 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:09:25.052715 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:09:25.052715 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:09:25.052715 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:09:25.052715 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:09:25.052715 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:09:25.052715 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:09:25.052715 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:09:25.052715 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:09:25.052715 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:09:25.052715 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:09:25.052715 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:09:25.052715 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:09:25.053658 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:09:25.053658 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:09:25.053658 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:09:25.053658 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:09:25.053658 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 540/1064] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:09:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:09:25.060193 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60d6bc9-d019-4993-a70a-eb9dcb32b7d2 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:25.176686 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60d6bc9-d019-4993-a70a-eb9dcb32b7d2 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:25.216580 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3c956-fe0b-47f3-b5ce-d2919aa3a32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:25.217247 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3c956-fe0b-47f3-b5ce-d2919aa3a32b None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:25.217520 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3c956-fe0b-47f3-b5ce-d2919aa3a32b None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:25.217817 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3c956-fe0b-47f3-b5ce-d2919aa3a32b None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:25.218543 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c3c956-fe0b-47f3-b5ce-d2919aa3a32b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:25.218844 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c3c956-fe0b-47f3-b5ce-d2919aa3a32b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:25.220220 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c3c956-fe0b-47f3-b5ce-d2919aa3a32b None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:25.234459 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 525/1065] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:09:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:25.240132 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1129195-a586-4d8b-828f-0bcacde660bd None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:25.321562 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:25.370410 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1129195-a586-4d8b-828f-0bcacde660bd None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:25.407073 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766f05f-98c3-45ae-96c4-0a04ca42b477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:25.407871 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766f05f-98c3-45ae-96c4-0a04ca42b477 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:25.408156 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766f05f-98c3-45ae-96c4-0a04ca42b477 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:25.408431 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766f05f-98c3-45ae-96c4-0a04ca42b477 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:25.418898 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4766f05f-98c3-45ae-96c4-0a04ca42b477 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:25.421437 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4766f05f-98c3-45ae-96c4-0a04ca42b477 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:25.437453 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-4766f05f-98c3-45ae-96c4-0a04ca42b477 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 12:09:25.437453 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:25.437453 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:25.437453 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:25.437453 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:25.437453 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:25.437453 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:25.437453 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:25.437453 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:25.437453 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:25.437453 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:25.437453 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:25.437453 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:09:25.437453 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:09:25.437453 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:09:25.437453 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:09:25.438485 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:25.438485 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:25.438485 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:09:25.438485 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:09:25.438485 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:09:25.438485 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:09:25.438485 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:09:25.438485 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:09:25.438485 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:09:25.438485 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:09:25.438485 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:09:25.438485 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:09:25.438485 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:09:25.438485 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:09:25.438485 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:09:25.438485 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:09:25.438485 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:09:25.438485 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:09:25.439460 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:09:25.439460 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:09:25.439460 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:09:25.439460 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:09:25.439460 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:09:25.439460 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:09:25.439460 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:09:25.439460 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:09:25.439460 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 12:09:25.439460 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:09:25.439460 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 541/1066] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Jun 29 12:09:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:09:25.448671 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3c956-fe0b-47f3-b5ce-d2919aa3a32b None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:25.481872 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:25.595634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3c956-fe0b-47f3-b5ce-d2919aa3a32b None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:25.638812 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a41caa-9e10-400c-a540-96c16c447909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:25.639787 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a41caa-9e10-400c-a540-96c16c447909 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:25.640076 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a41caa-9e10-400c-a540-96c16c447909 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:25.640349 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a41caa-9e10-400c-a540-96c16c447909 None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:25.641472 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a41caa-9e10-400c-a540-96c16c447909 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:25.641816 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a41caa-9e10-400c-a540-96c16c447909 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:25.643261 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a41caa-9e10-400c-a540-96c16c447909 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:25.665143 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 526/1067] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Jun 29 12:09:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:25.670814 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766f05f-98c3-45ae-96c4-0a04ca42b477 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:25.795823 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766f05f-98c3-45ae-96c4-0a04ca42b477 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:25.823857 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:25.837429 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d698316-76e8-4456-b122-cdb074f38dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:25.838268 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d698316-76e8-4456-b122-cdb074f38dc2 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:25.838554 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d698316-76e8-4456-b122-cdb074f38dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:25.838830 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d698316-76e8-4456-b122-cdb074f38dc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:25.852523 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d698316-76e8-4456-b122-cdb074f38dc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:25.854630 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d698316-76e8-4456-b122-cdb074f38dc2 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:25.872776 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-0d698316-76e8-4456-b122-cdb074f38dc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:09:25.872776 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:25.872776 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:25.872776 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:25.872776 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:25.872776 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:25.872776 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:25.872776 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:25.872776 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:25.872776 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:25.872776 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:25.872776 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:25.872776 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:09:25.872776 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:09:25.872776 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:09:25.874064 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:09:25.874064 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:25.874064 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:25.874064 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:09:25.874064 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:09:25.874064 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:09:25.874064 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:09:25.874064 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:09:25.874064 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:09:25.874064 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:09:25.874064 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:09:25.874064 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:09:25.874064 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:09:25.874064 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:09:25.874064 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:09:25.874064 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:09:25.874064 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:09:25.875026 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:09:25.875026 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:09:25.875026 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:09:25.875026 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:09:25.875026 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 542/1068] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:09:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:09:25.884214 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a41caa-9e10-400c-a540-96c16c447909 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:25.969446 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:25.999384 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a41caa-9e10-400c-a540-96c16c447909 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:26.036057 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f0a923-4db9-4e9c-9498-33a19ea3b2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:26.036739 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0a923-4db9-4e9c-9498-33a19ea3b2a3 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:26.037022 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0a923-4db9-4e9c-9498-33a19ea3b2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:26.037297 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0a923-4db9-4e9c-9498-33a19ea3b2a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:26.038111 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f0a923-4db9-4e9c-9498-33a19ea3b2a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:26.038419 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f0a923-4db9-4e9c-9498-33a19ea3b2a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:26.039806 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f0a923-4db9-4e9c-9498-33a19ea3b2a3 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:26.053106 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 527/1069] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:09:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:26.058641 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d698316-76e8-4456-b122-cdb074f38dc2 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:26.165951 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d698316-76e8-4456-b122-cdb074f38dc2 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:26.203038 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f5039-8ba6-42c9-85d8-d44f7c508db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:26.203843 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f5039-8ba6-42c9-85d8-d44f7c508db2 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:26.204129 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f5039-8ba6-42c9-85d8-d44f7c508db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:26.204405 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f5039-8ba6-42c9-85d8-d44f7c508db2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:26.211792 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f5039-8ba6-42c9-85d8-d44f7c508db2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:26.213285 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f5039-8ba6-42c9-85d8-d44f7c508db2 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:26.228082 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-601f5039-8ba6-42c9-85d8-d44f7c508db2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:09:26.228082 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:26.228082 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:26.228082 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:26.228082 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:26.228082 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:26.228082 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:26.228082 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:26.228082 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:26.228082 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:26.228082 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:26.228082 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:26.228082 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:09:26.228082 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:09:26.228082 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:09:26.229073 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:09:26.229073 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:26.229073 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:26.229073 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:09:26.229073 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:09:26.229073 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:09:26.229073 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:09:26.229073 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:09:26.229073 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:09:26.229073 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:09:26.229073 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:09:26.229073 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:09:26.229073 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:09:26.229073 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:09:26.229073 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:09:26.229073 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:09:26.229073 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:09:26.230020 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:09:26.230020 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:09:26.230020 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:09:26.230020 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:09:26.230020 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:09:26.230020 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:09:26.230020 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:09:26.230020 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:09:26.230020 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 543/1070] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jun 29 12:09:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:09:26.236815 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f0a923-4db9-4e9c-9498-33a19ea3b2a3 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:26.342645 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f0a923-4db9-4e9c-9498-33a19ea3b2a3 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:26.379116 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874b747c-223c-4e2f-9b36-3fe3f47bd33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:26.379782 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b747c-223c-4e2f-9b36-3fe3f47bd33f None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:26.380057 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b747c-223c-4e2f-9b36-3fe3f47bd33f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:26.380325 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b747c-223c-4e2f-9b36-3fe3f47bd33f None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:26.381126 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874b747c-223c-4e2f-9b36-3fe3f47bd33f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:26.381436 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874b747c-223c-4e2f-9b36-3fe3f47bd33f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:26.383003 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874b747c-223c-4e2f-9b36-3fe3f47bd33f None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:26.384770 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:26.397119 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 528/1071] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jun 29 12:09:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:26.403157 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f5039-8ba6-42c9-85d8-d44f7c508db2 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:26.441159 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:26.512546 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f5039-8ba6-42c9-85d8-d44f7c508db2 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:26.528177 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807e09b-5404-4916-8728-e52ee73f716d None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:26.528710 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807e09b-5404-4916-8728-e52ee73f716d None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:26.528710 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807e09b-5404-4916-8728-e52ee73f716d None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:26.530291 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 529/1072] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:09:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:09:26.535112 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814df1b9-201e-4cb7-9957-992d762c0985 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:26.535356 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814df1b9-201e-4cb7-9957-992d762c0985 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:26.535667 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814df1b9-201e-4cb7-9957-992d762c0985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:26.552060 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a31f699-92ce-40a6-9a3a-ef8e62d82e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:26.552963 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31f699-92ce-40a6-9a3a-ef8e62d82e9c None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:26.553251 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31f699-92ce-40a6-9a3a-ef8e62d82e9c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:26.553529 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31f699-92ce-40a6-9a3a-ef8e62d82e9c None admin] PATH_INFO: `/v3/projects/996db30845f84e57865fa40b9a730a05/users/7adaa2ef440941aa8214f2b2fd49b54e/roles/21cea97c141c42a18f5c161141c2a781` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:26.554596 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-814df1b9-201e-4cb7-9957-992d762c0985 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:09:26.555786 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-814df1b9-201e-4cb7-9957-992d762c0985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:09:26.556018 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a31f699-92ce-40a6-9a3a-ef8e62d82e9c None admin] RBAC: Authorizing `identity:create_grant(project_id=996db30845f84e57865fa40b9a730a05, user_id=7adaa2ef440941aa8214f2b2fd49b54e, role_id=21cea97c141c42a18f5c161141c2a781)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:26.557468 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a31f699-92ce-40a6-9a3a-ef8e62d82e9c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:26.574053 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 544/1073] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jun 29 12:09:26 2022] PUT /identity/v3/projects/996db30845f84e57865fa40b9a730a05/users/7adaa2ef440941aa8214f2b2fd49b54e/roles/21cea97c141c42a18f5c161141c2a781 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:09:26.636856 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 530/1074] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:09:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 12:09:26.659883 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a31f699-92ce-40a6-9a3a-ef8e62d82e9c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:26.773380 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:26.779986 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a31f699-92ce-40a6-9a3a-ef8e62d82e9c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:26.818065 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aead8be-62e9-4c51-9ce2-445f123e5c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:26.818877 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aead8be-62e9-4c51-9ce2-445f123e5c8a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:26.819159 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aead8be-62e9-4c51-9ce2-445f123e5c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:26.819752 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aead8be-62e9-4c51-9ce2-445f123e5c8a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:26.830751 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aead8be-62e9-4c51-9ce2-445f123e5c8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:09:26.838662 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-7aead8be-62e9-4c51-9ce2-445f123e5c8a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:09:26.838662 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:26.838662 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:26.838662 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:26.838662 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:26.838662 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:26.838662 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:26.838662 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:26.838662 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:26.838662 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:26.838662 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:26.838662 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:26.838662 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:09:26.838662 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:09:26.838662 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:09:26.838662 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:09:26.839626 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:09:26.839626 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:09:26.839626 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:09:26.839626 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:09:26.839626 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:26.839626 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:26.839626 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:09:26.839626 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:09:26.839626 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:09:26.839626 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:09:26.839626 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:09:26.839626 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:09:26.839626 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:09:26.839626 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:09:26.839626 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:09:26.839626 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:09:26.840971 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:09:26.840971 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:09:26.840971 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:09:26.840971 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:09:26.840971 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:09:26.840971 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:09:26.840971 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:09:26.840971 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:09:26.840971 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:09:26.840971 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:09:26.840971 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:09:26.840971 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:09:26.840971 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 545/1075] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jun 29 12:09:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:09:26.846503 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814df1b9-201e-4cb7-9957-992d762c0985 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:26.947567 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52fc873-ba40-4bcd-aa34-175b64c108c7 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:26.947800 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52fc873-ba40-4bcd-aa34-175b64c108c7 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:26.948013 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52fc873-ba40-4bcd-aa34-175b64c108c7 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:26.949597 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 546/1076] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:09:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:09:26.952406 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814df1b9-201e-4cb7-9957-992d762c0985 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:26.954892 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c877605-ff9f-458e-972f-c35786019d38 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:26.955179 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c877605-ff9f-458e-972f-c35786019d38 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:26.955457 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c877605-ff9f-458e-972f-c35786019d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:26.972727 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-7c877605-ff9f-458e-972f-c35786019d38 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:09:26.973958 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7c877605-ff9f-458e-972f-c35786019d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:09:26.982662 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:26.997095 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19bc9ae-538d-4113-a4f1-bd5ef2083fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:26.998061 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19bc9ae-538d-4113-a4f1-bd5ef2083fb8 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:26.998354 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19bc9ae-538d-4113-a4f1-bd5ef2083fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:26.998946 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19bc9ae-538d-4113-a4f1-bd5ef2083fb8 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:26.999731 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19bc9ae-538d-4113-a4f1-bd5ef2083fb8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:27.000039 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19bc9ae-538d-4113-a4f1-bd5ef2083fb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:27.001462 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19bc9ae-538d-4113-a4f1-bd5ef2083fb8 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:27.011673 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 531/1077] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:09:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:27.017477 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19bc9ae-538d-4113-a4f1-bd5ef2083fb8 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:27.066797 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 547/1078] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:09:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 12:09:27.090607 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c877605-ff9f-458e-972f-c35786019d38 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:27.132751 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19bc9ae-538d-4113-a4f1-bd5ef2083fb8 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:27.171734 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e256c7c9-a12a-48ec-b8d0-9e6316c8871a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:27.172623 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256c7c9-a12a-48ec-b8d0-9e6316c8871a None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:27.172963 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256c7c9-a12a-48ec-b8d0-9e6316c8871a None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:27.173242 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256c7c9-a12a-48ec-b8d0-9e6316c8871a None admin] PATH_INFO: `/v3/users/75e5b85bd9824ea0ab28bed0ccf460fa` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:27.174500 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e256c7c9-a12a-48ec-b8d0-9e6316c8871a None admin] RBAC: Authorizing `identity:get_user(user_id=75e5b85bd9824ea0ab28bed0ccf460fa)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:27.175983 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e256c7c9-a12a-48ec-b8d0-9e6316c8871a None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:27.177832 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 532/1079] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jun 29 12:09:27 2022] GET /identity/v3/users/75e5b85bd9824ea0ab28bed0ccf460fa => generated 285 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:09:27.183750 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e256c7c9-a12a-48ec-b8d0-9e6316c8871a None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:27.186765 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:27.207064 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c877605-ff9f-458e-972f-c35786019d38 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:27.248154 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c260b51-c327-4ddc-8438-8969110a98c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:27.248367 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:27.248980 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c260b51-c327-4ddc-8438-8969110a98c5 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:27.249163 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c260b51-c327-4ddc-8438-8969110a98c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:27.249592 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c260b51-c327-4ddc-8438-8969110a98c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:27.299327 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e256c7c9-a12a-48ec-b8d0-9e6316c8871a None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:27.320906 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c260b51-c327-4ddc-8438-8969110a98c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:27.321572 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c260b51-c327-4ddc-8438-8969110a98c5 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:27.341740 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43833724-25b5-42ba-868e-42c5bab5dd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:27.342621 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43833724-25b5-42ba-868e-42c5bab5dd01 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:27.342897 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43833724-25b5-42ba-868e-42c5bab5dd01 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:27.343166 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43833724-25b5-42ba-868e-42c5bab5dd01 None admin] PATH_INFO: `/v3/projects/fba748115e844a2e9477cdbf52b94ee8` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:27.344456 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43833724-25b5-42ba-868e-42c5bab5dd01 None admin] RBAC: Authorizing `identity:get_project(project_id=fba748115e844a2e9477cdbf52b94ee8)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:27.345934 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43833724-25b5-42ba-868e-42c5bab5dd01 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:27.347986 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 533/1080] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jun 29 12:09:27 2022] GET /identity/v3/projects/fba748115e844a2e9477cdbf52b94ee8 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:27.354415 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43833724-25b5-42ba-868e-42c5bab5dd01 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:27.411874 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:27.428426 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 548/1081] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:09:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 29 12:09:27.434411 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c260b51-c327-4ddc-8438-8969110a98c5 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:27.462878 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43833724-25b5-42ba-868e-42c5bab5dd01 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:27.487210 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:27.500839 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f864223-f60c-48e3-bf4d-8804c3651faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:27.501762 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f864223-f60c-48e3-bf4d-8804c3651faf None admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:27.502044 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f864223-f60c-48e3-bf4d-8804c3651faf None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:27.502320 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f864223-f60c-48e3-bf4d-8804c3651faf None admin] PATH_INFO: `/v3/projects/fba748115e844a2e9477cdbf52b94ee8/users/75e5b85bd9824ea0ab28bed0ccf460fa/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:27.504414 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f864223-f60c-48e3-bf4d-8804c3651faf None admin] RBAC: Authorizing `identity:create_grant(project_id=fba748115e844a2e9477cdbf52b94ee8, user_id=75e5b85bd9824ea0ab28bed0ccf460fa, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:27.505890 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f864223-f60c-48e3-bf4d-8804c3651faf None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:27.521559 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 534/1082] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jun 29 12:09:27 2022] PUT /identity/v3/projects/fba748115e844a2e9477cdbf52b94ee8/users/75e5b85bd9824ea0ab28bed0ccf460fa/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:09:27.546590 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c260b51-c327-4ddc-8438-8969110a98c5 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:27.587238 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544ef5e-0632-4ed0-b522-5e447fa03f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:27.588059 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544ef5e-0632-4ed0-b522-5e447fa03f2a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:27.588340 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544ef5e-0632-4ed0-b522-5e447fa03f2a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:27.588610 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544ef5e-0632-4ed0-b522-5e447fa03f2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:27.600862 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e544ef5e-0632-4ed0-b522-5e447fa03f2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:27.602500 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e544ef5e-0632-4ed0-b522-5e447fa03f2a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:27.623586 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-e544ef5e-0632-4ed0-b522-5e447fa03f2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:09:27.623586 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:27.623586 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:27.623586 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:27.623586 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:27.623586 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:27.623586 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:27.623586 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:27.623586 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:27.623586 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:27.623586 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:27.623586 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:27.623586 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:09:27.623586 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:09:27.623586 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:09:27.624609 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:09:27.624609 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:27.624609 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:27.624609 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:09:27.624609 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:09:27.624609 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:09:27.624609 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:09:27.624609 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:09:27.624609 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:09:27.624609 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:09:27.624609 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:09:27.624609 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:09:27.624609 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:09:27.624609 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:09:27.624609 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:09:27.624609 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:09:27.624609 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:09:27.631133 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:09:27.631133 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:09:27.631133 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:09:27.631133 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:09:27.631133 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 549/1083] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:09:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:09:27.633125 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f864223-f60c-48e3-bf4d-8804c3651faf None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:27.749259 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f864223-f60c-48e3-bf4d-8804c3651faf None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:27.786225 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d2e53-242e-45dc-b5c8-3f71bb26908e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:27.786896 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d2e53-242e-45dc-b5c8-3f71bb26908e None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:27.787176 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d2e53-242e-45dc-b5c8-3f71bb26908e None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:27.787450 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d2e53-242e-45dc-b5c8-3f71bb26908e None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:27.788345 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d2e53-242e-45dc-b5c8-3f71bb26908e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:27.788650 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d2e53-242e-45dc-b5c8-3f71bb26908e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:27.790071 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d2e53-242e-45dc-b5c8-3f71bb26908e None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:27.802596 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 535/1084] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:09:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:09:28.622457 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87609c93-7040-4d1c-81a1-975ad14cd7f5 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:28.624841 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87609c93-7040-4d1c-81a1-975ad14cd7f5 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:28.624841 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87609c93-7040-4d1c-81a1-975ad14cd7f5 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:28.624841 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 550/1085] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:09:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:09:28.630088 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3dbada-d5f6-47d7-bd5c-173c05bcf390 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:28.630338 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3dbada-d5f6-47d7-bd5c-173c05bcf390 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:28.630641 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3dbada-d5f6-47d7-bd5c-173c05bcf390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:28.648790 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-fe3dbada-d5f6-47d7-bd5c-173c05bcf390 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:09:28.650009 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-fe3dbada-d5f6-47d7-bd5c-173c05bcf390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:09:28.688691 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:28.722277 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 536/1086] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:09:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:09:28.746667 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87609c93-7040-4d1c-81a1-975ad14cd7f5 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:28.790523 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:28.854123 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87609c93-7040-4d1c-81a1-975ad14cd7f5 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:28.891072 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019b33c-87f4-4391-bb19-7cbbe4179eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:28.891832 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019b33c-87f4-4391-bb19-7cbbe4179eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:28.892110 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019b33c-87f4-4391-bb19-7cbbe4179eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:28.892363 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019b33c-87f4-4391-bb19-7cbbe4179eb2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:28.903242 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0019b33c-87f4-4391-bb19-7cbbe4179eb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:09:28.911369 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-0019b33c-87f4-4391-bb19-7cbbe4179eb2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 12:09:28.911369 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:28.911369 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:28.911369 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:28.911369 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:28.911369 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:28.911369 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:28.911369 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:28.911369 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:28.911369 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:28.911369 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:28.911369 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:28.911369 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:09:28.911369 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:09:28.911369 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:09:28.911369 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:09:28.912421 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:09:28.912421 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:09:28.912421 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:09:28.912421 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:09:28.912421 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:28.912421 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:28.912421 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:09:28.912421 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:09:28.912421 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:09:28.912421 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:09:28.912421 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:09:28.912421 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:09:28.912421 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:09:28.912421 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:09:28.912421 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:09:28.912421 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:09:28.913481 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:09:28.913481 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:09:28.913481 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:09:28.913481 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:09:28.913481 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:09:28.913481 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:09:28.913481 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:09:28.913481 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:09:28.913481 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:09:28.913481 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:09:28.913481 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 12:09:28.913481 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:09:28.913481 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 551/1087] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Jun 29 12:09:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:09:28.918963 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3dbada-d5f6-47d7-bd5c-173c05bcf390 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:29.026128 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3dbada-d5f6-47d7-bd5c-173c05bcf390 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:29.062692 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dafb77-6892-4ddf-a9e0-ab6302ffba94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:29.063371 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dafb77-6892-4ddf-a9e0-ab6302ffba94 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:29.063647 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dafb77-6892-4ddf-a9e0-ab6302ffba94 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:29.063917 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dafb77-6892-4ddf-a9e0-ab6302ffba94 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:29.064691 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dafb77-6892-4ddf-a9e0-ab6302ffba94 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:29.065003 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dafb77-6892-4ddf-a9e0-ab6302ffba94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:29.066401 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dafb77-6892-4ddf-a9e0-ab6302ffba94 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:29.075089 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 537/1088] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Jun 29 12:09:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:29.081236 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019b33c-87f4-4391-bb19-7cbbe4179eb2 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:29.180603 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:29.185869 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019b33c-87f4-4391-bb19-7cbbe4179eb2 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:29.224834 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e0a9ad-f004-4a0c-b8f3-6478fb668878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:29.225934 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e0a9ad-f004-4a0c-b8f3-6478fb668878 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:29.226214 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e0a9ad-f004-4a0c-b8f3-6478fb668878 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:29.226525 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e0a9ad-f004-4a0c-b8f3-6478fb668878 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:29.237825 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e0a9ad-f004-4a0c-b8f3-6478fb668878 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:29.239278 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e0a9ad-f004-4a0c-b8f3-6478fb668878 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:29.257831 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-a5e0a9ad-f004-4a0c-b8f3-6478fb668878 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:09:29.257831 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:29.257831 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:29.257831 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:29.257831 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:29.257831 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:29.257831 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:29.257831 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:29.257831 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:29.257831 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:29.257831 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:29.257831 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:29.257831 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:09:29.257831 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:09:29.257831 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:09:29.259128 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:09:29.259128 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:29.259128 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:29.259128 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:09:29.259128 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:09:29.259128 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:09:29.259128 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:09:29.259128 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:09:29.259128 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:09:29.259128 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:09:29.259128 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:09:29.259128 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:09:29.259128 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:09:29.259128 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:09:29.259128 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:09:29.259128 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:09:29.259128 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:09:29.260190 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:09:29.260190 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:09:29.260190 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:09:29.260190 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:09:29.260190 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 552/1089] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:09:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:09:29.265044 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dafb77-6892-4ddf-a9e0-ab6302ffba94 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:29.300785 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:29.371772 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dafb77-6892-4ddf-a9e0-ab6302ffba94 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:29.407101 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a935d9-e7f2-498a-9b9e-d2608799683c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:29.407770 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a935d9-e7f2-498a-9b9e-d2608799683c None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:29.408052 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a935d9-e7f2-498a-9b9e-d2608799683c None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:29.408330 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a935d9-e7f2-498a-9b9e-d2608799683c None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:29.409058 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a935d9-e7f2-498a-9b9e-d2608799683c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:29.409362 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a935d9-e7f2-498a-9b9e-d2608799683c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:29.410789 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a935d9-e7f2-498a-9b9e-d2608799683c None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:29.423118 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 538/1090] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:09:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:29.429556 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e0a9ad-f004-4a0c-b8f3-6478fb668878 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:29.531230 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e0a9ad-f004-4a0c-b8f3-6478fb668878 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:29.544554 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec678b-90e2-437d-bf98-4146ac626c67 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:29.544846 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec678b-90e2-437d-bf98-4146ac626c67 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:29.545127 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec678b-90e2-437d-bf98-4146ac626c67 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:29.546570 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 539/1091] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:09:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:09:29.551538 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40895bdf-0052-49e6-a46f-b2bd48e293b5 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:29.551819 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40895bdf-0052-49e6-a46f-b2bd48e293b5 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:29.552089 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40895bdf-0052-49e6-a46f-b2bd48e293b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:29.565272 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e718a6-3ca9-499c-b7ef-a996525fa613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:29.566097 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e718a6-3ca9-499c-b7ef-a996525fa613 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:29.566378 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e718a6-3ca9-499c-b7ef-a996525fa613 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:29.566650 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e718a6-3ca9-499c-b7ef-a996525fa613 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:29.569290 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-40895bdf-0052-49e6-a46f-b2bd48e293b5 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:09:29.570556 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-40895bdf-0052-49e6-a46f-b2bd48e293b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:09:29.574622 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e718a6-3ca9-499c-b7ef-a996525fa613 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:29.576068 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e718a6-3ca9-499c-b7ef-a996525fa613 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:29.590601 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-c2e718a6-3ca9-499c-b7ef-a996525fa613 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 12:09:29.590601 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:29.590601 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:29.590601 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:29.590601 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:29.590601 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:29.590601 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:29.590601 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:29.590601 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:29.590601 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:29.590601 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:29.590601 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:29.590601 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:09:29.590601 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:09:29.590601 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:09:29.590601 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:09:29.591699 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:29.591699 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:29.591699 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:09:29.591699 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:09:29.591699 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:09:29.591699 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:09:29.591699 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:09:29.591699 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:09:29.591699 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:09:29.591699 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:09:29.591699 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:09:29.591699 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:09:29.591699 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:09:29.591699 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:09:29.591699 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:09:29.591699 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:09:29.591699 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:09:29.591699 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:09:29.592798 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:09:29.592798 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:09:29.592798 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:09:29.592798 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:09:29.592798 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:09:29.592798 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:09:29.592798 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:09:29.592798 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:09:29.592798 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 12:09:29.592798 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:09:29.592798 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 553/1092] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Jun 29 12:09:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:09:29.597870 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e718a6-3ca9-499c-b7ef-a996525fa613 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:29.610952 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:29.642388 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 540/1093] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:09:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 12:09:29.666084 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40895bdf-0052-49e6-a46f-b2bd48e293b5 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:29.696827 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:29.713490 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e718a6-3ca9-499c-b7ef-a996525fa613 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:29.750520 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b83d5-6f7f-4ce4-b0a0-a08f855f4216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:29.751196 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b83d5-6f7f-4ce4-b0a0-a08f855f4216 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:29.751481 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b83d5-6f7f-4ce4-b0a0-a08f855f4216 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:29.751784 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b83d5-6f7f-4ce4-b0a0-a08f855f4216 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:29.752627 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27b83d5-6f7f-4ce4-b0a0-a08f855f4216 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:29.752937 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27b83d5-6f7f-4ce4-b0a0-a08f855f4216 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:29.754423 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27b83d5-6f7f-4ce4-b0a0-a08f855f4216 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:29.773726 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 554/1094] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Jun 29 12:09:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:29.777820 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b83d5-6f7f-4ce4-b0a0-a08f855f4216 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:29.779506 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40895bdf-0052-49e6-a46f-b2bd48e293b5 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:29.813359 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c80c3c-ed4c-4d3c-840e-38c0fa267c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:29.814187 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c80c3c-ed4c-4d3c-840e-38c0fa267c58 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:29.814472 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c80c3c-ed4c-4d3c-840e-38c0fa267c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:29.814741 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c80c3c-ed4c-4d3c-840e-38c0fa267c58 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:29.825241 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c80c3c-ed4c-4d3c-840e-38c0fa267c58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:09:29.833405 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-69c80c3c-ed4c-4d3c-840e-38c0fa267c58 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:09:29.833405 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:29.833405 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:29.833405 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:29.833405 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:29.833405 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:29.833405 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:29.833405 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:29.833405 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:29.833405 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:29.833405 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:29.833405 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:29.833405 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:09:29.833405 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:09:29.833405 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:09:29.833405 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:09:29.834457 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:09:29.834457 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:09:29.834457 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:09:29.834457 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:09:29.834457 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:29.834457 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:29.834457 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:09:29.834457 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:09:29.834457 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:09:29.834457 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:09:29.834457 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:09:29.834457 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:09:29.834457 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:09:29.834457 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:09:29.834457 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:09:29.834457 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:09:29.835512 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:09:29.835512 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:09:29.835512 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:09:29.835512 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:09:29.835512 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:09:29.835512 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:09:29.835512 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:09:29.835512 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:09:29.835512 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:09:29.835512 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:09:29.835512 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:09:29.835512 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:09:29.835512 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 541/1095] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jun 29 12:09:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:09:29.840997 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c80c3c-ed4c-4d3c-840e-38c0fa267c58 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:29.846623 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:29.882505 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b83d5-6f7f-4ce4-b0a0-a08f855f4216 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:29.919212 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3020f16-9e5a-41f0-a020-2cb0e6e75add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:29.919865 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3020f16-9e5a-41f0-a020-2cb0e6e75add None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:29.920147 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3020f16-9e5a-41f0-a020-2cb0e6e75add None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:29.920413 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3020f16-9e5a-41f0-a020-2cb0e6e75add None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:29.927797 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:29.944959 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c80c3c-ed4c-4d3c-840e-38c0fa267c58 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:29.982427 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83758ac7-1450-49f0-8fbc-b2a4c9dee79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:29.982802 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83758ac7-1450-49f0-8fbc-b2a4c9dee79c None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:29.983079 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83758ac7-1450-49f0-8fbc-b2a4c9dee79c None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:29.983349 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83758ac7-1450-49f0-8fbc-b2a4c9dee79c None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:29.984105 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83758ac7-1450-49f0-8fbc-b2a4c9dee79c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:29.984410 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83758ac7-1450-49f0-8fbc-b2a4c9dee79c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:29.985816 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83758ac7-1450-49f0-8fbc-b2a4c9dee79c None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:29.990808 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3020f16-9e5a-41f0-a020-2cb0e6e75add None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:29.993091 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3020f16-9e5a-41f0-a020-2cb0e6e75add None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:30.001443 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 542/1096] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:09:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:30.002840 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83758ac7-1450-49f0-8fbc-b2a4c9dee79c None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:30.062928 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:30.096518 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 555/1097] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:09:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 29 12:09:30.102382 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3020f16-9e5a-41f0-a020-2cb0e6e75add None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:30.116668 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83758ac7-1450-49f0-8fbc-b2a4c9dee79c None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:30.150611 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c86326-5502-4712-b917-a9a054418517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:30.151493 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c86326-5502-4712-b917-a9a054418517 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:30.151773 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c86326-5502-4712-b917-a9a054418517 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:30.152039 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c86326-5502-4712-b917-a9a054418517 None admin] PATH_INFO: `/v3/users/75e5b85bd9824ea0ab28bed0ccf460fa` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:30.153268 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c86326-5502-4712-b917-a9a054418517 None admin] RBAC: Authorizing `identity:get_user(user_id=75e5b85bd9824ea0ab28bed0ccf460fa)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:30.154749 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c86326-5502-4712-b917-a9a054418517 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:30.156404 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 543/1098] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jun 29 12:09:30 2022] GET /identity/v3/users/75e5b85bd9824ea0ab28bed0ccf460fa => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:30.162239 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c86326-5502-4712-b917-a9a054418517 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:30.178472 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:30.207338 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3020f16-9e5a-41f0-a020-2cb0e6e75add None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:30.241505 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fef3ec-28bd-43b4-9317-235a24b8ffb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:30.242468 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fef3ec-28bd-43b4-9317-235a24b8ffb4 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:30.242753 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fef3ec-28bd-43b4-9317-235a24b8ffb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:30.243028 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fef3ec-28bd-43b4-9317-235a24b8ffb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:30.253030 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fef3ec-28bd-43b4-9317-235a24b8ffb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:30.254683 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fef3ec-28bd-43b4-9317-235a24b8ffb4 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:30.264775 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c86326-5502-4712-b917-a9a054418517 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:30.272053 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-43fef3ec-28bd-43b4-9317-235a24b8ffb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:09:30.272053 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:30.272053 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:30.272053 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:30.272053 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:30.272053 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:30.272053 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:30.272053 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:30.272053 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:30.272053 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:30.272053 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:30.272053 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:30.272053 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:09:30.272053 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:09:30.272053 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:09:30.272997 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:09:30.272997 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:30.272997 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:30.272997 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:09:30.272997 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:09:30.272997 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:09:30.272997 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:09:30.272997 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:09:30.272997 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:09:30.272997 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:09:30.272997 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:09:30.272997 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:09:30.272997 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:09:30.272997 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:09:30.272997 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:09:30.272997 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:09:30.272997 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:09:30.273975 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:09:30.273975 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:09:30.273975 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:09:30.273975 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:09:30.273975 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 556/1099] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:09:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:09:30.279379 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fef3ec-28bd-43b4-9317-235a24b8ffb4 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:30.301109 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:30.304777 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ba4df7-e40a-48bd-91a6-b73a0a5c7c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:30.305447 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba4df7-e40a-48bd-91a6-b73a0a5c7c31 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:30.305753 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba4df7-e40a-48bd-91a6-b73a0a5c7c31 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:30.306031 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba4df7-e40a-48bd-91a6-b73a0a5c7c31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:30.376204 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ba4df7-e40a-48bd-91a6-b73a0a5c7c31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:30.377586 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ba4df7-e40a-48bd-91a6-b73a0a5c7c31 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:30.382346 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fef3ec-28bd-43b4-9317-235a24b8ffb4 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:30.393935 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:30.416516 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0676d03-e3d6-4137-b75a-24e8726c7159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:30.417179 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0676d03-e3d6-4137-b75a-24e8726c7159 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:30.417462 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0676d03-e3d6-4137-b75a-24e8726c7159 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:30.417768 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0676d03-e3d6-4137-b75a-24e8726c7159 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:30.418495 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0676d03-e3d6-4137-b75a-24e8726c7159 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:30.418800 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0676d03-e3d6-4137-b75a-24e8726c7159 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:30.420183 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0676d03-e3d6-4137-b75a-24e8726c7159 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:30.431657 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 557/1100] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:09:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:09:30.437770 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0676d03-e3d6-4137-b75a-24e8726c7159 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:30.484146 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 544/1101] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:09:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 29 12:09:30.490120 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ba4df7-e40a-48bd-91a6-b73a0a5c7c31 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:30.519381 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:30.542364 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0676d03-e3d6-4137-b75a-24e8726c7159 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:30.575708 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0b1ba2-5606-4faa-926e-4daf6916ac18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:30.576508 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b1ba2-5606-4faa-926e-4daf6916ac18 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:30.577149 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b1ba2-5606-4faa-926e-4daf6916ac18 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:30.577418 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b1ba2-5606-4faa-926e-4daf6916ac18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:30.584519 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0b1ba2-5606-4faa-926e-4daf6916ac18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:30.586096 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0b1ba2-5606-4faa-926e-4daf6916ac18 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:30.592420 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ba4df7-e40a-48bd-91a6-b73a0a5c7c31 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:30.600079 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-5f0b1ba2-5606-4faa-926e-4daf6916ac18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:09:30.600079 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:30.600079 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:30.600079 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:30.600079 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:30.600079 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:30.600079 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:30.600079 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:30.600079 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:30.600079 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:30.600079 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:30.600079 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:30.600079 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:09:30.600079 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:09:30.600079 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:09:30.601198 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:09:30.601198 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:30.601198 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:30.601198 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:09:30.601198 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:09:30.601198 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:09:30.601198 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:09:30.601198 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:09:30.601198 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:09:30.601198 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:09:30.601198 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:09:30.601198 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:09:30.601198 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:09:30.601198 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:09:30.601198 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:09:30.601198 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:09:30.601198 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:09:30.602134 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:09:30.602134 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:09:30.602134 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:09:30.602134 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:09:30.602134 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:09:30.602134 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:09:30.602134 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:09:30.602134 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:09:30.602134 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 558/1102] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jun 29 12:09:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:09:30.606869 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:30.607766 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0b1ba2-5606-4faa-926e-4daf6916ac18 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:30.629513 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d2b7c-aa5d-48ff-8a0d-420c312cca03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:30.630323 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d2b7c-aa5d-48ff-8a0d-420c312cca03 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:30.630600 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d2b7c-aa5d-48ff-8a0d-420c312cca03 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:30.630876 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d2b7c-aa5d-48ff-8a0d-420c312cca03 None admin] PATH_INFO: `/v3/projects/fba748115e844a2e9477cdbf52b94ee8` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:30.632628 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d2b7c-aa5d-48ff-8a0d-420c312cca03 None admin] RBAC: Authorizing `identity:get_project(project_id=fba748115e844a2e9477cdbf52b94ee8)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:30.634101 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d2b7c-aa5d-48ff-8a0d-420c312cca03 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:30.635819 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 545/1103] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jun 29 12:09:30 2022] GET /identity/v3/projects/fba748115e844a2e9477cdbf52b94ee8 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:09:30.641881 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d2b7c-aa5d-48ff-8a0d-420c312cca03 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:30.713929 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0b1ba2-5606-4faa-926e-4daf6916ac18 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:30.744270 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d2b7c-aa5d-48ff-8a0d-420c312cca03 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:30.748949 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a46c6-1b49-4eb6-b737-248547b2df77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:30.749610 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a46c6-1b49-4eb6-b737-248547b2df77 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:30.749912 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a46c6-1b49-4eb6-b737-248547b2df77 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:30.750183 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a46c6-1b49-4eb6-b737-248547b2df77 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:30.750966 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759a46c6-1b49-4eb6-b737-248547b2df77 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:30.751257 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759a46c6-1b49-4eb6-b737-248547b2df77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:30.752725 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759a46c6-1b49-4eb6-b737-248547b2df77 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:30.761234 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:30.765847 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 559/1104] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jun 29 12:09:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:09:30.770552 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a46c6-1b49-4eb6-b737-248547b2df77 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:30.779343 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2d2c2-5cb0-40ca-9904-2f4e638fe5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:30.780420 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2d2c2-5cb0-40ca-9904-2f4e638fe5c6 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:30.780703 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2d2c2-5cb0-40ca-9904-2f4e638fe5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:30.780980 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2d2c2-5cb0-40ca-9904-2f4e638fe5c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:30.782217 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a2d2c2-5cb0-40ca-9904-2f4e638fe5c6 None admin] RBAC: Adding query filter params (role.id=e0e69ac8a8bf4cc4baa6aa18f2fc9919, scope.project.id=fba748115e844a2e9477cdbf52b94ee8, user.id=75e5b85bd9824ea0ab28bed0ccf460fa) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:30.782531 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a2d2c2-5cb0-40ca-9904-2f4e638fe5c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:30.784289 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a2d2c2-5cb0-40ca-9904-2f4e638fe5c6 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:30.790842 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 546/1105] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jun 29 12:09:30 2022] GET /identity/v3/role_assignments?user.id=75e5b85bd9824ea0ab28bed0ccf460fa&scope.project.id=fba748115e844a2e9477cdbf52b94ee8&role.id=e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:09:30.885075 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a46c6-1b49-4eb6-b737-248547b2df77 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:30.922482 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3e349-59f9-4661-a8cc-cec5f18f247d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:30.923149 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3e349-59f9-4661-a8cc-cec5f18f247d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:30.923432 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3e349-59f9-4661-a8cc-cec5f18f247d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:30.923700 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3e349-59f9-4661-a8cc-cec5f18f247d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:30.924560 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b3e349-59f9-4661-a8cc-cec5f18f247d None admin] RBAC: Adding query filter params (role.id=21cea97c141c42a18f5c161141c2a781, scope.project.id=996db30845f84e57865fa40b9a730a05, user.id=7adaa2ef440941aa8214f2b2fd49b54e) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:30.924872 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b3e349-59f9-4661-a8cc-cec5f18f247d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:30.926375 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b3e349-59f9-4661-a8cc-cec5f18f247d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:30.933309 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 560/1106] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jun 29 12:09:30 2022] GET /identity/v3/role_assignments?user.id=7adaa2ef440941aa8214f2b2fd49b54e&scope.project.id=996db30845f84e57865fa40b9a730a05&role.id=21cea97c141c42a18f5c161141c2a781 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:32.863609 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00cb32e-0978-41bd-a501-abb849aff2fb None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:32.864538 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00cb32e-0978-41bd-a501-abb849aff2fb None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:32.864538 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00cb32e-0978-41bd-a501-abb849aff2fb None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:32.866737 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 547/1107] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:09:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:09:32.872070 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02ec1d-98a7-4a29-9a4d-4b50af10f769 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:32.872473 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02ec1d-98a7-4a29-9a4d-4b50af10f769 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:32.872618 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02ec1d-98a7-4a29-9a4d-4b50af10f769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:32.891091 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-9b02ec1d-98a7-4a29-9a4d-4b50af10f769 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:09:32.892278 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9b02ec1d-98a7-4a29-9a4d-4b50af10f769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:09:32.957677 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:32.967007 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 561/1108] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:09:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:09:32.997073 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00cb32e-0978-41bd-a501-abb849aff2fb None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:33.062856 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:33.126107 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00cb32e-0978-41bd-a501-abb849aff2fb None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:33.161704 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02c73d-9232-46c1-b515-b19151c0832d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:33.162521 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02c73d-9232-46c1-b515-b19151c0832d None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:33.162807 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02c73d-9232-46c1-b515-b19151c0832d None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:33.163287 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02c73d-9232-46c1-b515-b19151c0832d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:33.164594 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e02c73d-9232-46c1-b515-b19151c0832d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:33.166129 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e02c73d-9232-46c1-b515-b19151c0832d None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:33.167783 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 548/1109] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:09:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:33.173986 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b02ec1d-98a7-4a29-9a4d-4b50af10f769 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:33.278316 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b02ec1d-98a7-4a29-9a4d-4b50af10f769 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:33.312973 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80ed87-315b-4398-acbd-978ab8e76df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:33.313643 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80ed87-315b-4398-acbd-978ab8e76df1 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:33.313959 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80ed87-315b-4398-acbd-978ab8e76df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:33.314235 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80ed87-315b-4398-acbd-978ab8e76df1 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:33.314955 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f80ed87-315b-4398-acbd-978ab8e76df1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:33.316397 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f80ed87-315b-4398-acbd-978ab8e76df1 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:33.337940 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 562/1110] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Jun 29 12:09:33 2022] POST /identity/v3/users => generated 286 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:09:35.456637 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb9ef5-ede3-4110-8cc4-4260e484845b None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:35.457571 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb9ef5-ede3-4110-8cc4-4260e484845b None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:35.457571 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb9ef5-ede3-4110-8cc4-4260e484845b None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:35.459835 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 549/1111] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:09:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:09:35.466456 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fec116-9da1-48c4-a531-d9572348cab8 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:35.467187 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fec116-9da1-48c4-a531-d9572348cab8 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:35.467337 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fec116-9da1-48c4-a531-d9572348cab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:35.488034 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-49fec116-9da1-48c4-a531-d9572348cab8 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:09:35.489234 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-49fec116-9da1-48c4-a531-d9572348cab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:09:35.544320 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:35.574515 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 563/1112] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:09:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:09:35.598631 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb9ef5-ede3-4110-8cc4-4260e484845b None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:35.710539 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb9ef5-ede3-4110-8cc4-4260e484845b None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:35.724492 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:35.746742 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38089559-7e96-4f19-8169-84cc2cffd1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:35.747598 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38089559-7e96-4f19-8169-84cc2cffd1e0 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:35.747886 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38089559-7e96-4f19-8169-84cc2cffd1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:35.748166 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38089559-7e96-4f19-8169-84cc2cffd1e0 None admin] PATH_INFO: `/v3/roles/ea54879a52d24a47bada5629b6d8b456` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:35.749726 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38089559-7e96-4f19-8169-84cc2cffd1e0 None admin] RBAC: Authorizing `identity:get_role(role_id=ea54879a52d24a47bada5629b6d8b456)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:35.751129 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38089559-7e96-4f19-8169-84cc2cffd1e0 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:35.752519 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 550/1113] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jun 29 12:09:35 2022] GET /identity/v3/roles/ea54879a52d24a47bada5629b6d8b456 => generated 223 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:35.759216 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fec116-9da1-48c4-a531-d9572348cab8 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:35.872861 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fec116-9da1-48c4-a531-d9572348cab8 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:35.915113 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc8693-4d5a-45c3-8caf-068bb1adb673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:35.915974 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc8693-4d5a-45c3-8caf-068bb1adb673 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:35.916249 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc8693-4d5a-45c3-8caf-068bb1adb673 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:35.916517 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc8693-4d5a-45c3-8caf-068bb1adb673 None admin] PATH_INFO: `/v3/users/e5c1e3779c8f4838a3a6aa0cc522a70a` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:35.930760 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bc8693-4d5a-45c3-8caf-068bb1adb673 None admin] RBAC: Authorizing `identity:get_user(user_id=e5c1e3779c8f4838a3a6aa0cc522a70a)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:35.932205 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bc8693-4d5a-45c3-8caf-068bb1adb673 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:35.933868 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 564/1114] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jun 29 12:09:35 2022] GET /identity/v3/users/e5c1e3779c8f4838a3a6aa0cc522a70a => generated 286 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:35.939983 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38089559-7e96-4f19-8169-84cc2cffd1e0 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:36.067911 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38089559-7e96-4f19-8169-84cc2cffd1e0 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:36.106979 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84984b9e-1835-41f0-925c-52adbac66e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:36.107630 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84984b9e-1835-41f0-925c-52adbac66e40 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:36.107919 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84984b9e-1835-41f0-925c-52adbac66e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:36.108195 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84984b9e-1835-41f0-925c-52adbac66e40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:36.161390 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:36.181567 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84984b9e-1835-41f0-925c-52adbac66e40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:36.183055 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84984b9e-1835-41f0-925c-52adbac66e40 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:36.290309 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 551/1115] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:09:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 12:09:36.296670 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc8693-4d5a-45c3-8caf-068bb1adb673 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:36.339459 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:36.408893 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc8693-4d5a-45c3-8caf-068bb1adb673 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:36.445040 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b437f122-2d10-444d-8f86-5c6147948420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:36.445924 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437f122-2d10-444d-8f86-5c6147948420 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:36.446205 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437f122-2d10-444d-8f86-5c6147948420 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:36.446476 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437f122-2d10-444d-8f86-5c6147948420 None admin] PATH_INFO: `/v3/projects/fba748115e844a2e9477cdbf52b94ee8` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:36.447789 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b437f122-2d10-444d-8f86-5c6147948420 None admin] RBAC: Authorizing `identity:get_project(project_id=fba748115e844a2e9477cdbf52b94ee8)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:36.449240 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b437f122-2d10-444d-8f86-5c6147948420 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:36.450995 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 565/1116] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jun 29 12:09:36 2022] GET /identity/v3/projects/fba748115e844a2e9477cdbf52b94ee8 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:36.457921 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84984b9e-1835-41f0-925c-52adbac66e40 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:36.541494 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:36.561719 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84984b9e-1835-41f0-925c-52adbac66e40 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:36.595721 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460404e-285b-4052-84f6-0eb1531d2a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:36.596307 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460404e-285b-4052-84f6-0eb1531d2a28 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:36.596587 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460404e-285b-4052-84f6-0eb1531d2a28 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:36.596861 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460404e-285b-4052-84f6-0eb1531d2a28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:36.597728 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2460404e-285b-4052-84f6-0eb1531d2a28 None admin] RBAC: Adding query filter params (role.id=ea54879a52d24a47bada5629b6d8b456, scope.project.id=fba748115e844a2e9477cdbf52b94ee8, user.id=e5c1e3779c8f4838a3a6aa0cc522a70a) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:36.598029 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2460404e-285b-4052-84f6-0eb1531d2a28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:36.599452 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2460404e-285b-4052-84f6-0eb1531d2a28 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:36.604912 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 552/1117] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jun 29 12:09:36 2022] GET /identity/v3/role_assignments?user.id=e5c1e3779c8f4838a3a6aa0cc522a70a&scope.project.id=fba748115e844a2e9477cdbf52b94ee8&role.id=ea54879a52d24a47bada5629b6d8b456 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:38.606072 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45936e-054a-44bf-9b5c-8f88c60cf1ec None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:38.606655 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45936e-054a-44bf-9b5c-8f88c60cf1ec None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:38.606655 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45936e-054a-44bf-9b5c-8f88c60cf1ec None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:38.608748 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 566/1118] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:09:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:09:38.617433 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80803002-5f61-4355-9b65-7ea9fcd1214f None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:38.617862 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80803002-5f61-4355-9b65-7ea9fcd1214f None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:38.618009 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80803002-5f61-4355-9b65-7ea9fcd1214f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:38.636328 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-80803002-5f61-4355-9b65-7ea9fcd1214f None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:09:38.637533 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-80803002-5f61-4355-9b65-7ea9fcd1214f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:09:38.719651 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 553/1119] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:09:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:09:38.751438 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45936e-054a-44bf-9b5c-8f88c60cf1ec None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:38.862173 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45936e-054a-44bf-9b5c-8f88c60cf1ec None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:38.869569 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:38.900228 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111e6df-31d4-481b-959b-5889b616b34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:38.901081 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111e6df-31d4-481b-959b-5889b616b34c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:38.901367 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111e6df-31d4-481b-959b-5889b616b34c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:38.901640 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111e6df-31d4-481b-959b-5889b616b34c None admin] PATH_INFO: `/v3/roles/ea54879a52d24a47bada5629b6d8b456` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:38.903240 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0111e6df-31d4-481b-959b-5889b616b34c None admin] RBAC: Authorizing `identity:get_role(role_id=ea54879a52d24a47bada5629b6d8b456)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:38.904610 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0111e6df-31d4-481b-959b-5889b616b34c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:38.906024 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 567/1120] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jun 29 12:09:38 2022] GET /identity/v3/roles/ea54879a52d24a47bada5629b6d8b456 => generated 223 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:38.912910 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80803002-5f61-4355-9b65-7ea9fcd1214f None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:39.004676 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:39.037155 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80803002-5f61-4355-9b65-7ea9fcd1214f None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:39.073578 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83cd09a-bc65-4c29-9ad5-c617a4925be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:39.074479 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83cd09a-bc65-4c29-9ad5-c617a4925be4 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:39.074756 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83cd09a-bc65-4c29-9ad5-c617a4925be4 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:39.075030 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83cd09a-bc65-4c29-9ad5-c617a4925be4 None admin] PATH_INFO: `/v3/users/e5c1e3779c8f4838a3a6aa0cc522a70a` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:39.076290 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83cd09a-bc65-4c29-9ad5-c617a4925be4 None admin] RBAC: Authorizing `identity:get_user(user_id=e5c1e3779c8f4838a3a6aa0cc522a70a)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:39.078216 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83cd09a-bc65-4c29-9ad5-c617a4925be4 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:39.079889 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 554/1121] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jun 29 12:09:38 2022] GET /identity/v3/users/e5c1e3779c8f4838a3a6aa0cc522a70a => generated 286 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:39.086303 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111e6df-31d4-481b-959b-5889b616b34c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:39.192143 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111e6df-31d4-481b-959b-5889b616b34c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:39.233921 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d12262c-fd64-4343-a0e3-c103dd6bcb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:39.234780 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12262c-fd64-4343-a0e3-c103dd6bcb62 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:39.235059 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12262c-fd64-4343-a0e3-c103dd6bcb62 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:39.235335 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12262c-fd64-4343-a0e3-c103dd6bcb62 None admin] PATH_INFO: `/v3/projects/fba748115e844a2e9477cdbf52b94ee8` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:39.236657 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d12262c-fd64-4343-a0e3-c103dd6bcb62 None admin] RBAC: Authorizing `identity:get_project(project_id=fba748115e844a2e9477cdbf52b94ee8)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:39.238133 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d12262c-fd64-4343-a0e3-c103dd6bcb62 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:39.239852 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 568/1122] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jun 29 12:09:39 2022] GET /identity/v3/projects/fba748115e844a2e9477cdbf52b94ee8 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:39.247158 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83cd09a-bc65-4c29-9ad5-c617a4925be4 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:39.371010 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83cd09a-bc65-4c29-9ad5-c617a4925be4 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:39.415905 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ccb215-7342-4520-bdee-87ef4f36afa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:39.417356 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccb215-7342-4520-bdee-87ef4f36afa8 None admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:39.417796 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccb215-7342-4520-bdee-87ef4f36afa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:39.418132 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccb215-7342-4520-bdee-87ef4f36afa8 None admin] PATH_INFO: `/v3/projects/fba748115e844a2e9477cdbf52b94ee8/users/e5c1e3779c8f4838a3a6aa0cc522a70a/roles/ea54879a52d24a47bada5629b6d8b456` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:39.422254 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ccb215-7342-4520-bdee-87ef4f36afa8 None admin] RBAC: Authorizing `identity:create_grant(project_id=fba748115e844a2e9477cdbf52b94ee8, user_id=e5c1e3779c8f4838a3a6aa0cc522a70a, role_id=ea54879a52d24a47bada5629b6d8b456)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:39.424553 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ccb215-7342-4520-bdee-87ef4f36afa8 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:39.441099 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 555/1123] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jun 29 12:09:39 2022] PUT /identity/v3/projects/fba748115e844a2e9477cdbf52b94ee8/users/e5c1e3779c8f4838a3a6aa0cc522a70a/roles/ea54879a52d24a47bada5629b6d8b456 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:09:41.443353 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec38c4-7d30-4b21-9b10-b21145635586 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:41.443951 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec38c4-7d30-4b21-9b10-b21145635586 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:41.443951 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec38c4-7d30-4b21-9b10-b21145635586 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:41.445389 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 569/1124] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:09:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:09:41.452063 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ea7b1-4534-4447-9666-68e778d17979 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:41.452830 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ea7b1-4534-4447-9666-68e778d17979 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:41.452971 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ea7b1-4534-4447-9666-68e778d17979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:41.462200 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:41.474255 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-853ea7b1-4534-4447-9666-68e778d17979 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:09:41.475452 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-853ea7b1-4534-4447-9666-68e778d17979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:09:41.549980 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 556/1125] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:09:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:09:41.575287 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec38c4-7d30-4b21-9b10-b21145635586 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:41.633946 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:41.691170 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec38c4-7d30-4b21-9b10-b21145635586 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:41.726492 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851cdde3-c0b8-4fbb-8358-b00d9a850afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:41.727270 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851cdde3-c0b8-4fbb-8358-b00d9a850afe None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:41.727547 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851cdde3-c0b8-4fbb-8358-b00d9a850afe None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:41.727807 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851cdde3-c0b8-4fbb-8358-b00d9a850afe None admin] PATH_INFO: `/v3/roles/ea54879a52d24a47bada5629b6d8b456` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:41.729386 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851cdde3-c0b8-4fbb-8358-b00d9a850afe None admin] RBAC: Authorizing `identity:get_role(role_id=ea54879a52d24a47bada5629b6d8b456)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:41.730786 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851cdde3-c0b8-4fbb-8358-b00d9a850afe None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:41.732158 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 570/1126] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jun 29 12:09:41 2022] GET /identity/v3/roles/ea54879a52d24a47bada5629b6d8b456 => generated 223 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:41.738203 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ea7b1-4534-4447-9666-68e778d17979 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:41.841356 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ea7b1-4534-4447-9666-68e778d17979 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:41.876772 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94a07a-63d5-4f99-b548-d823254e1516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:41.877621 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94a07a-63d5-4f99-b548-d823254e1516 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:41.877925 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94a07a-63d5-4f99-b548-d823254e1516 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:41.878187 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94a07a-63d5-4f99-b548-d823254e1516 None admin] PATH_INFO: `/v3/users/e5c1e3779c8f4838a3a6aa0cc522a70a` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:41.879484 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c94a07a-63d5-4f99-b548-d823254e1516 None admin] RBAC: Authorizing `identity:get_user(user_id=e5c1e3779c8f4838a3a6aa0cc522a70a)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:41.880948 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c94a07a-63d5-4f99-b548-d823254e1516 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:41.882643 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 557/1127] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jun 29 12:09:41 2022] GET /identity/v3/users/e5c1e3779c8f4838a3a6aa0cc522a70a => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:41.888511 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851cdde3-c0b8-4fbb-8358-b00d9a850afe None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:41.995109 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851cdde3-c0b8-4fbb-8358-b00d9a850afe None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:42.009972 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:42.036657 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241389ec-443c-42f8-8072-e0dc8115a0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:42.037307 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241389ec-443c-42f8-8072-e0dc8115a0a6 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:42.037584 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241389ec-443c-42f8-8072-e0dc8115a0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:42.038023 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241389ec-443c-42f8-8072-e0dc8115a0a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:42.112544 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241389ec-443c-42f8-8072-e0dc8115a0a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:42.114018 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241389ec-443c-42f8-8072-e0dc8115a0a6 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:42.219501 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 571/1128] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:09:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 12:09:42.229834 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94a07a-63d5-4f99-b548-d823254e1516 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:42.234620 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:42.339809 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94a07a-63d5-4f99-b548-d823254e1516 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:42.375822 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e50cf0c-0282-409b-a9e4-6fc93994fc47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:42.376677 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50cf0c-0282-409b-a9e4-6fc93994fc47 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:42.376952 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50cf0c-0282-409b-a9e4-6fc93994fc47 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:42.377217 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50cf0c-0282-409b-a9e4-6fc93994fc47 None admin] PATH_INFO: `/v3/projects/fba748115e844a2e9477cdbf52b94ee8` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:42.378531 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e50cf0c-0282-409b-a9e4-6fc93994fc47 None admin] RBAC: Authorizing `identity:get_project(project_id=fba748115e844a2e9477cdbf52b94ee8)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:42.379930 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e50cf0c-0282-409b-a9e4-6fc93994fc47 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:42.381667 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 558/1129] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jun 29 12:09:42 2022] GET /identity/v3/projects/fba748115e844a2e9477cdbf52b94ee8 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:42.391741 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241389ec-443c-42f8-8072-e0dc8115a0a6 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:42.407161 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:42.511344 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241389ec-443c-42f8-8072-e0dc8115a0a6 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:42.548753 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a403c1fa-ef63-4d83-8d56-2334a759c912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:42.549393 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a403c1fa-ef63-4d83-8d56-2334a759c912 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:42.549674 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a403c1fa-ef63-4d83-8d56-2334a759c912 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:42.549971 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a403c1fa-ef63-4d83-8d56-2334a759c912 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:42.550800 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a403c1fa-ef63-4d83-8d56-2334a759c912 None admin] RBAC: Adding query filter params (role.id=ea54879a52d24a47bada5629b6d8b456, scope.project.id=fba748115e844a2e9477cdbf52b94ee8, user.id=e5c1e3779c8f4838a3a6aa0cc522a70a) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:42.551109 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a403c1fa-ef63-4d83-8d56-2334a759c912 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:42.552533 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a403c1fa-ef63-4d83-8d56-2334a759c912 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:42.558678 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 572/1130] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jun 29 12:09:42 2022] GET /identity/v3/role_assignments?user.id=e5c1e3779c8f4838a3a6aa0cc522a70a&scope.project.id=fba748115e844a2e9477cdbf52b94ee8&role.id=ea54879a52d24a47bada5629b6d8b456 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:44.615961 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efce420-e905-4a0c-8137-5c00d10f47d2 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:44.616760 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efce420-e905-4a0c-8137-5c00d10f47d2 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:44.617040 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efce420-e905-4a0c-8137-5c00d10f47d2 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:44.618486 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 559/1131] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:09:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:09:44.624834 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfe608-45ba-4069-85c5-b784345f2054 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:44.625623 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfe608-45ba-4069-85c5-b784345f2054 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:44.625906 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfe608-45ba-4069-85c5-b784345f2054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:44.651858 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-79dfe608-45ba-4069-85c5-b784345f2054 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:09:44.653064 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-79dfe608-45ba-4069-85c5-b784345f2054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:09:44.738187 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 573/1132] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:09:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:09:44.775049 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efce420-e905-4a0c-8137-5c00d10f47d2 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:44.854513 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:44.897737 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efce420-e905-4a0c-8137-5c00d10f47d2 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:44.933344 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c96b5-98dc-430d-a8c3-363be84386b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:44.934148 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c96b5-98dc-430d-a8c3-363be84386b0 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:44.934426 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c96b5-98dc-430d-a8c3-363be84386b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:44.934692 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c96b5-98dc-430d-a8c3-363be84386b0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:44.935959 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c96b5-98dc-430d-a8c3-363be84386b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:44.937394 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c96b5-98dc-430d-a8c3-363be84386b0 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:44.939040 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 560/1133] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:09:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:44.947184 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dfe608-45ba-4069-85c5-b784345f2054 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:44.950455 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:45.059549 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dfe608-45ba-4069-85c5-b784345f2054 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:45.093540 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd3485-f1b2-4599-af0d-b5badeeada5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:45.094225 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd3485-f1b2-4599-af0d-b5badeeada5f None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:45.094504 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd3485-f1b2-4599-af0d-b5badeeada5f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:45.094771 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd3485-f1b2-4599-af0d-b5badeeada5f None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:45.095472 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fd3485-f1b2-4599-af0d-b5badeeada5f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:45.096911 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fd3485-f1b2-4599-af0d-b5badeeada5f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:45.129432 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 574/1134] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Jun 29 12:09:44 2022] POST /identity/v3/projects => generated 311 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:09:47.169028 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f14ee-4e8e-466e-8897-24d4c77e3c29 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:47.169563 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f14ee-4e8e-466e-8897-24d4c77e3c29 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:47.169674 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f14ee-4e8e-466e-8897-24d4c77e3c29 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:47.171801 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 561/1135] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:09:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:09:47.180479 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ebb5a-c473-4fb9-8218-3b2a008262bb None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:47.180901 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ebb5a-c473-4fb9-8218-3b2a008262bb None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:47.181165 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ebb5a-c473-4fb9-8218-3b2a008262bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:47.204158 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-a60ebb5a-c473-4fb9-8218-3b2a008262bb None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:09:47.205357 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a60ebb5a-c473-4fb9-8218-3b2a008262bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:09:47.260790 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:47.289543 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 575/1136] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:09:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:09:47.314838 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f14ee-4e8e-466e-8897-24d4c77e3c29 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:47.427191 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f14ee-4e8e-466e-8897-24d4c77e3c29 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:47.463130 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b6e47-5fc4-44be-bf15-10bdcbd5d568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:47.463908 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b6e47-5fc4-44be-bf15-10bdcbd5d568 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:47.464185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b6e47-5fc4-44be-bf15-10bdcbd5d568 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:47.464451 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b6e47-5fc4-44be-bf15-10bdcbd5d568 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:47.465761 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355b6e47-5fc4-44be-bf15-10bdcbd5d568 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:47.467239 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355b6e47-5fc4-44be-bf15-10bdcbd5d568 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:47.468860 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 562/1137] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:09:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:47.477939 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ebb5a-c473-4fb9-8218-3b2a008262bb None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:47.588461 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ebb5a-c473-4fb9-8218-3b2a008262bb None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:47.624664 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1510230d-ad8f-40d5-8636-56df1996fa6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:47.625312 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510230d-ad8f-40d5-8636-56df1996fa6b None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:47.625585 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510230d-ad8f-40d5-8636-56df1996fa6b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:47.625887 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510230d-ad8f-40d5-8636-56df1996fa6b None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:47.626589 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1510230d-ad8f-40d5-8636-56df1996fa6b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:47.628017 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1510230d-ad8f-40d5-8636-56df1996fa6b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:47.650164 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 576/1138] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Jun 29 12:09:47 2022] POST /identity/v3/users => generated 286 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:09:49.715228 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe0e6e-d2eb-466a-886a-a23d3a780690 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:49.715794 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe0e6e-d2eb-466a-886a-a23d3a780690 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:49.715794 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe0e6e-d2eb-466a-886a-a23d3a780690 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:49.717188 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 563/1139] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:09:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:09:49.723763 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aad07c-7df3-4a79-8556-9b9485096810 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:49.724478 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aad07c-7df3-4a79-8556-9b9485096810 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:49.724627 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aad07c-7df3-4a79-8556-9b9485096810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:49.750556 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-56aad07c-7df3-4a79-8556-9b9485096810 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:09:49.751743 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-56aad07c-7df3-4a79-8556-9b9485096810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:09:49.791207 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:49.825807 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 577/1140] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:09:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:09:49.850418 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe0e6e-d2eb-466a-886a-a23d3a780690 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:49.863811 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:49.967502 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe0e6e-d2eb-466a-886a-a23d3a780690 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:50.004743 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a481c6-5831-477a-bf8f-58feb6c60c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:50.005523 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a481c6-5831-477a-bf8f-58feb6c60c5d None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:50.005844 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a481c6-5831-477a-bf8f-58feb6c60c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:50.006123 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a481c6-5831-477a-bf8f-58feb6c60c5d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:50.017576 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a481c6-5831-477a-bf8f-58feb6c60c5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:09:50.025361 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-b6a481c6-5831-477a-bf8f-58feb6c60c5d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:09:50.025361 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:50.025361 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:50.025361 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:50.025361 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:50.025361 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:50.025361 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:50.025361 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:50.025361 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:50.025361 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:50.025361 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:50.025361 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:50.025361 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:09:50.025361 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:09:50.025361 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:09:50.025361 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:09:50.026530 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:09:50.026530 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:09:50.026530 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:09:50.026530 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:09:50.026530 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:50.026530 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:50.026530 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:09:50.026530 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:09:50.026530 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:09:50.026530 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:09:50.026530 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:09:50.026530 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:09:50.026530 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:09:50.026530 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:09:50.026530 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:09:50.026530 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:09:50.027878 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:09:50.027878 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:09:50.027878 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:09:50.027878 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:09:50.027878 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:09:50.027878 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:09:50.027878 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:09:50.027878 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:09:50.027878 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:09:50.027878 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:09:50.027878 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:09:50.027878 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:09:50.027878 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 564/1141] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jun 29 12:09:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:09:50.035097 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aad07c-7df3-4a79-8556-9b9485096810 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:50.150701 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aad07c-7df3-4a79-8556-9b9485096810 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:50.188022 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a5344-3035-405f-8d1d-19119da92ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:50.188731 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a5344-3035-405f-8d1d-19119da92ab6 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:50.189013 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a5344-3035-405f-8d1d-19119da92ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:50.189290 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a5344-3035-405f-8d1d-19119da92ab6 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:50.190077 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48a5344-3035-405f-8d1d-19119da92ab6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:50.190373 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48a5344-3035-405f-8d1d-19119da92ab6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:50.191800 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48a5344-3035-405f-8d1d-19119da92ab6 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:50.200550 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 578/1142] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:09:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:50.207727 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a481c6-5831-477a-bf8f-58feb6c60c5d None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:50.287592 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:50.324976 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a481c6-5831-477a-bf8f-58feb6c60c5d None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:50.360381 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828d8bfd-b021-4ab6-8398-6620a9653078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:50.361253 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d8bfd-b021-4ab6-8398-6620a9653078 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:50.361539 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d8bfd-b021-4ab6-8398-6620a9653078 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:50.361854 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d8bfd-b021-4ab6-8398-6620a9653078 None admin] PATH_INFO: `/v3/users/dfe3b613a3384eaca2b901d5a406af28` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:50.375294 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828d8bfd-b021-4ab6-8398-6620a9653078 None admin] RBAC: Authorizing `identity:get_user(user_id=dfe3b613a3384eaca2b901d5a406af28)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:50.376741 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828d8bfd-b021-4ab6-8398-6620a9653078 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:50.378454 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 565/1143] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jun 29 12:09:50 2022] GET /identity/v3/users/dfe3b613a3384eaca2b901d5a406af28 => generated 286 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:50.386286 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a5344-3035-405f-8d1d-19119da92ab6 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:50.426230 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:50.500240 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a5344-3035-405f-8d1d-19119da92ab6 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:50.536494 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13aca8-4e9d-4d71-9ade-cc7e26d6e8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:50.537130 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13aca8-4e9d-4d71-9ade-cc7e26d6e8f2 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:50.537408 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13aca8-4e9d-4d71-9ade-cc7e26d6e8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:50.537787 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13aca8-4e9d-4d71-9ade-cc7e26d6e8f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:50.625629 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd13aca8-4e9d-4d71-9ade-cc7e26d6e8f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:50.627120 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd13aca8-4e9d-4d71-9ade-cc7e26d6e8f2 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:50.669493 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:50.738455 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 579/1144] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:09:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 12:09:50.744955 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828d8bfd-b021-4ab6-8398-6620a9653078 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:50.862022 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828d8bfd-b021-4ab6-8398-6620a9653078 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:50.887839 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:50.908569 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6bc30-97a6-45bd-8d33-f5c1c8667f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:50.909990 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6bc30-97a6-45bd-8d33-f5c1c8667f1d None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:50.910461 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6bc30-97a6-45bd-8d33-f5c1c8667f1d None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:50.910911 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6bc30-97a6-45bd-8d33-f5c1c8667f1d None admin] PATH_INFO: `/v3/projects/92841305c7b847ab875291a4a92610f1` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:50.913002 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc6bc30-97a6-45bd-8d33-f5c1c8667f1d None admin] RBAC: Authorizing `identity:get_project(project_id=92841305c7b847ab875291a4a92610f1)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:50.914491 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc6bc30-97a6-45bd-8d33-f5c1c8667f1d None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:50.916250 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 566/1145] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jun 29 12:09:50 2022] GET /identity/v3/projects/92841305c7b847ab875291a4a92610f1 => generated 311 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:09:50.923119 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13aca8-4e9d-4d71-9ade-cc7e26d6e8f2 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:51.042898 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13aca8-4e9d-4d71-9ade-cc7e26d6e8f2 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:51.088317 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98c5782-e839-4d52-91e2-074998c2d37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:51.088993 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c5782-e839-4d52-91e2-074998c2d37a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:51.089267 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c5782-e839-4d52-91e2-074998c2d37a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:51.089590 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c5782-e839-4d52-91e2-074998c2d37a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:51.090395 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98c5782-e839-4d52-91e2-074998c2d37a None admin] RBAC: Adding query filter params (role.id=e0e69ac8a8bf4cc4baa6aa18f2fc9919, scope.project.id=92841305c7b847ab875291a4a92610f1, user.id=dfe3b613a3384eaca2b901d5a406af28) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:51.090703 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98c5782-e839-4d52-91e2-074998c2d37a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:51.092138 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98c5782-e839-4d52-91e2-074998c2d37a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:51.093943 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:51.097991 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 580/1146] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jun 29 12:09:50 2022] GET /identity/v3/role_assignments?user.id=dfe3b613a3384eaca2b901d5a406af28&scope.project.id=92841305c7b847ab875291a4a92610f1&role.id=e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:53.086175 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da411ca0-f04e-440a-9165-9da6d7157bbd None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:53.086970 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da411ca0-f04e-440a-9165-9da6d7157bbd None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:53.087121 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da411ca0-f04e-440a-9165-9da6d7157bbd None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:53.089350 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 567/1147] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:09:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:09:53.095671 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd00a57-7033-4481-800d-b3efc3097777 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:53.096427 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd00a57-7033-4481-800d-b3efc3097777 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:53.096575 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd00a57-7033-4481-800d-b3efc3097777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:53.116260 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-fcd00a57-7033-4481-800d-b3efc3097777 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:09:53.117542 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-fcd00a57-7033-4481-800d-b3efc3097777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:09:53.188916 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 581/1148] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:09:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:09:53.214781 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da411ca0-f04e-440a-9165-9da6d7157bbd None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:53.325065 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da411ca0-f04e-440a-9165-9da6d7157bbd None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:53.370318 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c09ad-7fd5-4787-99fd-7b7ef659531c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:53.371108 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c09ad-7fd5-4787-99fd-7b7ef659531c None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:53.371384 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c09ad-7fd5-4787-99fd-7b7ef659531c None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:53.371659 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c09ad-7fd5-4787-99fd-7b7ef659531c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:53.383646 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542c09ad-7fd5-4787-99fd-7b7ef659531c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:09:53.391187 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-542c09ad-7fd5-4787-99fd-7b7ef659531c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:09:53.391187 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:53.391187 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:53.391187 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:53.391187 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:53.391187 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:53.391187 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:53.391187 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:53.391187 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:53.391187 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:53.391187 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:53.391187 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:53.391187 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:09:53.391187 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:09:53.391187 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:09:53.391187 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:09:53.392262 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:09:53.392262 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:09:53.392262 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:09:53.392262 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:09:53.392262 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:53.392262 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:53.392262 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:09:53.392262 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:09:53.392262 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:09:53.392262 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:09:53.392262 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:09:53.392262 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:09:53.392262 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:09:53.392262 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:09:53.392262 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:09:53.392262 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:09:53.393431 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:09:53.393431 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:09:53.393431 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:09:53.393431 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:09:53.393431 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:09:53.393431 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:09:53.393431 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:09:53.393431 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:09:53.393431 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:09:53.393431 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:09:53.393431 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:09:53.393431 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:09:53.393431 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 568/1149] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jun 29 12:09:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:09:53.403098 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd00a57-7033-4481-800d-b3efc3097777 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:53.516605 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd00a57-7033-4481-800d-b3efc3097777 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:53.543807 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:53.552065 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1263c5ca-44ec-4858-80d5-4fb166d08576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:53.552730 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263c5ca-44ec-4858-80d5-4fb166d08576 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:53.553013 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263c5ca-44ec-4858-80d5-4fb166d08576 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:53.553466 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263c5ca-44ec-4858-80d5-4fb166d08576 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:53.554301 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1263c5ca-44ec-4858-80d5-4fb166d08576 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:53.554600 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1263c5ca-44ec-4858-80d5-4fb166d08576 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:53.555982 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1263c5ca-44ec-4858-80d5-4fb166d08576 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:53.564376 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 582/1150] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:09:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:53.570692 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c09ad-7fd5-4787-99fd-7b7ef659531c None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:53.626757 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:53.675837 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c09ad-7fd5-4787-99fd-7b7ef659531c None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:53.715325 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b1255-b42f-455f-aa5f-1b4b007a7a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:53.716237 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b1255-b42f-455f-aa5f-1b4b007a7a44 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:53.716516 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b1255-b42f-455f-aa5f-1b4b007a7a44 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:53.716789 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b1255-b42f-455f-aa5f-1b4b007a7a44 None admin] PATH_INFO: `/v3/users/dfe3b613a3384eaca2b901d5a406af28` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:53.718086 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280b1255-b42f-455f-aa5f-1b4b007a7a44 None admin] RBAC: Authorizing `identity:get_user(user_id=dfe3b613a3384eaca2b901d5a406af28)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:53.719545 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280b1255-b42f-455f-aa5f-1b4b007a7a44 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:53.721242 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 569/1151] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jun 29 12:09:53 2022] GET /identity/v3/users/dfe3b613a3384eaca2b901d5a406af28 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:53.727839 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1263c5ca-44ec-4858-80d5-4fb166d08576 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:53.849854 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1263c5ca-44ec-4858-80d5-4fb166d08576 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:53.889421 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f7a08-f05a-4fc6-a3c2-1e9b2e76177e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:53.890227 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f7a08-f05a-4fc6-a3c2-1e9b2e76177e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:53.890508 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f7a08-f05a-4fc6-a3c2-1e9b2e76177e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:53.890771 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f7a08-f05a-4fc6-a3c2-1e9b2e76177e None admin] PATH_INFO: `/v3/projects/92841305c7b847ab875291a4a92610f1` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:53.892003 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f7a08-f05a-4fc6-a3c2-1e9b2e76177e None admin] RBAC: Authorizing `identity:get_project(project_id=92841305c7b847ab875291a4a92610f1)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:53.893440 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f7a08-f05a-4fc6-a3c2-1e9b2e76177e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:53.895176 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 583/1152] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jun 29 12:09:53 2022] GET /identity/v3/projects/92841305c7b847ab875291a4a92610f1 => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:53.904990 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b1255-b42f-455f-aa5f-1b4b007a7a44 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:54.035675 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b1255-b42f-455f-aa5f-1b4b007a7a44 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:54.058060 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:54.076734 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6494de-fc7b-44f2-bcc7-d09777d7b28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:54.077642 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6494de-fc7b-44f2-bcc7-d09777d7b28b None admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:54.078028 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6494de-fc7b-44f2-bcc7-d09777d7b28b None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:54.078300 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6494de-fc7b-44f2-bcc7-d09777d7b28b None admin] PATH_INFO: `/v3/projects/92841305c7b847ab875291a4a92610f1/users/dfe3b613a3384eaca2b901d5a406af28/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:54.080565 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6494de-fc7b-44f2-bcc7-d09777d7b28b None admin] RBAC: Authorizing `identity:create_grant(project_id=92841305c7b847ab875291a4a92610f1, user_id=dfe3b613a3384eaca2b901d5a406af28, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:54.082051 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6494de-fc7b-44f2-bcc7-d09777d7b28b None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:54.098120 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 570/1153] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jun 29 12:09:53 2022] PUT /identity/v3/projects/92841305c7b847ab875291a4a92610f1/users/dfe3b613a3384eaca2b901d5a406af28/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:09:56.121599 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb7059-bdb6-40e9-b604-075201933d9d None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:56.122532 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb7059-bdb6-40e9-b604-075201933d9d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:56.122532 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb7059-bdb6-40e9-b604-075201933d9d None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:56.124738 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 584/1154] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:09:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:09:56.130176 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145dd268-2cd3-4610-a1db-33235df3dc5d None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:56.130596 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145dd268-2cd3-4610-a1db-33235df3dc5d None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:56.130703 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145dd268-2cd3-4610-a1db-33235df3dc5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:56.150155 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-145dd268-2cd3-4610-a1db-33235df3dc5d None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:09:56.151335 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-145dd268-2cd3-4610-a1db-33235df3dc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:09:56.230876 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 571/1155] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:09:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:09:56.255144 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb7059-bdb6-40e9-b604-075201933d9d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:56.325146 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:56.382981 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb7059-bdb6-40e9-b604-075201933d9d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:56.421287 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee90108-13f0-414e-8e10-0fe1a83f3a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:56.422096 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee90108-13f0-414e-8e10-0fe1a83f3a40 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:56.422376 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee90108-13f0-414e-8e10-0fe1a83f3a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:56.422648 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee90108-13f0-414e-8e10-0fe1a83f3a40 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:56.433872 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee90108-13f0-414e-8e10-0fe1a83f3a40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:09:56.441417 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-3ee90108-13f0-414e-8e10-0fe1a83f3a40 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:09:56.441417 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:09:56.441417 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:09:56.441417 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:09:56.441417 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:09:56.441417 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:09:56.441417 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:09:56.441417 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:09:56.441417 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:09:56.441417 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:09:56.441417 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:09:56.441417 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:09:56.441417 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:09:56.441417 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:09:56.441417 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:09:56.441417 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:09:56.442504 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:09:56.442504 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:09:56.442504 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:09:56.442504 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:09:56.442504 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:09:56.442504 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:09:56.442504 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:09:56.442504 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:09:56.442504 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:09:56.442504 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:09:56.442504 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:09:56.442504 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:09:56.442504 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:09:56.442504 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:09:56.442504 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:09:56.442504 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:09:56.443926 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:09:56.443926 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:09:56.443926 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:09:56.443926 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:09:56.443926 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:09:56.443926 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:09:56.443926 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:09:56.443926 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:09:56.443926 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:09:56.443926 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:09:56.443926 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:09:56.443926 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:09:56.443926 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 585/1156] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jun 29 12:09:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:09:56.452131 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145dd268-2cd3-4610-a1db-33235df3dc5d None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:56.558096 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145dd268-2cd3-4610-a1db-33235df3dc5d None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:56.570386 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:56.598941 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1322dad-8ccb-4eae-8be9-0b8d353be596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:56.599533 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1322dad-8ccb-4eae-8be9-0b8d353be596 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:56.599817 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1322dad-8ccb-4eae-8be9-0b8d353be596 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:56.600133 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1322dad-8ccb-4eae-8be9-0b8d353be596 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:56.600851 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1322dad-8ccb-4eae-8be9-0b8d353be596 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:56.601183 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1322dad-8ccb-4eae-8be9-0b8d353be596 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:56.602595 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1322dad-8ccb-4eae-8be9-0b8d353be596 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:56.611488 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 572/1157] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:09:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:56.619270 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee90108-13f0-414e-8e10-0fe1a83f3a40 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:56.731430 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee90108-13f0-414e-8e10-0fe1a83f3a40 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:56.748777 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:56.767897 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ae844-5283-44fa-8325-2ecb1c8134a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:56.768769 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ae844-5283-44fa-8325-2ecb1c8134a9 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:56.769046 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ae844-5283-44fa-8325-2ecb1c8134a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:56.769314 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ae844-5283-44fa-8325-2ecb1c8134a9 None admin] PATH_INFO: `/v3/users/dfe3b613a3384eaca2b901d5a406af28` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:56.770675 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ae844-5283-44fa-8325-2ecb1c8134a9 None admin] RBAC: Authorizing `identity:get_user(user_id=dfe3b613a3384eaca2b901d5a406af28)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:56.772200 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ae844-5283-44fa-8325-2ecb1c8134a9 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:56.773877 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 586/1158] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jun 29 12:09:56 2022] GET /identity/v3/users/dfe3b613a3384eaca2b901d5a406af28 => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:56.780741 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1322dad-8ccb-4eae-8be9-0b8d353be596 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:56.889811 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1322dad-8ccb-4eae-8be9-0b8d353be596 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:56.926935 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d1b35b-0c20-4d47-b8ed-fa0dcda7dc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:56.927865 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1b35b-0c20-4d47-b8ed-fa0dcda7dc7e None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:56.928182 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1b35b-0c20-4d47-b8ed-fa0dcda7dc7e None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:56.928559 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1b35b-0c20-4d47-b8ed-fa0dcda7dc7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:56.978134 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:57.008742 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d1b35b-0c20-4d47-b8ed-fa0dcda7dc7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:57.010232 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d1b35b-0c20-4d47-b8ed-fa0dcda7dc7e None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:57.131674 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 573/1159] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:09:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 12:09:57.138530 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ae844-5283-44fa-8325-2ecb1c8134a9 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:57.257052 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ae844-5283-44fa-8325-2ecb1c8134a9 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:57.293207 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc94b4d0-2f62-47c3-8439-4bae5f8eaeb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:57.294089 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94b4d0-2f62-47c3-8439-4bae5f8eaeb6 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:57.294370 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94b4d0-2f62-47c3-8439-4bae5f8eaeb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:57.294643 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94b4d0-2f62-47c3-8439-4bae5f8eaeb6 None admin] PATH_INFO: `/v3/projects/92841305c7b847ab875291a4a92610f1` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:57.295943 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc94b4d0-2f62-47c3-8439-4bae5f8eaeb6 None admin] RBAC: Authorizing `identity:get_project(project_id=92841305c7b847ab875291a4a92610f1)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:57.297408 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc94b4d0-2f62-47c3-8439-4bae5f8eaeb6 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:57.299171 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 587/1160] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jun 29 12:09:57 2022] GET /identity/v3/projects/92841305c7b847ab875291a4a92610f1 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:57.305989 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d1b35b-0c20-4d47-b8ed-fa0dcda7dc7e None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:57.377711 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:57.415595 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d1b35b-0c20-4d47-b8ed-fa0dcda7dc7e None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:57.454277 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d610001b-0855-4aac-bc1c-bc70f067f6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:57.454922 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610001b-0855-4aac-bc1c-bc70f067f6b0 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:57.455198 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610001b-0855-4aac-bc1c-bc70f067f6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:57.455472 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610001b-0855-4aac-bc1c-bc70f067f6b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:57.456301 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d610001b-0855-4aac-bc1c-bc70f067f6b0 None admin] RBAC: Adding query filter params (role.id=e0e69ac8a8bf4cc4baa6aa18f2fc9919, scope.project.id=92841305c7b847ab875291a4a92610f1, user.id=dfe3b613a3384eaca2b901d5a406af28) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:09:57.456613 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d610001b-0855-4aac-bc1c-bc70f067f6b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:57.458066 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d610001b-0855-4aac-bc1c-bc70f067f6b0 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:57.464124 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 574/1161] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jun 29 12:09:57 2022] GET /identity/v3/role_assignments?user.id=dfe3b613a3384eaca2b901d5a406af28&scope.project.id=92841305c7b847ab875291a4a92610f1&role.id=e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:09:59.505776 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291cba80-4017-4e12-a76d-095942c180aa None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:59.506671 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291cba80-4017-4e12-a76d-095942c180aa None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:59.507092 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291cba80-4017-4e12-a76d-095942c180aa None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:59.509299 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 588/1162] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:09:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:09:59.515680 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2afd16d-c49d-4af4-b1c8-11dea48a9315 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:59.516414 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2afd16d-c49d-4af4-b1c8-11dea48a9315 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:59.516558 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2afd16d-c49d-4af4-b1c8-11dea48a9315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:59.536905 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-b2afd16d-c49d-4af4-b1c8-11dea48a9315 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:09:59.538396 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-b2afd16d-c49d-4af4-b1c8-11dea48a9315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:09:59.615322 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 575/1163] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:09:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:09:59.651234 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291cba80-4017-4e12-a76d-095942c180aa None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:09:59.729059 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:09:59.784665 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291cba80-4017-4e12-a76d-095942c180aa None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:09:59.828175 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99dbfd-aed1-4398-bbea-e64230c3ec0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:09:59.828821 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99dbfd-aed1-4398-bbea-e64230c3ec0c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:09:59.829104 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99dbfd-aed1-4398-bbea-e64230c3ec0c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:09:59.829377 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99dbfd-aed1-4398-bbea-e64230c3ec0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:09:59.897045 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c99dbfd-aed1-4398-bbea-e64230c3ec0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:09:59.898569 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c99dbfd-aed1-4398-bbea-e64230c3ec0c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:09:59.959014 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:00.006911 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 589/1164] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:09:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 12:10:00.016719 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2afd16d-c49d-4af4-b1c8-11dea48a9315 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:00.098566 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:00.133787 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2afd16d-c49d-4af4-b1c8-11dea48a9315 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:00.169254 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d64c07-575c-449c-b296-034c9bbc1b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:00.170076 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d64c07-575c-449c-b296-034c9bbc1b9a None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:00.170378 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d64c07-575c-449c-b296-034c9bbc1b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:00.170645 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d64c07-575c-449c-b296-034c9bbc1b9a None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:00.177810 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d64c07-575c-449c-b296-034c9bbc1b9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:00.179810 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d64c07-575c-449c-b296-034c9bbc1b9a None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:00.194088 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-e1d64c07-575c-449c-b296-034c9bbc1b9a None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 29 12:10:00.194088 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:10:00.194088 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 29 12:10:00.194088 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 29 12:10:00.194088 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:10:00.194088 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:10:00.194088 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:10:00.194088 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:10:00.194088 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 29 12:10:00.194088 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:10:00.194088 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 12:10:00.194088 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:10:00.194088 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:10:00.194088 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:10:00.194088 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:10:00.194088 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:10:00.194088 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:10:00.195239 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:10:00.195239 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:10:00.195239 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:10:00.195239 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:10:00.195239 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:10:00.195239 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:10:00.195239 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:10:00.195239 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:10:00.195239 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:10:00.195239 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:10:00.195239 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:10:00.195239 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:10:00.195239 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:10:00.195239 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:10:00.195239 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:10:00.195239 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:10:00.196567 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:10:00.196567 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:10:00.196567 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:10:00.196567 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:10:00.196567 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:10:00.196567 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:10:00.196567 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:10:00.196567 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:10:00.196567 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:10:00.196567 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:10:00.196567 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 29 12:10:00.196567 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:10:00.196567 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 29 12:10:00.196567 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:10:00.196567 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 576/1165] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Jun 29 12:10:00 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:10:00.202091 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99dbfd-aed1-4398-bbea-e64230c3ec0c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:00.311816 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99dbfd-aed1-4398-bbea-e64230c3ec0c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:00.352589 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2190381d-4597-4895-bbc9-66053d4b1f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:00.353244 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190381d-4597-4895-bbc9-66053d4b1f71 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:00.353522 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190381d-4597-4895-bbc9-66053d4b1f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:00.353816 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190381d-4597-4895-bbc9-66053d4b1f71 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:00.354549 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2190381d-4597-4895-bbc9-66053d4b1f71 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:10:00.354856 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2190381d-4597-4895-bbc9-66053d4b1f71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:00.356226 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2190381d-4597-4895-bbc9-66053d4b1f71 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:00.364191 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 590/1166] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Jun 29 12:10:00 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:10:02.369016 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a02a3d-55b7-44f8-8763-7c2e20b111c1 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:02.369908 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a02a3d-55b7-44f8-8763-7c2e20b111c1 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:02.370173 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a02a3d-55b7-44f8-8763-7c2e20b111c1 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:02.372423 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 577/1167] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:10:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:10:02.377910 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d10d22-3f91-456f-9ef4-ef0c2ebfaa9c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:02.378331 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d10d22-3f91-456f-9ef4-ef0c2ebfaa9c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:02.378449 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d10d22-3f91-456f-9ef4-ef0c2ebfaa9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:02.397568 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-a5d10d22-3f91-456f-9ef4-ef0c2ebfaa9c None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:10:02.398795 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a5d10d22-3f91-456f-9ef4-ef0c2ebfaa9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:10:02.413955 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:02.475491 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 591/1168] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:10:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:10:02.504522 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a02a3d-55b7-44f8-8763-7c2e20b111c1 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:02.622934 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a02a3d-55b7-44f8-8763-7c2e20b111c1 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:02.651598 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:02.661585 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776154d1-c262-4946-a799-93d2ec91b91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:02.662272 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776154d1-c262-4946-a799-93d2ec91b91e None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:02.662545 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776154d1-c262-4946-a799-93d2ec91b91e None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:02.662861 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776154d1-c262-4946-a799-93d2ec91b91e None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:02.663631 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776154d1-c262-4946-a799-93d2ec91b91e None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:02.665025 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776154d1-c262-4946-a799-93d2ec91b91e None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:02.682568 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 578/1169] 10.222.0.27 () {60 vars in 1138 bytes} [Wed Jun 29 12:10:02 2022] POST /identity/v3/domains => generated 267 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:10:04.770531 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc38d2-8440-44ab-96f9-3d8802512280 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:04.771392 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc38d2-8440-44ab-96f9-3d8802512280 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:04.771392 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc38d2-8440-44ab-96f9-3d8802512280 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:04.773234 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 592/1170] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:10:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:10:04.778685 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1dc0b-65ce-492d-afe3-6928d25841c8 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:04.779108 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1dc0b-65ce-492d-afe3-6928d25841c8 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:04.779220 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1dc0b-65ce-492d-afe3-6928d25841c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:04.798045 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-b0e1dc0b-65ce-492d-afe3-6928d25841c8 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:10:04.799216 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-b0e1dc0b-65ce-492d-afe3-6928d25841c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:10:04.871245 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 579/1171] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:10:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:10:04.900389 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc38d2-8440-44ab-96f9-3d8802512280 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:05.021915 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc38d2-8440-44ab-96f9-3d8802512280 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:05.059142 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b70e7e-3bc4-4e56-8e89-67a8b3c6e4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:05.060029 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b70e7e-3bc4-4e56-8e89-67a8b3c6e4c0 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:05.060314 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b70e7e-3bc4-4e56-8e89-67a8b3c6e4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:05.060570 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b70e7e-3bc4-4e56-8e89-67a8b3c6e4c0 None admin] PATH_INFO: `/v3/domains/7da8823b75a842bcaa93ea3787aa3490` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:05.072479 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b70e7e-3bc4-4e56-8e89-67a8b3c6e4c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=7da8823b75a842bcaa93ea3787aa3490)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:05.074009 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b70e7e-3bc4-4e56-8e89-67a8b3c6e4c0 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:05.075721 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 593/1172] 10.222.0.27 () {56 vars in 1183 bytes} [Wed Jun 29 12:10:04 2022] GET /identity/v3/domains/7da8823b75a842bcaa93ea3787aa3490 => generated 267 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:10:05.082090 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e1dc0b-65ce-492d-afe3-6928d25841c8 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:05.186293 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e1dc0b-65ce-492d-afe3-6928d25841c8 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:05.203543 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:05.224479 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d57733-d21f-497f-aab1-441442f4eaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:05.225326 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d57733-d21f-497f-aab1-441442f4eaa7 None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:05.225606 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d57733-d21f-497f-aab1-441442f4eaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:05.225923 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d57733-d21f-497f-aab1-441442f4eaa7 None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:05.226632 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d57733-d21f-497f-aab1-441442f4eaa7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:05.228064 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d57733-d21f-497f-aab1-441442f4eaa7 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:05.260868 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 580/1173] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Jun 29 12:10:05 2022] POST /identity/v3/projects => generated 361 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:10:07.347785 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e4e7d-da15-41f1-867d-ff62d5af316f None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:07.348385 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e4e7d-da15-41f1-867d-ff62d5af316f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:07.348385 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e4e7d-da15-41f1-867d-ff62d5af316f None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:07.349721 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 594/1174] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:10:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:10:07.356668 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e195220-fb7b-42a1-925e-81f6779e87e1 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:07.357455 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e195220-fb7b-42a1-925e-81f6779e87e1 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:07.357593 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e195220-fb7b-42a1-925e-81f6779e87e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:07.384678 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-3e195220-fb7b-42a1-925e-81f6779e87e1 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:10:07.385914 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-3e195220-fb7b-42a1-925e-81f6779e87e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:10:07.458067 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 581/1175] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:10:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:10:07.489011 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e4e7d-da15-41f1-867d-ff62d5af316f None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:07.502506 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:07.600969 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e4e7d-da15-41f1-867d-ff62d5af316f None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:07.637490 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e1e59c-e66e-4a32-8725-2ef47820b5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:07.638373 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1e59c-e66e-4a32-8725-2ef47820b5aa None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:07.638647 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1e59c-e66e-4a32-8725-2ef47820b5aa None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:07.638919 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1e59c-e66e-4a32-8725-2ef47820b5aa None admin] PATH_INFO: `/v3/domains/7da8823b75a842bcaa93ea3787aa3490` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:07.640137 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e1e59c-e66e-4a32-8725-2ef47820b5aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=7da8823b75a842bcaa93ea3787aa3490)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:07.641587 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e1e59c-e66e-4a32-8725-2ef47820b5aa None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:07.643251 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 595/1176] 10.222.0.27 () {56 vars in 1183 bytes} [Wed Jun 29 12:10:07 2022] GET /identity/v3/domains/7da8823b75a842bcaa93ea3787aa3490 => generated 267 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:10:07.649206 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e195220-fb7b-42a1-925e-81f6779e87e1 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:07.755809 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:07.760149 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e195220-fb7b-42a1-925e-81f6779e87e1 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:07.795486 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb8b85a-9b53-4c70-ac25-dfaa6860696f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:07.796150 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8b85a-9b53-4c70-ac25-dfaa6860696f None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:07.796431 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8b85a-9b53-4c70-ac25-dfaa6860696f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:07.796704 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8b85a-9b53-4c70-ac25-dfaa6860696f None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:07.797415 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb8b85a-9b53-4c70-ac25-dfaa6860696f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:07.798887 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb8b85a-9b53-4c70-ac25-dfaa6860696f None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:07.822888 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 582/1177] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Jun 29 12:10:07 2022] POST /identity/v3/users => generated 311 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:10:09.889981 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababe9e5-0755-45e6-b2ed-f5539d553746 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:09.890567 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababe9e5-0755-45e6-b2ed-f5539d553746 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:09.890567 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababe9e5-0755-45e6-b2ed-f5539d553746 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:09.891928 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 596/1178] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:10:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:10:09.898817 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb8bde-4553-44de-89cc-e805a92002e1 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:09.899501 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb8bde-4553-44de-89cc-e805a92002e1 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:09.900775 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb8bde-4553-44de-89cc-e805a92002e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:09.922988 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-9bfb8bde-4553-44de-89cc-e805a92002e1 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:10:09.924171 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-9bfb8bde-4553-44de-89cc-e805a92002e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:10:10.000028 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 583/1179] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:10:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:10:10.032747 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ababe9e5-0755-45e6-b2ed-f5539d553746 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:10.116483 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:10.142704 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ababe9e5-0755-45e6-b2ed-f5539d553746 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:10.178181 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46677625-c549-41a7-91b9-0c0511521640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:10.178972 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46677625-c549-41a7-91b9-0c0511521640 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:10.179252 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46677625-c549-41a7-91b9-0c0511521640 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:10.179524 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46677625-c549-41a7-91b9-0c0511521640 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:10.190848 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46677625-c549-41a7-91b9-0c0511521640 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:10:10.198543 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-46677625-c549-41a7-91b9-0c0511521640 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:10:10.198543 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:10:10.198543 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:10:10.198543 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:10:10.198543 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:10:10.198543 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:10:10.198543 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:10:10.198543 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:10:10.198543 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:10:10.198543 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:10:10.198543 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:10:10.198543 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:10:10.198543 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:10:10.198543 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:10:10.198543 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:10:10.198543 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:10:10.199686 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:10:10.199686 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:10:10.199686 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:10:10.199686 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:10:10.199686 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:10:10.199686 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:10:10.199686 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:10:10.199686 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:10:10.199686 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:10:10.199686 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:10:10.199686 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:10:10.199686 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:10:10.199686 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:10:10.199686 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:10:10.199686 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:10:10.199686 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:10:10.200842 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:10:10.200842 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:10:10.200842 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:10:10.200842 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:10:10.200842 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:10:10.200842 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:10:10.200842 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:10:10.200842 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:10:10.200842 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:10:10.200842 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:10:10.200842 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:10:10.200842 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:10:10.200842 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 597/1180] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jun 29 12:10:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:10:10.207015 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb8bde-4553-44de-89cc-e805a92002e1 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:10.297144 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:10.315461 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb8bde-4553-44de-89cc-e805a92002e1 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:10.349464 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a6c19-7648-4993-83bd-13ed4158a554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:10.350208 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a6c19-7648-4993-83bd-13ed4158a554 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:10.350495 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a6c19-7648-4993-83bd-13ed4158a554 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:10.350772 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a6c19-7648-4993-83bd-13ed4158a554 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:10.351521 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a6c19-7648-4993-83bd-13ed4158a554 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:10:10.351830 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a6c19-7648-4993-83bd-13ed4158a554 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:10.353205 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a6c19-7648-4993-83bd-13ed4158a554 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:10.361200 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 584/1181] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:10:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:10:10.368108 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46677625-c549-41a7-91b9-0c0511521640 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:10.477415 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46677625-c549-41a7-91b9-0c0511521640 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:10.512900 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9202a4db-bfa7-40ab-9f92-f72d3ab99681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:10.513810 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9202a4db-bfa7-40ab-9f92-f72d3ab99681 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:10.514039 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9202a4db-bfa7-40ab-9f92-f72d3ab99681 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:10.514339 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9202a4db-bfa7-40ab-9f92-f72d3ab99681 None admin] PATH_INFO: `/v3/users/ade01642e7a5437ba5c67e3f4bb2b9e3` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:10.517374 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:10.535024 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9202a4db-bfa7-40ab-9f92-f72d3ab99681 None admin] RBAC: Authorizing `identity:get_user(user_id=ade01642e7a5437ba5c67e3f4bb2b9e3)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:10.537348 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9202a4db-bfa7-40ab-9f92-f72d3ab99681 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:10.539109 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 598/1182] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jun 29 12:10:10 2022] GET /identity/v3/users/ade01642e7a5437ba5c67e3f4bb2b9e3 => generated 311 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:10:10.545127 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a6c19-7648-4993-83bd-13ed4158a554 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:10.655546 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a6c19-7648-4993-83bd-13ed4158a554 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:10.689885 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f107de-818f-440d-b48b-1961bc8266d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:10.690574 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f107de-818f-440d-b48b-1961bc8266d7 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:10.690851 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f107de-818f-440d-b48b-1961bc8266d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:10.691118 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f107de-818f-440d-b48b-1961bc8266d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:10.707392 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:10.762126 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f107de-818f-440d-b48b-1961bc8266d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:10.763490 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f107de-818f-440d-b48b-1961bc8266d7 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:10.872749 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 585/1183] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:10:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 12:10:10.878973 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9202a4db-bfa7-40ab-9f92-f72d3ab99681 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:10.999257 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9202a4db-bfa7-40ab-9f92-f72d3ab99681 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:11.037103 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add4186-582f-4fc6-b931-d718be5fa78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:11.038122 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add4186-582f-4fc6-b931-d718be5fa78c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:11.038435 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add4186-582f-4fc6-b931-d718be5fa78c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:11.038668 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add4186-582f-4fc6-b931-d718be5fa78c None admin] PATH_INFO: `/v3/projects/e7d9bf30f6d64f6394be7802b1c3e639` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:11.040100 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add4186-582f-4fc6-b931-d718be5fa78c None admin] RBAC: Authorizing `identity:get_project(project_id=e7d9bf30f6d64f6394be7802b1c3e639)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:11.041559 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add4186-582f-4fc6-b931-d718be5fa78c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:11.043344 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 599/1184] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jun 29 12:10:10 2022] GET /identity/v3/projects/e7d9bf30f6d64f6394be7802b1c3e639 => generated 361 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:10:11.050654 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f107de-818f-440d-b48b-1961bc8266d7 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:11.104127 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:11.169807 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f107de-818f-440d-b48b-1961bc8266d7 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:11.206435 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15006263-0886-4f45-b08e-e15548ccc0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:11.207080 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15006263-0886-4f45-b08e-e15548ccc0e3 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:11.207356 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15006263-0886-4f45-b08e-e15548ccc0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:11.207625 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15006263-0886-4f45-b08e-e15548ccc0e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:11.208458 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15006263-0886-4f45-b08e-e15548ccc0e3 None admin] RBAC: Adding query filter params (role.id=e0e69ac8a8bf4cc4baa6aa18f2fc9919, scope.project.id=e7d9bf30f6d64f6394be7802b1c3e639, user.id=ade01642e7a5437ba5c67e3f4bb2b9e3) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:10:11.208770 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15006263-0886-4f45-b08e-e15548ccc0e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:11.210287 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15006263-0886-4f45-b08e-e15548ccc0e3 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:11.215879 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 586/1185] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jun 29 12:10:11 2022] GET /identity/v3/role_assignments?user.id=ade01642e7a5437ba5c67e3f4bb2b9e3&scope.project.id=e7d9bf30f6d64f6394be7802b1c3e639&role.id=e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:10:13.208608 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e0481-642b-4556-9fb5-f9a609fd5313 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:13.209486 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e0481-642b-4556-9fb5-f9a609fd5313 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:13.209486 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e0481-642b-4556-9fb5-f9a609fd5313 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:13.211246 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 600/1186] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:10:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:10:13.217863 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3c02a-98c5-4c37-bd8d-7a1840367bc0 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:13.218307 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3c02a-98c5-4c37-bd8d-7a1840367bc0 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:13.218428 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3c02a-98c5-4c37-bd8d-7a1840367bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:13.244848 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-02d3c02a-98c5-4c37-bd8d-7a1840367bc0 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:10:13.246096 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-02d3c02a-98c5-4c37-bd8d-7a1840367bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:10:13.325229 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 587/1187] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:10:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:10:13.348500 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e0481-642b-4556-9fb5-f9a609fd5313 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:13.415699 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:13.468902 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e0481-642b-4556-9fb5-f9a609fd5313 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:13.507314 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f7705-e023-4ba6-8455-f64a3ce68d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:13.508106 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f7705-e023-4ba6-8455-f64a3ce68d93 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:13.508385 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f7705-e023-4ba6-8455-f64a3ce68d93 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:13.508661 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f7705-e023-4ba6-8455-f64a3ce68d93 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:13.523658 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7f7705-e023-4ba6-8455-f64a3ce68d93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:10:13.536020 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-fa7f7705-e023-4ba6-8455-f64a3ce68d93 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:10:13.536020 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:10:13.536020 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:10:13.536020 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:10:13.536020 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:10:13.536020 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:10:13.536020 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:10:13.536020 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:10:13.536020 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:10:13.536020 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:10:13.536020 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:10:13.536020 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:10:13.536020 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:10:13.536020 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:10:13.536020 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:10:13.536020 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:10:13.537272 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:10:13.537272 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:10:13.537272 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:10:13.537272 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:10:13.537272 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:10:13.537272 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:10:13.537272 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:10:13.537272 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:10:13.537272 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:10:13.537272 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:10:13.537272 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:10:13.537272 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:10:13.537272 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:10:13.537272 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:10:13.537272 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:10:13.537272 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:10:13.538295 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:10:13.538295 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:10:13.538295 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:10:13.538295 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:10:13.538295 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:10:13.538295 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:10:13.538295 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:10:13.538295 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:10:13.538295 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:10:13.538295 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:10:13.538295 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:10:13.538295 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:10:13.538295 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 601/1188] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jun 29 12:10:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:10:13.543910 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d3c02a-98c5-4c37-bd8d-7a1840367bc0 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:13.586219 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:13.658817 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d3c02a-98c5-4c37-bd8d-7a1840367bc0 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:13.695297 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12825026-1bb9-40e9-aa45-085e63d80b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:13.695950 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12825026-1bb9-40e9-aa45-085e63d80b3b None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:13.696207 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12825026-1bb9-40e9-aa45-085e63d80b3b None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:13.696499 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12825026-1bb9-40e9-aa45-085e63d80b3b None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:13.697226 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12825026-1bb9-40e9-aa45-085e63d80b3b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:10:13.697524 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12825026-1bb9-40e9-aa45-085e63d80b3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:13.698929 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12825026-1bb9-40e9-aa45-085e63d80b3b None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:13.708032 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 588/1189] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:10:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:10:13.714915 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f7705-e023-4ba6-8455-f64a3ce68d93 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:13.824553 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f7705-e023-4ba6-8455-f64a3ce68d93 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:13.847594 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:13.861738 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5e1cdd-9dd1-433f-8bd0-082cd70b5633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:13.862620 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e1cdd-9dd1-433f-8bd0-082cd70b5633 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:13.862937 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e1cdd-9dd1-433f-8bd0-082cd70b5633 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:13.863212 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e1cdd-9dd1-433f-8bd0-082cd70b5633 None admin] PATH_INFO: `/v3/users/ade01642e7a5437ba5c67e3f4bb2b9e3` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:13.864537 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5e1cdd-9dd1-433f-8bd0-082cd70b5633 None admin] RBAC: Authorizing `identity:get_user(user_id=ade01642e7a5437ba5c67e3f4bb2b9e3)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:13.866058 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5e1cdd-9dd1-433f-8bd0-082cd70b5633 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:13.867706 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 602/1190] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jun 29 12:10:13 2022] GET /identity/v3/users/ade01642e7a5437ba5c67e3f4bb2b9e3 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:10:13.873811 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12825026-1bb9-40e9-aa45-085e63d80b3b None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:13.978961 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12825026-1bb9-40e9-aa45-085e63d80b3b None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:13.980576 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:14.023234 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da933406-8392-48be-bcaf-8906d97da900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:14.024098 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da933406-8392-48be-bcaf-8906d97da900 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:14.024380 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da933406-8392-48be-bcaf-8906d97da900 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:14.024651 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da933406-8392-48be-bcaf-8906d97da900 None admin] PATH_INFO: `/v3/projects/e7d9bf30f6d64f6394be7802b1c3e639` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:14.026015 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da933406-8392-48be-bcaf-8906d97da900 None admin] RBAC: Authorizing `identity:get_project(project_id=e7d9bf30f6d64f6394be7802b1c3e639)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:14.027467 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da933406-8392-48be-bcaf-8906d97da900 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:14.029352 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 589/1191] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jun 29 12:10:13 2022] GET /identity/v3/projects/e7d9bf30f6d64f6394be7802b1c3e639 => generated 361 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:10:14.035465 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5e1cdd-9dd1-433f-8bd0-082cd70b5633 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:14.141790 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5e1cdd-9dd1-433f-8bd0-082cd70b5633 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:14.179351 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a344764-f4e9-4f1a-83b5-efd650772bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:14.180634 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a344764-f4e9-4f1a-83b5-efd650772bda None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:14.180996 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a344764-f4e9-4f1a-83b5-efd650772bda None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:14.181368 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a344764-f4e9-4f1a-83b5-efd650772bda None admin] PATH_INFO: `/v3/projects/e7d9bf30f6d64f6394be7802b1c3e639/users/ade01642e7a5437ba5c67e3f4bb2b9e3/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:14.184709 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a344764-f4e9-4f1a-83b5-efd650772bda None admin] RBAC: Authorizing `identity:create_grant(project_id=e7d9bf30f6d64f6394be7802b1c3e639, user_id=ade01642e7a5437ba5c67e3f4bb2b9e3, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:14.187047 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a344764-f4e9-4f1a-83b5-efd650772bda None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:14.205783 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 603/1192] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jun 29 12:10:14 2022] PUT /identity/v3/projects/e7d9bf30f6d64f6394be7802b1c3e639/users/ade01642e7a5437ba5c67e3f4bb2b9e3/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:10:16.282298 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c60bcb-cde4-4b16-81b7-021d24c9881e None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:16.283181 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c60bcb-cde4-4b16-81b7-021d24c9881e None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:16.283181 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c60bcb-cde4-4b16-81b7-021d24c9881e None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:16.285451 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 590/1193] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:10:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:10:16.292218 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83798e-3321-4d0b-88ce-59d5c6adda22 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:16.292932 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83798e-3321-4d0b-88ce-59d5c6adda22 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:16.293021 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83798e-3321-4d0b-88ce-59d5c6adda22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:16.320359 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-3f83798e-3321-4d0b-88ce-59d5c6adda22 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:10:16.321569 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3f83798e-3321-4d0b-88ce-59d5c6adda22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:10:16.372161 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:16.398226 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 604/1194] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:10:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:10:16.422540 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c60bcb-cde4-4b16-81b7-021d24c9881e None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:16.539615 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c60bcb-cde4-4b16-81b7-021d24c9881e None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:16.577523 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8bdc5a-e36f-452b-bcdf-55449dbe4637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:16.578256 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8bdc5a-e36f-452b-bcdf-55449dbe4637 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:16.578534 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8bdc5a-e36f-452b-bcdf-55449dbe4637 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:16.578806 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8bdc5a-e36f-452b-bcdf-55449dbe4637 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:16.589879 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8bdc5a-e36f-452b-bcdf-55449dbe4637 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:10:16.597634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-7a8bdc5a-e36f-452b-bcdf-55449dbe4637 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:10:16.597634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:10:16.597634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:10:16.597634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:10:16.597634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:10:16.597634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:10:16.597634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:10:16.597634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:10:16.597634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:10:16.597634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:10:16.597634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:10:16.597634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:10:16.597634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:10:16.597634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:10:16.597634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:10:16.597634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:10:16.598715 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:10:16.598715 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:10:16.598715 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:10:16.598715 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:10:16.598715 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:10:16.598715 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:10:16.598715 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:10:16.598715 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:10:16.598715 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:10:16.598715 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:10:16.598715 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:10:16.598715 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:10:16.598715 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:10:16.598715 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:10:16.598715 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:10:16.598715 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:10:16.599585 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:10:16.599585 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:10:16.599585 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:10:16.599585 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:10:16.599585 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:10:16.599585 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:10:16.599585 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:10:16.599585 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:10:16.599585 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:10:16.599585 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:10:16.599585 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:10:16.599585 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:10:16.599585 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 591/1195] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jun 29 12:10:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:10:16.605600 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f83798e-3321-4d0b-88ce-59d5c6adda22 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:16.715283 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f83798e-3321-4d0b-88ce-59d5c6adda22 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:16.751186 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b30d55-6f6d-4377-8db4-dacfcfb44305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:16.751837 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b30d55-6f6d-4377-8db4-dacfcfb44305 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:16.752112 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b30d55-6f6d-4377-8db4-dacfcfb44305 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:16.752377 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b30d55-6f6d-4377-8db4-dacfcfb44305 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:16.753117 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b30d55-6f6d-4377-8db4-dacfcfb44305 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:10:16.753429 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b30d55-6f6d-4377-8db4-dacfcfb44305 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:16.754819 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b30d55-6f6d-4377-8db4-dacfcfb44305 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:16.764034 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 605/1196] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:10:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:10:16.773684 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8bdc5a-e36f-452b-bcdf-55449dbe4637 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:16.807059 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:16.883504 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8bdc5a-e36f-452b-bcdf-55449dbe4637 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:16.919189 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df2289-2b72-4ee0-83db-ede22a02b0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:16.920062 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df2289-2b72-4ee0-83db-ede22a02b0fb None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:16.920339 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df2289-2b72-4ee0-83db-ede22a02b0fb None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:16.920611 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df2289-2b72-4ee0-83db-ede22a02b0fb None admin] PATH_INFO: `/v3/users/ade01642e7a5437ba5c67e3f4bb2b9e3` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:16.921957 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02df2289-2b72-4ee0-83db-ede22a02b0fb None admin] RBAC: Authorizing `identity:get_user(user_id=ade01642e7a5437ba5c67e3f4bb2b9e3)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:16.923419 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02df2289-2b72-4ee0-83db-ede22a02b0fb None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:16.925054 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 592/1197] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jun 29 12:10:16 2022] GET /identity/v3/users/ade01642e7a5437ba5c67e3f4bb2b9e3 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:10:16.931609 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b30d55-6f6d-4377-8db4-dacfcfb44305 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:16.980669 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:17.042644 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b30d55-6f6d-4377-8db4-dacfcfb44305 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:17.087354 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d44f13-3d02-4e08-8ce0-c5bee8424720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:17.087994 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d44f13-3d02-4e08-8ce0-c5bee8424720 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:17.088277 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d44f13-3d02-4e08-8ce0-c5bee8424720 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:17.088552 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d44f13-3d02-4e08-8ce0-c5bee8424720 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:17.167118 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d44f13-3d02-4e08-8ce0-c5bee8424720 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:17.168489 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d44f13-3d02-4e08-8ce0-c5bee8424720 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:17.214822 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:17.280218 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 606/1198] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:10:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 12:10:17.289437 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df2289-2b72-4ee0-83db-ede22a02b0fb None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:17.386755 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:17.390485 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df2289-2b72-4ee0-83db-ede22a02b0fb None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:17.425369 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270615fc-5aef-4962-88bb-48c7d82cc968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:17.426200 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270615fc-5aef-4962-88bb-48c7d82cc968 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:17.426478 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270615fc-5aef-4962-88bb-48c7d82cc968 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:17.426752 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270615fc-5aef-4962-88bb-48c7d82cc968 None admin] PATH_INFO: `/v3/projects/e7d9bf30f6d64f6394be7802b1c3e639` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:17.428158 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270615fc-5aef-4962-88bb-48c7d82cc968 None admin] RBAC: Authorizing `identity:get_project(project_id=e7d9bf30f6d64f6394be7802b1c3e639)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:17.429593 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270615fc-5aef-4962-88bb-48c7d82cc968 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:17.431469 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 593/1199] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jun 29 12:10:17 2022] GET /identity/v3/projects/e7d9bf30f6d64f6394be7802b1c3e639 => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:10:17.438099 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d44f13-3d02-4e08-8ce0-c5bee8424720 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:10:17.542794 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d44f13-3d02-4e08-8ce0-c5bee8424720 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:10:17.578635 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf5a587-616d-4b7f-a17c-d3af6cd85de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:10:17.579288 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5a587-616d-4b7f-a17c-d3af6cd85de4 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:10:17.579562 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5a587-616d-4b7f-a17c-d3af6cd85de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:10:17.579835 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5a587-616d-4b7f-a17c-d3af6cd85de4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:10:17.580675 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf5a587-616d-4b7f-a17c-d3af6cd85de4 None admin] RBAC: Adding query filter params (role.id=e0e69ac8a8bf4cc4baa6aa18f2fc9919, scope.project.id=e7d9bf30f6d64f6394be7802b1c3e639, user.id=ade01642e7a5437ba5c67e3f4bb2b9e3) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:10:17.580992 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf5a587-616d-4b7f-a17c-d3af6cd85de4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:10:17.582466 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf5a587-616d-4b7f-a17c-d3af6cd85de4 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:10:17.588890 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 607/1200] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jun 29 12:10:17 2022] GET /identity/v3/role_assignments?user.id=ade01642e7a5437ba5c67e3f4bb2b9e3&scope.project.id=e7d9bf30f6d64f6394be7802b1c3e639&role.id=e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:10:27.420567 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=17 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:10:27.586142 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:13.639491 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1182dc-0af3-42a5-9b6c-be14b009f6be None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:13.640124 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1182dc-0af3-42a5-9b6c-be14b009f6be None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:13.640124 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1182dc-0af3-42a5-9b6c-be14b009f6be None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:13.641966 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 594/1201] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:11:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:11:13.647786 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5f0f4-e3f4-49ca-bdbb-2587cc34e3ad None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:13.648496 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5f0f4-e3f4-49ca-bdbb-2587cc34e3ad None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:13.648496 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5f0f4-e3f4-49ca-bdbb-2587cc34e3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:13.667426 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-18b5f0f4-e3f4-49ca-bdbb-2587cc34e3ad None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:11:13.668723 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-18b5f0f4-e3f4-49ca-bdbb-2587cc34e3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:11:13.758324 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 608/1202] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:11:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:11:13.784096 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1182dc-0af3-42a5-9b6c-be14b009f6be None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:13.921210 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1182dc-0af3-42a5-9b6c-be14b009f6be None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:13.965861 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8d4116-ba36-4076-ba1e-6f7c3581e2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:13.966763 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d4116-ba36-4076-ba1e-6f7c3581e2b1 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:13.967107 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d4116-ba36-4076-ba1e-6f7c3581e2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:13.967355 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d4116-ba36-4076-ba1e-6f7c3581e2b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:13.981474 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8d4116-ba36-4076-ba1e-6f7c3581e2b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:13.983284 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8d4116-ba36-4076-ba1e-6f7c3581e2b1 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:14.003085 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-dd8d4116-ba36-4076-ba1e-6f7c3581e2b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:11:14.003085 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:11:14.003085 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:11:14.003085 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:11:14.003085 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:11:14.003085 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:11:14.003085 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:11:14.003085 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:11:14.003085 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:11:14.003085 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:11:14.003085 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:11:14.003085 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:11:14.003085 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:11:14.003085 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:11:14.003085 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:11:14.004285 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:11:14.004285 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:11:14.004285 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:11:14.004285 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:11:14.004285 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:11:14.004285 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:11:14.004285 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:11:14.004285 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:11:14.004285 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:11:14.004285 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:11:14.004285 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:11:14.004285 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:11:14.004285 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:11:14.004285 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:11:14.004285 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:11:14.004285 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:11:14.004285 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:11:14.005382 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:11:14.005382 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:11:14.005382 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:11:14.005382 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:11:14.012976 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 595/1203] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:11:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:11:14.014092 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b5f0f4-e3f4-49ca-bdbb-2587cc34e3ad None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:14.140374 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b5f0f4-e3f4-49ca-bdbb-2587cc34e3ad None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:14.182589 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:14.190003 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acba68d-61c0-42da-9265-d6bb9994c035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:14.190858 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acba68d-61c0-42da-9265-d6bb9994c035 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:14.191340 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acba68d-61c0-42da-9265-d6bb9994c035 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:14.191669 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acba68d-61c0-42da-9265-d6bb9994c035 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:14.192471 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acba68d-61c0-42da-9265-d6bb9994c035 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:11:14.193085 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acba68d-61c0-42da-9265-d6bb9994c035 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:14.194998 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acba68d-61c0-42da-9265-d6bb9994c035 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:14.209581 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 609/1204] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:11:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:11:14.216001 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8d4116-ba36-4076-ba1e-6f7c3581e2b1 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:14.307395 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:14.373306 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8d4116-ba36-4076-ba1e-6f7c3581e2b1 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:14.424562 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd74d37-ab0d-468e-8148-de45b85487b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:14.425350 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd74d37-ab0d-468e-8148-de45b85487b6 None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:14.425633 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd74d37-ab0d-468e-8148-de45b85487b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:14.426077 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd74d37-ab0d-468e-8148-de45b85487b6 None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:14.427174 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd74d37-ab0d-468e-8148-de45b85487b6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:14.429893 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd74d37-ab0d-468e-8148-de45b85487b6 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:14.454496 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 596/1205] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Jun 29 12:11:14 2022] POST /identity/v3/users => generated 251 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:11:16.731792 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e96dd8-c5e1-4dc8-86d1-8205f85c1622 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:16.732426 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e96dd8-c5e1-4dc8-86d1-8205f85c1622 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:16.732426 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e96dd8-c5e1-4dc8-86d1-8205f85c1622 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:16.734343 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 610/1206] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:11:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:11:16.740602 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434efd3-ebb0-43ee-a278-b6b5b05e49a8 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:16.741125 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434efd3-ebb0-43ee-a278-b6b5b05e49a8 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:16.741309 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434efd3-ebb0-43ee-a278-b6b5b05e49a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:16.759659 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-6434efd3-ebb0-43ee-a278-b6b5b05e49a8 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:11:16.760933 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-6434efd3-ebb0-43ee-a278-b6b5b05e49a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:11:16.840045 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 597/1207] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:11:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:11:16.870397 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e96dd8-c5e1-4dc8-86d1-8205f85c1622 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:16.992648 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e96dd8-c5e1-4dc8-86d1-8205f85c1622 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:17.036731 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7fc4c1-4a41-4fde-a30e-3617d9d28f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:17.037539 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7fc4c1-4a41-4fde-a30e-3617d9d28f3d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:17.037851 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7fc4c1-4a41-4fde-a30e-3617d9d28f3d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:17.038212 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7fc4c1-4a41-4fde-a30e-3617d9d28f3d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:17.055210 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7fc4c1-4a41-4fde-a30e-3617d9d28f3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:11:17.062904 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-9b7fc4c1-4a41-4fde-a30e-3617d9d28f3d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:11:17.062904 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:11:17.062904 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:11:17.062904 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:11:17.062904 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:11:17.062904 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:11:17.062904 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:11:17.062904 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:11:17.062904 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:11:17.062904 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:11:17.062904 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:11:17.062904 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:11:17.062904 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:11:17.062904 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:11:17.062904 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:11:17.062904 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:11:17.071715 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:11:17.071715 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:11:17.071715 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:11:17.071715 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:11:17.071715 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:11:17.071715 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:11:17.071715 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:11:17.071715 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:11:17.071715 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:11:17.071715 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:11:17.071715 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:11:17.071715 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:11:17.071715 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:11:17.071715 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:11:17.071715 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:11:17.071715 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:11:17.072663 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:11:17.072663 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:11:17.072663 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:11:17.072663 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:11:17.072663 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:11:17.072663 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:11:17.072663 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:11:17.072663 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:11:17.072663 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:11:17.072663 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:11:17.072663 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:11:17.072663 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:11:17.072663 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 611/1208] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jun 29 12:11:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:11:17.073418 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434efd3-ebb0-43ee-a278-b6b5b05e49a8 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:17.117844 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:17.185394 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434efd3-ebb0-43ee-a278-b6b5b05e49a8 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:17.222890 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ec8c76-3de6-484e-be71-ff8f5a117039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:17.223665 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec8c76-3de6-484e-be71-ff8f5a117039 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:17.224022 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec8c76-3de6-484e-be71-ff8f5a117039 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:17.224357 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec8c76-3de6-484e-be71-ff8f5a117039 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:17.225226 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ec8c76-3de6-484e-be71-ff8f5a117039 None admin] RBAC: Adding query filter params (name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:11:17.225577 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ec8c76-3de6-484e-be71-ff8f5a117039 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:17.227112 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ec8c76-3de6-484e-be71-ff8f5a117039 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:17.235670 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 598/1209] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jun 29 12:11:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:11:17.241548 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7fc4c1-4a41-4fde-a30e-3617d9d28f3d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:17.303015 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:17.366135 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7fc4c1-4a41-4fde-a30e-3617d9d28f3d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:17.410233 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac7d87-4da0-425e-9659-11e9a5d66273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:17.411155 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac7d87-4da0-425e-9659-11e9a5d66273 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:17.411444 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac7d87-4da0-425e-9659-11e9a5d66273 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:17.411754 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac7d87-4da0-425e-9659-11e9a5d66273 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:17.424448 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ac7d87-4da0-425e-9659-11e9a5d66273 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:17.426105 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ac7d87-4da0-425e-9659-11e9a5d66273 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:17.445087 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-d3ac7d87-4da0-425e-9659-11e9a5d66273 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:11:17.445087 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:11:17.445087 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:11:17.445087 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:11:17.445087 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:11:17.445087 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:11:17.445087 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:11:17.445087 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:11:17.445087 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:11:17.445087 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:11:17.445087 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:11:17.445087 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:11:17.445087 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:11:17.445087 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:11:17.445087 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:11:17.446485 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:11:17.446485 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:11:17.446485 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:11:17.446485 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:11:17.446485 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:11:17.446485 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:11:17.446485 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:11:17.446485 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:11:17.446485 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:11:17.446485 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:11:17.446485 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:11:17.446485 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:11:17.446485 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:11:17.446485 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:11:17.446485 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:11:17.446485 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:11:17.446485 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:11:17.452584 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:11:17.452584 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:11:17.452584 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:11:17.452584 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:11:17.452584 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 612/1210] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:11:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:11:17.454291 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ec8c76-3de6-484e-be71-ff8f5a117039 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:17.573186 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:17.576871 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ec8c76-3de6-484e-be71-ff8f5a117039 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:17.620153 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ea84b-6a84-4673-ad7e-8216337c941c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:17.620858 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ea84b-6a84-4673-ad7e-8216337c941c None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:17.621142 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ea84b-6a84-4673-ad7e-8216337c941c None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:17.621530 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ea84b-6a84-4673-ad7e-8216337c941c None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:17.622298 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ea84b-6a84-4673-ad7e-8216337c941c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:11:17.622605 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ea84b-6a84-4673-ad7e-8216337c941c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:17.624138 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ea84b-6a84-4673-ad7e-8216337c941c None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:17.638203 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 599/1211] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:11:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:11:17.644824 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac7d87-4da0-425e-9659-11e9a5d66273 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:17.765624 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac7d87-4da0-425e-9659-11e9a5d66273 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:17.767237 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:17.807482 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edcbb92-1d65-4dbc-9bb7-cb0393be46b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:17.808352 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edcbb92-1d65-4dbc-9bb7-cb0393be46b0 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:17.808622 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edcbb92-1d65-4dbc-9bb7-cb0393be46b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:17.808931 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edcbb92-1d65-4dbc-9bb7-cb0393be46b0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:17.822490 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edcbb92-1d65-4dbc-9bb7-cb0393be46b0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:17.823868 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edcbb92-1d65-4dbc-9bb7-cb0393be46b0 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:17.842005 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-2edcbb92-1d65-4dbc-9bb7-cb0393be46b0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 29 12:11:17.842005 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:11:17.842005 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:11:17.842005 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:11:17.842005 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:11:17.842005 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:11:17.842005 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:11:17.842005 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:11:17.842005 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:11:17.842005 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:11:17.842005 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:11:17.842005 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:11:17.842005 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:11:17.842005 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:11:17.842005 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:11:17.842005 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:11:17.843298 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:11:17.843298 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:11:17.843298 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:11:17.843298 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:11:17.843298 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:11:17.843298 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:11:17.843298 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:11:17.843298 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:11:17.843298 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:11:17.843298 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:11:17.843298 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:11:17.843298 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:11:17.843298 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:11:17.843298 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:11:17.843298 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:11:17.843298 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:11:17.843298 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:11:17.843298 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:11:17.849408 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:11:17.849408 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:11:17.849408 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:11:17.849408 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:11:17.849408 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:11:17.849408 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:11:17.849408 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:11:17.849408 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:11:17.849408 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 29 12:11:17.849408 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:11:17.849408 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 613/1212] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:11:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:11:17.852979 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ea84b-6a84-4673-ad7e-8216337c941c None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:17.974950 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ea84b-6a84-4673-ad7e-8216337c941c None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:18.015632 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae5561-eb6d-4858-8f45-47c91f44e35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:18.016322 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae5561-eb6d-4858-8f45-47c91f44e35b None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:18.016606 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae5561-eb6d-4858-8f45-47c91f44e35b None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:18.016879 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae5561-eb6d-4858-8f45-47c91f44e35b None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:18.017762 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae5561-eb6d-4858-8f45-47c91f44e35b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:11:18.018096 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae5561-eb6d-4858-8f45-47c91f44e35b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:18.019531 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae5561-eb6d-4858-8f45-47c91f44e35b None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:18.042364 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 600/1213] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Jun 29 12:11:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:11:18.048224 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edcbb92-1d65-4dbc-9bb7-cb0393be46b0 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:18.175278 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edcbb92-1d65-4dbc-9bb7-cb0393be46b0 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:18.230796 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0291293-4399-4be6-bac0-8418f263c79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:18.231990 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0291293-4399-4be6-bac0-8418f263c79d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:18.232510 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0291293-4399-4be6-bac0-8418f263c79d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:18.232905 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0291293-4399-4be6-bac0-8418f263c79d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:18.274163 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:18.332386 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0291293-4399-4be6-bac0-8418f263c79d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:18.334139 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0291293-4399-4be6-bac0-8418f263c79d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:18.457389 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 614/1214] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:11:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 12:11:18.463626 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae5561-eb6d-4858-8f45-47c91f44e35b None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:18.485553 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:18.582266 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae5561-eb6d-4858-8f45-47c91f44e35b None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:18.624512 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef117f8-249a-4226-987d-4494e925ed91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:18.625538 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef117f8-249a-4226-987d-4494e925ed91 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:18.625995 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef117f8-249a-4226-987d-4494e925ed91 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:18.626401 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef117f8-249a-4226-987d-4494e925ed91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:18.638421 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef117f8-249a-4226-987d-4494e925ed91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:18.640140 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef117f8-249a-4226-987d-4494e925ed91 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:18.659841 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-3ef117f8-249a-4226-987d-4494e925ed91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:11:18.659841 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:11:18.659841 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:11:18.659841 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:11:18.659841 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:11:18.659841 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:11:18.659841 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:11:18.659841 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:11:18.659841 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:11:18.659841 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:11:18.659841 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:11:18.659841 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:11:18.659841 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:11:18.659841 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:11:18.659841 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:11:18.660881 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:11:18.660881 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:11:18.660881 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:11:18.660881 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:11:18.660881 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:11:18.660881 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:11:18.660881 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:11:18.660881 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:11:18.660881 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:11:18.660881 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:11:18.660881 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:11:18.660881 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:11:18.660881 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:11:18.660881 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:11:18.660881 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:11:18.660881 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:11:18.660881 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:11:18.661862 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:11:18.661862 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:11:18.661862 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:11:18.661862 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:11:18.661862 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 601/1215] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:11:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:11:18.671228 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0291293-4399-4be6-bac0-8418f263c79d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:18.742703 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:18.785211 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0291293-4399-4be6-bac0-8418f263c79d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:18.828702 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a48b2-4cb6-49f9-b4ba-d59180131ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:18.829508 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a48b2-4cb6-49f9-b4ba-d59180131ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:18.829915 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a48b2-4cb6-49f9-b4ba-d59180131ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:18.830220 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a48b2-4cb6-49f9-b4ba-d59180131ac3 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:18.831164 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a48b2-4cb6-49f9-b4ba-d59180131ac3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:11:18.831490 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a48b2-4cb6-49f9-b4ba-d59180131ac3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:18.833041 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a48b2-4cb6-49f9-b4ba-d59180131ac3 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:18.847292 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 615/1216] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:11:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:11:18.853563 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef117f8-249a-4226-987d-4494e925ed91 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:18.931295 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:18.963484 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef117f8-249a-4226-987d-4494e925ed91 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:19.000577 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d9957-ed5c-401d-a3ac-c9a5110e0b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:19.001465 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d9957-ed5c-401d-a3ac-c9a5110e0b01 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:19.001835 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d9957-ed5c-401d-a3ac-c9a5110e0b01 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:19.002237 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d9957-ed5c-401d-a3ac-c9a5110e0b01 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:19.010462 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581d9957-ed5c-401d-a3ac-c9a5110e0b01 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:19.012051 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581d9957-ed5c-401d-a3ac-c9a5110e0b01 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:19.029960 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-581d9957-ed5c-401d-a3ac-c9a5110e0b01 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:11:19.029960 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:11:19.029960 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:11:19.029960 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:11:19.029960 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:11:19.029960 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:11:19.029960 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:11:19.029960 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:11:19.029960 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:11:19.029960 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:11:19.029960 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:11:19.029960 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:11:19.029960 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:11:19.029960 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:11:19.029960 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:11:19.031013 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:11:19.031013 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:11:19.031013 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:11:19.031013 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:11:19.031013 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:11:19.031013 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:11:19.031013 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:11:19.031013 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:11:19.031013 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:11:19.031013 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:11:19.031013 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:11:19.031013 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:11:19.031013 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:11:19.031013 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:11:19.031013 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:11:19.031013 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:11:19.031013 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:11:19.031942 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:11:19.031942 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:11:19.031942 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:11:19.031942 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:11:19.031942 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:11:19.031942 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:11:19.031942 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:11:19.031942 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:11:19.035576 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 602/1217] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jun 29 12:11:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:11:19.036254 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a48b2-4cb6-49f9-b4ba-d59180131ac3 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:19.153381 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a48b2-4cb6-49f9-b4ba-d59180131ac3 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:19.180914 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:19.195377 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cb066f-1590-4420-ab25-c3c4a07e7a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:19.196194 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb066f-1590-4420-ab25-c3c4a07e7a52 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:19.196574 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb066f-1590-4420-ab25-c3c4a07e7a52 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:19.196951 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb066f-1590-4420-ab25-c3c4a07e7a52 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:19.197943 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cb066f-1590-4420-ab25-c3c4a07e7a52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:11:19.198373 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cb066f-1590-4420-ab25-c3c4a07e7a52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:19.200288 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cb066f-1590-4420-ab25-c3c4a07e7a52 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:19.214437 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 616/1218] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jun 29 12:11:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:11:19.220820 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d9957-ed5c-401d-a3ac-c9a5110e0b01 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:19.330058 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d9957-ed5c-401d-a3ac-c9a5110e0b01 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:19.362757 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:19.371033 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98c2d10-bed9-44c0-a550-c6edef2b7962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:19.371719 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c2d10-bed9-44c0-a550-c6edef2b7962 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:19.371986 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c2d10-bed9-44c0-a550-c6edef2b7962 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:19.372260 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c2d10-bed9-44c0-a550-c6edef2b7962 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:19.373097 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98c2d10-bed9-44c0-a550-c6edef2b7962 None admin] RBAC: Adding query filter params (role.id=6f63a9619c7b40ebb5b73bde026d606b, scope.project.id=996db30845f84e57865fa40b9a730a05, user.id=286a99b42d9246db909040bf8ab18ea1) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:11:19.373408 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98c2d10-bed9-44c0-a550-c6edef2b7962 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:19.374922 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98c2d10-bed9-44c0-a550-c6edef2b7962 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:19.380870 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 603/1219] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jun 29 12:11:19 2022] GET /identity/v3/role_assignments?user.id=286a99b42d9246db909040bf8ab18ea1&scope.project.id=996db30845f84e57865fa40b9a730a05&role.id=6f63a9619c7b40ebb5b73bde026d606b => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:11:21.435471 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808afed-7b9e-4a03-839d-2781c4ea29b9 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:21.436047 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808afed-7b9e-4a03-839d-2781c4ea29b9 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:21.436047 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808afed-7b9e-4a03-839d-2781c4ea29b9 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:21.437520 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 617/1220] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:11:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:11:21.443034 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968a105-5b57-43ed-ad78-0575ce69bdc9 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:21.443450 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968a105-5b57-43ed-ad78-0575ce69bdc9 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:21.443605 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968a105-5b57-43ed-ad78-0575ce69bdc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:21.463167 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-0968a105-5b57-43ed-ad78-0575ce69bdc9 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:11:21.464519 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-0968a105-5b57-43ed-ad78-0575ce69bdc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:11:21.538715 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 604/1221] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:11:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:11:21.561616 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6808afed-7b9e-4a03-839d-2781c4ea29b9 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:21.688993 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6808afed-7b9e-4a03-839d-2781c4ea29b9 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:21.734600 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24046744-ec35-4fa7-89d3-c9ee9e1ad177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:21.735579 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24046744-ec35-4fa7-89d3-c9ee9e1ad177 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:21.735992 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24046744-ec35-4fa7-89d3-c9ee9e1ad177 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:21.736331 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24046744-ec35-4fa7-89d3-c9ee9e1ad177 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:21.746826 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24046744-ec35-4fa7-89d3-c9ee9e1ad177 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:11:21.754618 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-24046744-ec35-4fa7-89d3-c9ee9e1ad177 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:11:21.754618 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:11:21.754618 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:11:21.754618 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:11:21.754618 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:11:21.754618 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:11:21.754618 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:11:21.754618 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:11:21.754618 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:11:21.754618 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:11:21.754618 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:11:21.754618 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:11:21.754618 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:11:21.754618 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:11:21.754618 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:11:21.754618 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:11:21.755792 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:11:21.755792 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:11:21.755792 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:11:21.755792 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:11:21.755792 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:11:21.755792 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:11:21.755792 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:11:21.755792 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:11:21.755792 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:11:21.755792 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:11:21.755792 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:11:21.755792 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:11:21.755792 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:11:21.755792 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:11:21.755792 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:11:21.755792 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:11:21.757004 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:11:21.757004 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:11:21.757004 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:11:21.757004 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:11:21.757004 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:11:21.757004 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:11:21.757004 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:11:21.757004 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:11:21.757004 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:11:21.757004 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:11:21.757004 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:11:21.757004 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:11:21.757004 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 618/1222] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jun 29 12:11:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:11:21.762160 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0968a105-5b57-43ed-ad78-0575ce69bdc9 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:21.871415 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0968a105-5b57-43ed-ad78-0575ce69bdc9 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:21.898630 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:21.911080 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d45c0c-9396-48b3-8eac-958480ecbe0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:21.911693 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d45c0c-9396-48b3-8eac-958480ecbe0d None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:21.912006 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d45c0c-9396-48b3-8eac-958480ecbe0d None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:21.912326 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d45c0c-9396-48b3-8eac-958480ecbe0d None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:21.913333 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d45c0c-9396-48b3-8eac-958480ecbe0d None admin] RBAC: Adding query filter params (name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:11:21.913669 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d45c0c-9396-48b3-8eac-958480ecbe0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:21.915154 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d45c0c-9396-48b3-8eac-958480ecbe0d None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:21.924976 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 605/1223] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jun 29 12:11:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:11:21.933999 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24046744-ec35-4fa7-89d3-c9ee9e1ad177 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:21.985514 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:22.056058 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24046744-ec35-4fa7-89d3-c9ee9e1ad177 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:22.093836 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e354e-7a4e-4014-94be-45850cb4b7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:22.094644 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e354e-7a4e-4014-94be-45850cb4b7ce None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:22.095017 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e354e-7a4e-4014-94be-45850cb4b7ce None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:22.095292 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e354e-7a4e-4014-94be-45850cb4b7ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:22.107476 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6e354e-7a4e-4014-94be-45850cb4b7ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:22.108941 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6e354e-7a4e-4014-94be-45850cb4b7ce None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:22.127511 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-bc6e354e-7a4e-4014-94be-45850cb4b7ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:11:22.127511 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:11:22.127511 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:11:22.127511 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:11:22.127511 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:11:22.127511 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:11:22.127511 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:11:22.127511 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:11:22.127511 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:11:22.127511 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:11:22.127511 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:11:22.127511 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:11:22.127511 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:11:22.127511 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:11:22.127511 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:11:22.128864 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:11:22.128864 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:11:22.128864 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:11:22.128864 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:11:22.128864 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:11:22.128864 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:11:22.128864 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:11:22.128864 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:11:22.128864 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:11:22.128864 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:11:22.128864 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:11:22.128864 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:11:22.128864 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:11:22.128864 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:11:22.128864 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:11:22.128864 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:11:22.128864 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:11:22.130098 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:11:22.130098 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:11:22.130098 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:11:22.130098 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:11:22.130098 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 619/1224] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:11:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:11:22.136182 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d45c0c-9396-48b3-8eac-958480ecbe0d None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:22.247480 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d45c0c-9396-48b3-8eac-958480ecbe0d None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:22.286014 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdcad42-0e98-4987-bfca-8cb79ead51ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:22.286716 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdcad42-0e98-4987-bfca-8cb79ead51ba None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:22.287000 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdcad42-0e98-4987-bfca-8cb79ead51ba None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:22.287293 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdcad42-0e98-4987-bfca-8cb79ead51ba None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:22.288326 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdcad42-0e98-4987-bfca-8cb79ead51ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:11:22.288641 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdcad42-0e98-4987-bfca-8cb79ead51ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:22.290219 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdcad42-0e98-4987-bfca-8cb79ead51ba None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:22.304901 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 606/1225] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:11:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:11:22.310934 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e354e-7a4e-4014-94be-45850cb4b7ce None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:22.422751 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:22.430778 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e354e-7a4e-4014-94be-45850cb4b7ce None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:22.466888 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7efc5e0-aa1c-4e98-926e-988a4a667811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:22.467692 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7efc5e0-aa1c-4e98-926e-988a4a667811 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:22.468122 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7efc5e0-aa1c-4e98-926e-988a4a667811 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:22.468342 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7efc5e0-aa1c-4e98-926e-988a4a667811 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:22.477216 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7efc5e0-aa1c-4e98-926e-988a4a667811 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:22.479068 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7efc5e0-aa1c-4e98-926e-988a4a667811 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:22.495198 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-e7efc5e0-aa1c-4e98-926e-988a4a667811 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 29 12:11:22.495198 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:11:22.495198 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:11:22.495198 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:11:22.495198 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:11:22.495198 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:11:22.495198 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:11:22.495198 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:11:22.495198 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:11:22.495198 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:11:22.495198 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:11:22.495198 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:11:22.495198 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:11:22.495198 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:11:22.495198 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:11:22.495198 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:11:22.496439 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:11:22.496439 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:11:22.496439 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:11:22.496439 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:11:22.496439 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:11:22.496439 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:11:22.496439 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:11:22.496439 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:11:22.496439 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:11:22.496439 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:11:22.496439 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:11:22.496439 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:11:22.496439 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:11:22.496439 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:11:22.496439 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:11:22.496439 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:11:22.496439 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:11:22.496439 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:11:22.497806 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:11:22.497806 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:11:22.497806 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:11:22.497806 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:11:22.497806 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:11:22.497806 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:11:22.497806 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:11:22.497806 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:11:22.497806 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 29 12:11:22.497806 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:11:22.499599 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 620/1226] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:11:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:11:22.506203 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdcad42-0e98-4987-bfca-8cb79ead51ba None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:22.558430 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:22.624938 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdcad42-0e98-4987-bfca-8cb79ead51ba None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:22.666356 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e2851f-ed0c-4702-b70d-84cfb284dc33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:22.667057 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2851f-ed0c-4702-b70d-84cfb284dc33 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:22.667303 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2851f-ed0c-4702-b70d-84cfb284dc33 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:22.667600 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2851f-ed0c-4702-b70d-84cfb284dc33 None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:22.668620 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e2851f-ed0c-4702-b70d-84cfb284dc33 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:11:22.669003 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e2851f-ed0c-4702-b70d-84cfb284dc33 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:22.670637 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e2851f-ed0c-4702-b70d-84cfb284dc33 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:22.692107 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 607/1227] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Jun 29 12:11:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:11:22.696999 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7efc5e0-aa1c-4e98-926e-988a4a667811 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:22.819607 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7efc5e0-aa1c-4e98-926e-988a4a667811 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:22.860901 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ea1240-03d7-44ec-8300-f5f115aa25df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:22.861723 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea1240-03d7-44ec-8300-f5f115aa25df None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:22.862012 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea1240-03d7-44ec-8300-f5f115aa25df None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:22.862287 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea1240-03d7-44ec-8300-f5f115aa25df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:22.873631 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ea1240-03d7-44ec-8300-f5f115aa25df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:22.875259 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ea1240-03d7-44ec-8300-f5f115aa25df None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:22.894353 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-66ea1240-03d7-44ec-8300-f5f115aa25df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:11:22.894353 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:11:22.894353 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:11:22.894353 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:11:22.894353 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:11:22.894353 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:11:22.894353 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:11:22.894353 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:11:22.894353 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:11:22.894353 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:11:22.894353 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:11:22.894353 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:11:22.894353 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:11:22.894353 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:11:22.894353 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:11:22.895616 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:11:22.895616 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:11:22.895616 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:11:22.895616 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:11:22.895616 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:11:22.895616 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:11:22.895616 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:11:22.895616 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:11:22.895616 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:11:22.895616 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:11:22.895616 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:11:22.895616 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:11:22.895616 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:11:22.895616 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:11:22.895616 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:11:22.895616 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:11:22.895616 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:11:22.896800 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:11:22.896800 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:11:22.896800 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:11:22.896800 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:11:22.898790 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 621/1228] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:11:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:11:22.905790 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e2851f-ed0c-4702-b70d-84cfb284dc33 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:23.036420 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e2851f-ed0c-4702-b70d-84cfb284dc33 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:23.039777 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:23.077124 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2dca4-9077-4fe0-a098-72ed97d3529e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:23.077740 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2dca4-9077-4fe0-a098-72ed97d3529e None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:23.078023 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2dca4-9077-4fe0-a098-72ed97d3529e None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:23.078294 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2dca4-9077-4fe0-a098-72ed97d3529e None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:23.079024 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de2dca4-9077-4fe0-a098-72ed97d3529e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:11:23.079326 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de2dca4-9077-4fe0-a098-72ed97d3529e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:23.080755 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de2dca4-9077-4fe0-a098-72ed97d3529e None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:23.093146 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 608/1229] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:11:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:11:23.098999 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ea1240-03d7-44ec-8300-f5f115aa25df None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:23.108437 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:23.217174 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ea1240-03d7-44ec-8300-f5f115aa25df None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:23.258287 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db14c2d-a2fd-4f53-9c39-fdda7d749139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:23.259132 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db14c2d-a2fd-4f53-9c39-fdda7d749139 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:23.259416 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db14c2d-a2fd-4f53-9c39-fdda7d749139 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:23.259724 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db14c2d-a2fd-4f53-9c39-fdda7d749139 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:23.267843 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db14c2d-a2fd-4f53-9c39-fdda7d749139 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:23.269520 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db14c2d-a2fd-4f53-9c39-fdda7d749139 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:23.285738 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-7db14c2d-a2fd-4f53-9c39-fdda7d749139 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:11:23.285738 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:11:23.285738 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:11:23.285738 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:11:23.285738 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:11:23.285738 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:11:23.285738 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:11:23.285738 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:11:23.285738 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:11:23.285738 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:11:23.285738 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:11:23.285738 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:11:23.285738 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:11:23.285738 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:11:23.285738 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:11:23.286862 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:11:23.286862 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:11:23.286862 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:11:23.286862 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:11:23.286862 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:11:23.286862 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:11:23.286862 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:11:23.286862 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:11:23.286862 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:11:23.286862 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:11:23.286862 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:11:23.286862 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:11:23.286862 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:11:23.286862 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:11:23.286862 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:11:23.286862 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:11:23.286862 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:11:23.288080 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:11:23.288080 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:11:23.288080 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:11:23.288080 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:11:23.288080 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:11:23.288080 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:11:23.288080 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:11:23.288080 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:11:23.288080 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 622/1230] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jun 29 12:11:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:11:23.295142 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2dca4-9077-4fe0-a098-72ed97d3529e None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:23.413987 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2dca4-9077-4fe0-a098-72ed97d3529e None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:23.458728 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6a4a7f-c1d4-4cc4-a374-6dba1c7cefae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:23.459505 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a4a7f-c1d4-4cc4-a374-6dba1c7cefae None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:23.459875 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a4a7f-c1d4-4cc4-a374-6dba1c7cefae None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:23.460146 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a4a7f-c1d4-4cc4-a374-6dba1c7cefae None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:23.461007 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6a4a7f-c1d4-4cc4-a374-6dba1c7cefae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:11:23.461380 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6a4a7f-c1d4-4cc4-a374-6dba1c7cefae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:23.462919 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6a4a7f-c1d4-4cc4-a374-6dba1c7cefae None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:23.476304 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 609/1231] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jun 29 12:11:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:11:23.483303 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db14c2d-a2fd-4f53-9c39-fdda7d749139 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:23.553077 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:23.594051 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db14c2d-a2fd-4f53-9c39-fdda7d749139 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:23.636664 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a22ab-3912-4996-b686-a3f65a134c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:23.637713 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a22ab-3912-4996-b686-a3f65a134c4f None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:23.638015 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a22ab-3912-4996-b686-a3f65a134c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:23.638345 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a22ab-3912-4996-b686-a3f65a134c4f None admin] PATH_INFO: `/v3/projects/996db30845f84e57865fa40b9a730a05/users/286a99b42d9246db909040bf8ab18ea1/roles/6f63a9619c7b40ebb5b73bde026d606b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:23.655396 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a22ab-3912-4996-b686-a3f65a134c4f None admin] RBAC: Authorizing `identity:create_grant(project_id=996db30845f84e57865fa40b9a730a05, user_id=286a99b42d9246db909040bf8ab18ea1, role_id=6f63a9619c7b40ebb5b73bde026d606b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:23.657348 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a22ab-3912-4996-b686-a3f65a134c4f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:23.672232 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 623/1232] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jun 29 12:11:23 2022] PUT /identity/v3/projects/996db30845f84e57865fa40b9a730a05/users/286a99b42d9246db909040bf8ab18ea1/roles/6f63a9619c7b40ebb5b73bde026d606b => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:11:25.869564 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1effdcb-aa6f-4177-b146-c8f1a767653e None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:25.870148 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1effdcb-aa6f-4177-b146-c8f1a767653e None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:25.870280 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1effdcb-aa6f-4177-b146-c8f1a767653e None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:25.872272 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 610/1233] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:11:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:11:25.879902 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20f3e2-4819-469f-a06d-240590df2b81 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:25.882844 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20f3e2-4819-469f-a06d-240590df2b81 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:25.882844 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20f3e2-4819-469f-a06d-240590df2b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:25.899891 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-9a20f3e2-4819-469f-a06d-240590df2b81 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:11:25.901289 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9a20f3e2-4819-469f-a06d-240590df2b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:11:25.979988 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 624/1234] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:11:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:11:26.004772 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1effdcb-aa6f-4177-b146-c8f1a767653e None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:26.032524 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:26.119710 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1effdcb-aa6f-4177-b146-c8f1a767653e None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:26.155663 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d94727-c5ac-48b4-8b0e-dfe6a46ef7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:26.156477 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d94727-c5ac-48b4-8b0e-dfe6a46ef7a0 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:26.156761 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d94727-c5ac-48b4-8b0e-dfe6a46ef7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:26.157038 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d94727-c5ac-48b4-8b0e-dfe6a46ef7a0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:26.167379 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d94727-c5ac-48b4-8b0e-dfe6a46ef7a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:11:26.175891 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-71d94727-c5ac-48b4-8b0e-dfe6a46ef7a0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:11:26.175891 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:11:26.175891 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:11:26.175891 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:11:26.175891 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:11:26.175891 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:11:26.175891 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:11:26.175891 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:11:26.175891 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:11:26.175891 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:11:26.175891 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:11:26.175891 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:11:26.175891 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:11:26.175891 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:11:26.175891 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:11:26.175891 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:11:26.177069 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:11:26.177069 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:11:26.177069 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:11:26.177069 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:11:26.177069 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:11:26.177069 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:11:26.177069 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:11:26.177069 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:11:26.177069 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:11:26.177069 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:11:26.177069 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:11:26.177069 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:11:26.177069 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:11:26.177069 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:11:26.177069 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:11:26.177069 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:11:26.178136 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:11:26.178136 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:11:26.178136 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:11:26.178136 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:11:26.178136 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:11:26.178136 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:11:26.178136 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:11:26.178136 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:11:26.178136 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:11:26.178136 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:11:26.178136 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 12:11:26.178136 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:11:26.178136 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 611/1235] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jun 29 12:11:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:11:26.184026 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20f3e2-4819-469f-a06d-240590df2b81 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:26.235548 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:26.296837 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20f3e2-4819-469f-a06d-240590df2b81 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:26.336101 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea449371-796c-402a-91e3-e953a79b03fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:26.336836 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea449371-796c-402a-91e3-e953a79b03fd None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:26.337159 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea449371-796c-402a-91e3-e953a79b03fd None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:26.337473 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea449371-796c-402a-91e3-e953a79b03fd None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:26.338370 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea449371-796c-402a-91e3-e953a79b03fd None admin] RBAC: Adding query filter params (name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:11:26.338737 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea449371-796c-402a-91e3-e953a79b03fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:26.340342 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea449371-796c-402a-91e3-e953a79b03fd None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:26.348739 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 625/1236] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jun 29 12:11:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:11:26.355089 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d94727-c5ac-48b4-8b0e-dfe6a46ef7a0 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:26.448723 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:26.466471 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d94727-c5ac-48b4-8b0e-dfe6a46ef7a0 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:26.503932 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858bc908-15bf-43d0-b722-6d043bf3b520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:26.504746 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858bc908-15bf-43d0-b722-6d043bf3b520 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:26.505286 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858bc908-15bf-43d0-b722-6d043bf3b520 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:26.505564 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858bc908-15bf-43d0-b722-6d043bf3b520 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:26.517246 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858bc908-15bf-43d0-b722-6d043bf3b520 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:26.518756 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858bc908-15bf-43d0-b722-6d043bf3b520 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:26.536594 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-858bc908-15bf-43d0-b722-6d043bf3b520 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:11:26.536594 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:11:26.536594 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:11:26.536594 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:11:26.536594 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:11:26.536594 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:11:26.536594 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:11:26.536594 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:11:26.536594 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:11:26.536594 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:11:26.536594 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:11:26.536594 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:11:26.536594 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:11:26.536594 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:11:26.536594 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:11:26.537759 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:11:26.537759 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:11:26.537759 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:11:26.537759 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:11:26.537759 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:11:26.537759 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:11:26.537759 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:11:26.537759 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:11:26.537759 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:11:26.537759 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:11:26.537759 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:11:26.537759 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:11:26.537759 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:11:26.537759 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:11:26.537759 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:11:26.537759 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:11:26.537759 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:11:26.538878 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:11:26.538878 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:11:26.538878 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:11:26.538878 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:11:26.538878 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 612/1237] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:11:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:11:26.543822 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea449371-796c-402a-91e3-e953a79b03fd None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:26.654678 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea449371-796c-402a-91e3-e953a79b03fd None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:26.664758 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:26.693492 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165a1279-d039-4755-a1f6-fb99449ee47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:26.694995 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a1279-d039-4755-a1f6-fb99449ee47b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:26.695267 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a1279-d039-4755-a1f6-fb99449ee47b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:26.695662 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a1279-d039-4755-a1f6-fb99449ee47b None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:26.696500 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165a1279-d039-4755-a1f6-fb99449ee47b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:11:26.696926 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165a1279-d039-4755-a1f6-fb99449ee47b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:26.698671 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165a1279-d039-4755-a1f6-fb99449ee47b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:26.714370 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 626/1238] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:11:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:11:26.720281 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858bc908-15bf-43d0-b722-6d043bf3b520 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:26.837630 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858bc908-15bf-43d0-b722-6d043bf3b520 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:26.875369 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc5d5ce-6742-4428-8f4e-8c02bda55481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:26.876181 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5d5ce-6742-4428-8f4e-8c02bda55481 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:26.876457 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5d5ce-6742-4428-8f4e-8c02bda55481 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:26.876726 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5d5ce-6742-4428-8f4e-8c02bda55481 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:26.879504 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:26.886321 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc5d5ce-6742-4428-8f4e-8c02bda55481 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:26.888203 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc5d5ce-6742-4428-8f4e-8c02bda55481 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:26.904151 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-cbc5d5ce-6742-4428-8f4e-8c02bda55481 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 29 12:11:26.904151 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:11:26.904151 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:11:26.904151 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:11:26.904151 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:11:26.904151 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:11:26.904151 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:11:26.904151 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:11:26.904151 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:11:26.904151 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:11:26.904151 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:11:26.904151 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:11:26.904151 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:11:26.904151 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:11:26.904151 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:11:26.904151 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:11:26.905296 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:11:26.905296 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:11:26.905296 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:11:26.905296 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:11:26.905296 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:11:26.905296 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:11:26.905296 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:11:26.905296 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:11:26.905296 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:11:26.905296 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:11:26.905296 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:11:26.905296 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:11:26.905296 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:11:26.905296 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:11:26.905296 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:11:26.905296 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:11:26.905296 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:11:26.905296 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:11:26.907603 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:11:26.907603 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:11:26.907603 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:11:26.907603 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:11:26.907603 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:11:26.907603 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:11:26.907603 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:11:26.907603 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:11:26.907603 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 29 12:11:26.907603 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:11:26.907603 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 613/1239] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:11:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:11:26.911336 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165a1279-d039-4755-a1f6-fb99449ee47b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:27.019882 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165a1279-d039-4755-a1f6-fb99449ee47b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:27.062284 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36b961-7b79-40a5-a43f-9e65699e7718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:27.062960 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36b961-7b79-40a5-a43f-9e65699e7718 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:27.063263 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36b961-7b79-40a5-a43f-9e65699e7718 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:27.063575 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36b961-7b79-40a5-a43f-9e65699e7718 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:27.064513 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b36b961-7b79-40a5-a43f-9e65699e7718 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:11:27.064818 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b36b961-7b79-40a5-a43f-9e65699e7718 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:27.066354 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b36b961-7b79-40a5-a43f-9e65699e7718 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:27.089510 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 627/1240] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Jun 29 12:11:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:11:27.090862 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc5d5ce-6742-4428-8f4e-8c02bda55481 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:27.196127 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc5d5ce-6742-4428-8f4e-8c02bda55481 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:27.235565 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3549bd57-0590-4832-98b4-8a7a2d8a3c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:27.236220 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549bd57-0590-4832-98b4-8a7a2d8a3c10 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:27.236498 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549bd57-0590-4832-98b4-8a7a2d8a3c10 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:27.236752 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549bd57-0590-4832-98b4-8a7a2d8a3c10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:27.300503 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:27.307325 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3549bd57-0590-4832-98b4-8a7a2d8a3c10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:27.308794 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3549bd57-0590-4832-98b4-8a7a2d8a3c10 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:27.419187 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 614/1241] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:11:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 12:11:27.425261 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36b961-7b79-40a5-a43f-9e65699e7718 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:27.456341 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:27.555629 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36b961-7b79-40a5-a43f-9e65699e7718 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:27.596832 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f7b0a-3046-4803-ad3a-6f22b715c052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:27.597974 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f7b0a-3046-4803-ad3a-6f22b715c052 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:27.598253 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f7b0a-3046-4803-ad3a-6f22b715c052 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:27.598526 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f7b0a-3046-4803-ad3a-6f22b715c052 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:27.610838 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f7b0a-3046-4803-ad3a-6f22b715c052 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:27.612619 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f7b0a-3046-4803-ad3a-6f22b715c052 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:27.633371 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-8f2f7b0a-3046-4803-ad3a-6f22b715c052 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:11:27.633371 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:11:27.633371 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:11:27.633371 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:11:27.633371 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:11:27.633371 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:11:27.633371 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:11:27.633371 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:11:27.633371 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:11:27.633371 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:11:27.633371 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:11:27.633371 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:11:27.633371 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:11:27.633371 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:11:27.633371 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:11:27.634510 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:11:27.634510 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:11:27.634510 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:11:27.634510 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:11:27.634510 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:11:27.634510 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:11:27.634510 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:11:27.634510 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:11:27.634510 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:11:27.634510 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:11:27.634510 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:11:27.634510 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:11:27.634510 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:11:27.634510 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:11:27.634510 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:11:27.634510 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:11:27.634510 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:11:27.635433 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:11:27.635433 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:11:27.635433 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:11:27.635433 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:11:27.635433 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 628/1242] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:11:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:11:27.640960 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3549bd57-0590-4832-98b4-8a7a2d8a3c10 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:27.755081 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:27.762450 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3549bd57-0590-4832-98b4-8a7a2d8a3c10 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:27.797776 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cffdad2-345c-45c3-9656-36fe937a0daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:27.798411 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cffdad2-345c-45c3-9656-36fe937a0daa None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:27.798692 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cffdad2-345c-45c3-9656-36fe937a0daa None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:27.798965 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cffdad2-345c-45c3-9656-36fe937a0daa None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:27.799691 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cffdad2-345c-45c3-9656-36fe937a0daa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:11:27.799995 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cffdad2-345c-45c3-9656-36fe937a0daa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:27.801381 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cffdad2-345c-45c3-9656-36fe937a0daa None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:27.816058 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 615/1243] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:11:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:11:27.823586 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f7b0a-3046-4803-ad3a-6f22b715c052 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:27.926435 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:27.960109 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f7b0a-3046-4803-ad3a-6f22b715c052 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:28.003423 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b67da83-b78c-4228-a181-bd046a91438a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:28.004232 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67da83-b78c-4228-a181-bd046a91438a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:28.004508 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67da83-b78c-4228-a181-bd046a91438a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:28.004778 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67da83-b78c-4228-a181-bd046a91438a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:28.012852 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b67da83-b78c-4228-a181-bd046a91438a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:28.014638 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b67da83-b78c-4228-a181-bd046a91438a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:28.029417 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-4b67da83-b78c-4228-a181-bd046a91438a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:11:28.029417 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:11:28.029417 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:11:28.029417 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:11:28.029417 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:11:28.029417 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:11:28.029417 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:11:28.029417 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:11:28.029417 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:11:28.029417 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:11:28.029417 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:11:28.029417 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:11:28.029417 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:11:28.029417 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:11:28.029417 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:11:28.031858 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:11:28.031858 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:11:28.031858 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:11:28.031858 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:11:28.031858 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:11:28.031858 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:11:28.031858 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:11:28.031858 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:11:28.031858 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:11:28.031858 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:11:28.031858 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:11:28.031858 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:11:28.031858 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:11:28.031858 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:11:28.031858 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:11:28.031858 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:11:28.031858 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:11:28.033532 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:11:28.033532 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:11:28.033532 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:11:28.033532 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:11:28.033532 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:11:28.033532 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:11:28.033532 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:11:28.033532 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:11:28.033532 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 629/1244] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jun 29 12:11:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:11:28.036787 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cffdad2-345c-45c3-9656-36fe937a0daa None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:28.154110 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cffdad2-345c-45c3-9656-36fe937a0daa None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:28.191186 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5011c5-833b-49d7-a01c-f3c1ab9c238c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:28.192939 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5011c5-833b-49d7-a01c-f3c1ab9c238c None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:28.192939 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5011c5-833b-49d7-a01c-f3c1ab9c238c None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:28.192939 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5011c5-833b-49d7-a01c-f3c1ab9c238c None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:28.193181 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5011c5-833b-49d7-a01c-f3c1ab9c238c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:11:28.193499 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5011c5-833b-49d7-a01c-f3c1ab9c238c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:28.195355 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5011c5-833b-49d7-a01c-f3c1ab9c238c None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:28.208683 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 616/1245] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jun 29 12:11:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:11:28.215361 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b67da83-b78c-4228-a181-bd046a91438a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:28.343720 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b67da83-b78c-4228-a181-bd046a91438a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:28.389908 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc48a1-4598-4f12-aae4-b893d0dc2757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:28.390704 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc48a1-4598-4f12-aae4-b893d0dc2757 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:28.391100 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc48a1-4598-4f12-aae4-b893d0dc2757 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:28.391461 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc48a1-4598-4f12-aae4-b893d0dc2757 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:28.392489 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edc48a1-4598-4f12-aae4-b893d0dc2757 None admin] RBAC: Adding query filter params (role.id=6f63a9619c7b40ebb5b73bde026d606b, scope.project.id=996db30845f84e57865fa40b9a730a05, user.id=286a99b42d9246db909040bf8ab18ea1) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:11:28.392809 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edc48a1-4598-4f12-aae4-b893d0dc2757 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:28.394277 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edc48a1-4598-4f12-aae4-b893d0dc2757 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:28.402303 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 630/1246] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jun 29 12:11:28 2022] GET /identity/v3/role_assignments?user.id=286a99b42d9246db909040bf8ab18ea1&scope.project.id=996db30845f84e57865fa40b9a730a05&role.id=6f63a9619c7b40ebb5b73bde026d606b => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:11:30.950365 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90651fe9-904e-4b6a-95a7-c82f91a34c4d None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:30.950938 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90651fe9-904e-4b6a-95a7-c82f91a34c4d None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:30.951199 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90651fe9-904e-4b6a-95a7-c82f91a34c4d None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:30.953136 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 617/1247] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:11:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:11:30.959266 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99637bd6-42c2-4964-b668-3adbafea31d6 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:30.959887 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99637bd6-42c2-4964-b668-3adbafea31d6 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:30.960012 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99637bd6-42c2-4964-b668-3adbafea31d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:30.965841 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:30.981194 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-99637bd6-42c2-4964-b668-3adbafea31d6 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:11:30.982866 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-99637bd6-42c2-4964-b668-3adbafea31d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:11:31.062219 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 631/1248] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:11:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:11:31.088554 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90651fe9-904e-4b6a-95a7-c82f91a34c4d None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:31.110172 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:31.212879 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90651fe9-904e-4b6a-95a7-c82f91a34c4d None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:31.252950 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26964a-ba6c-49fa-afe4-f60d3ca00155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:31.254007 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26964a-ba6c-49fa-afe4-f60d3ca00155 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:31.254297 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26964a-ba6c-49fa-afe4-f60d3ca00155 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:31.254601 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26964a-ba6c-49fa-afe4-f60d3ca00155 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:31.268307 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e26964a-ba6c-49fa-afe4-f60d3ca00155 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:11:31.277648 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-4e26964a-ba6c-49fa-afe4-f60d3ca00155 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:11:31.277648 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:11:31.277648 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:11:31.277648 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:11:31.277648 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:11:31.277648 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:11:31.277648 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:11:31.277648 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:11:31.277648 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:11:31.277648 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:11:31.277648 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:11:31.277648 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:11:31.277648 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:11:31.277648 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:11:31.277648 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:11:31.277648 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:11:31.278932 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:11:31.278932 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:11:31.278932 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:11:31.278932 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:11:31.278932 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:11:31.278932 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:11:31.278932 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:11:31.278932 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:11:31.278932 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:11:31.278932 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:11:31.278932 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:11:31.278932 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:11:31.278932 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:11:31.278932 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:11:31.278932 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:11:31.278932 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:11:31.279912 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:11:31.279912 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:11:31.279912 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:11:31.279912 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:11:31.279912 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:11:31.279912 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:11:31.279912 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:11:31.279912 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:11:31.279912 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:11:31.279912 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:11:31.279912 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:11:31.279912 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:11:31.279912 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 618/1249] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jun 29 12:11:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:11:31.285513 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99637bd6-42c2-4964-b668-3adbafea31d6 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:31.410691 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99637bd6-42c2-4964-b668-3adbafea31d6 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:31.444547 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:31.455360 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc858f-a766-4445-8240-683b5d3ca20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:31.456052 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc858f-a766-4445-8240-683b5d3ca20a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:31.456375 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc858f-a766-4445-8240-683b5d3ca20a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:31.456563 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc858f-a766-4445-8240-683b5d3ca20a None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:31.457310 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafc858f-a766-4445-8240-683b5d3ca20a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:11:31.457828 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafc858f-a766-4445-8240-683b5d3ca20a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:31.459173 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafc858f-a766-4445-8240-683b5d3ca20a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:31.471082 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 632/1250] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:11:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:11:31.477508 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26964a-ba6c-49fa-afe4-f60d3ca00155 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:31.566427 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:31.591958 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26964a-ba6c-49fa-afe4-f60d3ca00155 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:31.634534 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875eb4a4-8bd5-4184-8121-422dac96abc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:31.635524 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875eb4a4-8bd5-4184-8121-422dac96abc3 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:31.635806 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875eb4a4-8bd5-4184-8121-422dac96abc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:31.636079 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875eb4a4-8bd5-4184-8121-422dac96abc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:31.649150 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875eb4a4-8bd5-4184-8121-422dac96abc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:31.650663 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875eb4a4-8bd5-4184-8121-422dac96abc3 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:31.670896 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-875eb4a4-8bd5-4184-8121-422dac96abc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:11:31.670896 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:11:31.670896 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:11:31.670896 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:11:31.670896 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:11:31.670896 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:11:31.670896 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:11:31.670896 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:11:31.670896 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:11:31.670896 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:11:31.670896 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:11:31.670896 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:11:31.670896 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:11:31.670896 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:11:31.670896 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:11:31.672346 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:11:31.672346 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:11:31.672346 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:11:31.672346 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:11:31.672346 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:11:31.672346 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:11:31.672346 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:11:31.672346 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:11:31.672346 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:11:31.672346 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:11:31.672346 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:11:31.672346 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:11:31.672346 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:11:31.672346 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:11:31.672346 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:11:31.672346 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:11:31.672346 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:11:31.673544 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:11:31.673544 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:11:31.673544 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:11:31.673544 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:11:31.673544 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 619/1251] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:11:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:11:31.678309 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc858f-a766-4445-8240-683b5d3ca20a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:31.804613 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc858f-a766-4445-8240-683b5d3ca20a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:31.843420 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8536d-f9af-425a-8892-45b8eafe809d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:31.844129 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8536d-f9af-425a-8892-45b8eafe809d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:31.844435 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8536d-f9af-425a-8892-45b8eafe809d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:31.844755 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8536d-f9af-425a-8892-45b8eafe809d None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:31.845485 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d8536d-f9af-425a-8892-45b8eafe809d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:11:31.845822 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d8536d-f9af-425a-8892-45b8eafe809d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:31.847205 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d8536d-f9af-425a-8892-45b8eafe809d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:31.866556 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 633/1252] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:11:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:11:31.867919 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875eb4a4-8bd5-4184-8121-422dac96abc3 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:31.986343 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875eb4a4-8bd5-4184-8121-422dac96abc3 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:32.016208 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:32.025229 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88e4c3-0340-4ecc-8ea5-91e5d879e83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:32.026135 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88e4c3-0340-4ecc-8ea5-91e5d879e83a None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:32.026513 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88e4c3-0340-4ecc-8ea5-91e5d879e83a None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:32.026825 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88e4c3-0340-4ecc-8ea5-91e5d879e83a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:32.036471 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf88e4c3-0340-4ecc-8ea5-91e5d879e83a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:32.038395 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf88e4c3-0340-4ecc-8ea5-91e5d879e83a None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:32.054577 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-bf88e4c3-0340-4ecc-8ea5-91e5d879e83a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 29 12:11:32.054577 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:11:32.054577 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:11:32.054577 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:11:32.054577 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:11:32.054577 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:11:32.054577 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:11:32.054577 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:11:32.054577 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:11:32.054577 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:11:32.054577 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:11:32.054577 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:11:32.054577 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:11:32.054577 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:11:32.054577 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:11:32.054577 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:11:32.055858 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:11:32.055858 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:11:32.055858 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:11:32.055858 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:11:32.055858 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:11:32.055858 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:11:32.055858 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:11:32.055858 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:11:32.055858 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:11:32.055858 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:11:32.055858 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:11:32.055858 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:11:32.055858 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:11:32.055858 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:11:32.055858 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:11:32.055858 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:11:32.055858 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:11:32.055858 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:11:32.056977 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:11:32.056977 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:11:32.056977 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:11:32.056977 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:11:32.056977 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:11:32.056977 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:11:32.056977 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:11:32.056977 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:11:32.056977 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 29 12:11:32.056977 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:11:32.056977 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 620/1253] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:11:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 12:11:32.062416 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8536d-f9af-425a-8892-45b8eafe809d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:32.127880 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:32.178570 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8536d-f9af-425a-8892-45b8eafe809d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:32.217004 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39280f-ac27-4662-9052-d2ed5af73e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:32.217713 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39280f-ac27-4662-9052-d2ed5af73e4e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:32.218020 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39280f-ac27-4662-9052-d2ed5af73e4e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:32.218272 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39280f-ac27-4662-9052-d2ed5af73e4e None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:32.219144 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed39280f-ac27-4662-9052-d2ed5af73e4e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:11:32.219650 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed39280f-ac27-4662-9052-d2ed5af73e4e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:32.221546 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed39280f-ac27-4662-9052-d2ed5af73e4e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:32.241965 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 634/1254] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Jun 29 12:11:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:11:32.247946 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88e4c3-0340-4ecc-8ea5-91e5d879e83a None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:32.361472 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88e4c3-0340-4ecc-8ea5-91e5d879e83a None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:32.398079 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d9595-cfe3-4b7b-9d18-939620591b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:32.398741 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d9595-cfe3-4b7b-9d18-939620591b1a None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:32.399025 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d9595-cfe3-4b7b-9d18-939620591b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:32.399376 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d9595-cfe3-4b7b-9d18-939620591b1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:32.463899 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:32.477496 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011d9595-cfe3-4b7b-9d18-939620591b1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:32.479187 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011d9595-cfe3-4b7b-9d18-939620591b1a None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:32.585125 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 621/1255] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:11:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 12:11:32.591338 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39280f-ac27-4662-9052-d2ed5af73e4e None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:32.707779 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39280f-ac27-4662-9052-d2ed5af73e4e None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:32.722834 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:32.746815 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba1063c-8071-4342-ab3b-94108fd88f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:32.747725 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1063c-8071-4342-ab3b-94108fd88f93 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:32.747996 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1063c-8071-4342-ab3b-94108fd88f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:32.748299 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1063c-8071-4342-ab3b-94108fd88f93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:32.759790 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba1063c-8071-4342-ab3b-94108fd88f93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:32.761256 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba1063c-8071-4342-ab3b-94108fd88f93 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:32.778851 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-eba1063c-8071-4342-ab3b-94108fd88f93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:11:32.778851 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:11:32.778851 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:11:32.778851 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:11:32.778851 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:11:32.778851 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:11:32.778851 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:11:32.778851 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:11:32.778851 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:11:32.778851 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:11:32.778851 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:11:32.778851 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:11:32.778851 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:11:32.778851 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:11:32.778851 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:11:32.780070 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:11:32.780070 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:11:32.780070 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:11:32.780070 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:11:32.780070 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:11:32.780070 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:11:32.780070 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:11:32.780070 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:11:32.780070 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:11:32.780070 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:11:32.780070 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:11:32.780070 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:11:32.780070 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:11:32.780070 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:11:32.780070 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:11:32.780070 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:11:32.780070 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:11:32.781203 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:11:32.781203 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:11:32.781203 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:11:32.781203 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:11:32.781203 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 635/1256] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:11:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:11:32.786260 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d9595-cfe3-4b7b-9d18-939620591b1a None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:32.890172 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:32.903887 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d9595-cfe3-4b7b-9d18-939620591b1a None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:32.941404 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1747308-a6cc-4622-9a5a-ece12ed21d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:32.942102 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1747308-a6cc-4622-9a5a-ece12ed21d3b None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:32.942382 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1747308-a6cc-4622-9a5a-ece12ed21d3b None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:32.942661 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1747308-a6cc-4622-9a5a-ece12ed21d3b None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:32.943472 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1747308-a6cc-4622-9a5a-ece12ed21d3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:11:32.944027 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1747308-a6cc-4622-9a5a-ece12ed21d3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:32.945968 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1747308-a6cc-4622-9a5a-ece12ed21d3b None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:32.959546 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 622/1257] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:11:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:11:32.965278 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba1063c-8071-4342-ab3b-94108fd88f93 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:33.079806 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba1063c-8071-4342-ab3b-94108fd88f93 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:33.120938 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da632a0f-5e40-4e02-b1c4-32e915058807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:33.121771 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da632a0f-5e40-4e02-b1c4-32e915058807 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:33.122054 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da632a0f-5e40-4e02-b1c4-32e915058807 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:33.122323 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da632a0f-5e40-4e02-b1c4-32e915058807 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:33.131278 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da632a0f-5e40-4e02-b1c4-32e915058807 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:33.133676 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da632a0f-5e40-4e02-b1c4-32e915058807 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:33.150691 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-da632a0f-5e40-4e02-b1c4-32e915058807 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:11:33.150691 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:11:33.150691 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:11:33.150691 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:11:33.150691 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:11:33.150691 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:11:33.150691 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:11:33.150691 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:11:33.150691 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:11:33.150691 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:11:33.150691 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:11:33.150691 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:11:33.150691 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:11:33.150691 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:11:33.150691 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:11:33.152067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:11:33.152067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:11:33.152067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:11:33.152067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:11:33.152067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:11:33.152067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:11:33.152067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:11:33.152067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:11:33.152067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:11:33.152067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:11:33.152067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:11:33.152067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:11:33.152067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:11:33.152067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:11:33.152067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:11:33.152067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:11:33.152067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:11:33.153429 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:11:33.153429 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:11:33.153429 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:11:33.153429 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:11:33.153429 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:11:33.153429 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:11:33.153429 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:11:33.153429 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:11:33.155572 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 636/1258] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jun 29 12:11:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:11:33.163050 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1747308-a6cc-4622-9a5a-ece12ed21d3b None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:33.274438 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1747308-a6cc-4622-9a5a-ece12ed21d3b None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:33.312098 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5566e5-0779-435e-9421-98b19ff5d6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:33.312934 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5566e5-0779-435e-9421-98b19ff5d6dd None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:33.313219 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5566e5-0779-435e-9421-98b19ff5d6dd None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:33.313502 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5566e5-0779-435e-9421-98b19ff5d6dd None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:33.314334 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5566e5-0779-435e-9421-98b19ff5d6dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:11:33.314648 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5566e5-0779-435e-9421-98b19ff5d6dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:33.316099 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5566e5-0779-435e-9421-98b19ff5d6dd None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:33.332169 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 623/1259] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jun 29 12:11:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:11:33.339311 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da632a0f-5e40-4e02-b1c4-32e915058807 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:33.368385 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:33.453240 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da632a0f-5e40-4e02-b1c4-32e915058807 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:33.493347 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea488775-b760-478b-aa51-401e21eb8a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:33.494038 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea488775-b760-478b-aa51-401e21eb8a3f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:33.494322 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea488775-b760-478b-aa51-401e21eb8a3f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:33.494597 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea488775-b760-478b-aa51-401e21eb8a3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:33.495433 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea488775-b760-478b-aa51-401e21eb8a3f None admin] RBAC: Adding query filter params (role.id=e0e69ac8a8bf4cc4baa6aa18f2fc9919, scope.project.id=996db30845f84e57865fa40b9a730a05, user.id=286a99b42d9246db909040bf8ab18ea1) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:11:33.495744 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea488775-b760-478b-aa51-401e21eb8a3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:33.497198 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea488775-b760-478b-aa51-401e21eb8a3f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:33.506883 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 637/1260] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jun 29 12:11:33 2022] GET /identity/v3/role_assignments?user.id=286a99b42d9246db909040bf8ab18ea1&scope.project.id=996db30845f84e57865fa40b9a730a05&role.id=e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:11:35.529172 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af3d20-54f8-46a3-b1ff-dc9d089f32df None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:35.530090 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af3d20-54f8-46a3-b1ff-dc9d089f32df None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:35.530090 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af3d20-54f8-46a3-b1ff-dc9d089f32df None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:35.532278 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 624/1261] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:11:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:11:35.537804 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f52b93e-9102-4af8-a646-e559dbd36cb9 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:35.538241 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f52b93e-9102-4af8-a646-e559dbd36cb9 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:35.539121 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f52b93e-9102-4af8-a646-e559dbd36cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:35.557941 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-6f52b93e-9102-4af8-a646-e559dbd36cb9 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:11:35.559139 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6f52b93e-9102-4af8-a646-e559dbd36cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:11:35.642090 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 638/1262] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:11:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:11:35.664750 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af3d20-54f8-46a3-b1ff-dc9d089f32df None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:35.676535 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:35.787251 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af3d20-54f8-46a3-b1ff-dc9d089f32df None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:35.828004 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c6a263-76bb-416b-b80b-f6cb1a32e06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:35.828983 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c6a263-76bb-416b-b80b-f6cb1a32e06a None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:35.829424 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c6a263-76bb-416b-b80b-f6cb1a32e06a None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:35.829901 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c6a263-76bb-416b-b80b-f6cb1a32e06a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:35.841905 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c6a263-76bb-416b-b80b-f6cb1a32e06a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:11:35.849511 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-19c6a263-76bb-416b-b80b-f6cb1a32e06a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:11:35.849511 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:11:35.849511 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:11:35.849511 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:11:35.849511 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:11:35.849511 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:11:35.849511 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:11:35.849511 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:11:35.849511 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:11:35.849511 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:11:35.849511 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:11:35.849511 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:11:35.849511 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:11:35.849511 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:11:35.849511 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:11:35.849511 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:11:35.850669 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:11:35.850669 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:11:35.850669 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:11:35.850669 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:11:35.850669 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:11:35.850669 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:11:35.850669 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:11:35.850669 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:11:35.850669 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:11:35.850669 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:11:35.850669 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:11:35.850669 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:11:35.850669 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:11:35.850669 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:11:35.850669 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:11:35.850669 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:11:35.851747 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:11:35.851747 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:11:35.851747 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:11:35.851747 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:11:35.851747 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:11:35.851747 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:11:35.851747 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:11:35.851747 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:11:35.851747 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:11:35.851747 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:11:35.851747 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:11:35.851747 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:11:35.851747 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 625/1263] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jun 29 12:11:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:11:35.858428 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f52b93e-9102-4af8-a646-e559dbd36cb9 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:35.878451 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:35.963880 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f52b93e-9102-4af8-a646-e559dbd36cb9 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:36.003717 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123bee10-1de6-4e6d-8822-012cf978f747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:36.004378 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123bee10-1de6-4e6d-8822-012cf978f747 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:36.004662 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123bee10-1de6-4e6d-8822-012cf978f747 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:36.004932 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123bee10-1de6-4e6d-8822-012cf978f747 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:36.005683 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123bee10-1de6-4e6d-8822-012cf978f747 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:11:36.006026 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123bee10-1de6-4e6d-8822-012cf978f747 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:36.007799 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123bee10-1de6-4e6d-8822-012cf978f747 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:36.016151 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 639/1264] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:11:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:11:36.024153 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c6a263-76bb-416b-b80b-f6cb1a32e06a None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:36.099624 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:36.134477 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c6a263-76bb-416b-b80b-f6cb1a32e06a None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:36.170794 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a05df7-a713-472a-a8d9-3a39cea9f0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:36.171577 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a05df7-a713-472a-a8d9-3a39cea9f0da None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:36.171858 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a05df7-a713-472a-a8d9-3a39cea9f0da None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:36.172131 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a05df7-a713-472a-a8d9-3a39cea9f0da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:36.183344 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a05df7-a713-472a-a8d9-3a39cea9f0da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:36.184787 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a05df7-a713-472a-a8d9-3a39cea9f0da None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:36.204542 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-f0a05df7-a713-472a-a8d9-3a39cea9f0da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:11:36.204542 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:11:36.204542 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:11:36.204542 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:11:36.204542 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:11:36.204542 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:11:36.204542 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:11:36.204542 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:11:36.204542 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:11:36.204542 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:11:36.204542 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:11:36.204542 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:11:36.204542 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:11:36.204542 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:11:36.204542 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:11:36.205654 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:11:36.205654 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:11:36.205654 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:11:36.205654 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:11:36.205654 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:11:36.205654 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:11:36.205654 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:11:36.205654 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:11:36.205654 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:11:36.205654 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:11:36.205654 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:11:36.205654 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:11:36.205654 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:11:36.205654 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:11:36.205654 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:11:36.205654 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:11:36.205654 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:11:36.207280 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:11:36.207280 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:11:36.207280 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:11:36.207280 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:11:36.207280 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 626/1265] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:11:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:11:36.215739 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123bee10-1de6-4e6d-8822-012cf978f747 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:36.311673 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:36.342275 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123bee10-1de6-4e6d-8822-012cf978f747 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:36.377867 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231fe3f6-4dcb-497b-a857-5137ff787b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:36.378526 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231fe3f6-4dcb-497b-a857-5137ff787b66 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:36.378811 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231fe3f6-4dcb-497b-a857-5137ff787b66 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:36.379088 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231fe3f6-4dcb-497b-a857-5137ff787b66 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:36.379814 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231fe3f6-4dcb-497b-a857-5137ff787b66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:11:36.380117 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231fe3f6-4dcb-497b-a857-5137ff787b66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:36.381529 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231fe3f6-4dcb-497b-a857-5137ff787b66 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:36.393560 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 640/1266] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:11:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:11:36.401043 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a05df7-a713-472a-a8d9-3a39cea9f0da None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:36.510964 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a05df7-a713-472a-a8d9-3a39cea9f0da None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:36.538781 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:36.559795 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2708d36b-3d95-4821-a9f7-2c2ce22fd7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:36.560624 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708d36b-3d95-4821-a9f7-2c2ce22fd7a9 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:36.560896 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708d36b-3d95-4821-a9f7-2c2ce22fd7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:36.561166 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708d36b-3d95-4821-a9f7-2c2ce22fd7a9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:36.571510 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2708d36b-3d95-4821-a9f7-2c2ce22fd7a9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:36.572914 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2708d36b-3d95-4821-a9f7-2c2ce22fd7a9 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:36.588489 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-2708d36b-3d95-4821-a9f7-2c2ce22fd7a9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 29 12:11:36.588489 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:11:36.588489 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:11:36.588489 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:11:36.588489 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:11:36.588489 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:11:36.588489 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:11:36.588489 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:11:36.588489 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:11:36.588489 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:11:36.588489 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:11:36.588489 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:11:36.588489 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:11:36.588489 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:11:36.588489 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:11:36.588489 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:11:36.589625 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:11:36.589625 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:11:36.589625 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:11:36.589625 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:11:36.589625 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:11:36.589625 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:11:36.589625 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:11:36.589625 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:11:36.589625 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:11:36.589625 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:11:36.589625 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:11:36.589625 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:11:36.589625 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:11:36.589625 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:11:36.589625 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:11:36.589625 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:11:36.589625 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:11:36.589625 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:11:36.595107 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:11:36.595107 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:11:36.595107 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:11:36.595107 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:11:36.595107 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:11:36.595107 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:11:36.595107 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:11:36.595107 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:11:36.595107 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 29 12:11:36.595107 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:11:36.595107 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 627/1267] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:11:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:11:36.597313 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231fe3f6-4dcb-497b-a857-5137ff787b66 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:36.712903 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231fe3f6-4dcb-497b-a857-5137ff787b66 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:36.753718 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7624725b-ce62-46fc-b3e0-d1628d034e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:36.754404 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624725b-ce62-46fc-b3e0-d1628d034e9e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:36.754684 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624725b-ce62-46fc-b3e0-d1628d034e9e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:36.754949 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624725b-ce62-46fc-b3e0-d1628d034e9e None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:36.755783 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7624725b-ce62-46fc-b3e0-d1628d034e9e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:11:36.756116 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7624725b-ce62-46fc-b3e0-d1628d034e9e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:36.757585 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7624725b-ce62-46fc-b3e0-d1628d034e9e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:36.766772 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:36.778704 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 641/1268] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Jun 29 12:11:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:11:36.784783 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2708d36b-3d95-4821-a9f7-2c2ce22fd7a9 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:36.892920 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2708d36b-3d95-4821-a9f7-2c2ce22fd7a9 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:36.929965 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5213b5-dd4b-45c8-8c68-e1e9c649c611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:36.930750 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5213b5-dd4b-45c8-8c68-e1e9c649c611 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:36.931030 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5213b5-dd4b-45c8-8c68-e1e9c649c611 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:36.931301 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5213b5-dd4b-45c8-8c68-e1e9c649c611 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:36.942366 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5213b5-dd4b-45c8-8c68-e1e9c649c611 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:36.943972 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5213b5-dd4b-45c8-8c68-e1e9c649c611 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:36.962116 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-fb5213b5-dd4b-45c8-8c68-e1e9c649c611 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:11:36.962116 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:11:36.962116 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:11:36.962116 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:11:36.962116 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:11:36.962116 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:11:36.962116 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:11:36.962116 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:11:36.962116 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:11:36.962116 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:11:36.962116 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:11:36.962116 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:11:36.962116 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:11:36.962116 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:11:36.962116 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:11:36.963149 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:11:36.963149 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:11:36.963149 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:11:36.963149 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:11:36.963149 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:11:36.963149 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:11:36.963149 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:11:36.963149 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:11:36.963149 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:11:36.963149 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:11:36.963149 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:11:36.963149 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:11:36.963149 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:11:36.963149 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:11:36.963149 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:11:36.963149 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:11:36.963149 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:11:36.964104 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:11:36.964104 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:11:36.964104 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:11:36.964104 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:11:36.964104 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 628/1269] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:11:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:11:36.971980 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7624725b-ce62-46fc-b3e0-d1628d034e9e None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:37.092846 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7624725b-ce62-46fc-b3e0-d1628d034e9e None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:37.130984 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c6065-b954-468f-ad0b-7f5b4ca1ecfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:37.131656 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c6065-b954-468f-ad0b-7f5b4ca1ecfd None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:37.131981 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c6065-b954-468f-ad0b-7f5b4ca1ecfd None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:37.132247 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c6065-b954-468f-ad0b-7f5b4ca1ecfd None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:37.132963 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9c6065-b954-468f-ad0b-7f5b4ca1ecfd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:11:37.133251 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9c6065-b954-468f-ad0b-7f5b4ca1ecfd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:37.134689 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9c6065-b954-468f-ad0b-7f5b4ca1ecfd None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:37.146126 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 642/1270] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:11:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:11:37.154781 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5213b5-dd4b-45c8-8c68-e1e9c649c611 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:37.187543 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:37.271337 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5213b5-dd4b-45c8-8c68-e1e9c649c611 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:37.309561 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a9955-5afd-4cd8-80d0-3214537429b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:37.310446 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a9955-5afd-4cd8-80d0-3214537429b4 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:37.310726 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a9955-5afd-4cd8-80d0-3214537429b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:37.311002 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a9955-5afd-4cd8-80d0-3214537429b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:37.318563 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43a9955-5afd-4cd8-80d0-3214537429b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:37.320498 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43a9955-5afd-4cd8-80d0-3214537429b4 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:37.335653 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-e43a9955-5afd-4cd8-80d0-3214537429b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:11:37.335653 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:11:37.335653 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:11:37.335653 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:11:37.335653 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:11:37.335653 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:11:37.335653 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:11:37.335653 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:11:37.335653 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:11:37.335653 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:11:37.335653 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:11:37.335653 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:11:37.335653 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:11:37.335653 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:11:37.335653 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:11:37.336615 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:11:37.336615 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:11:37.336615 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:11:37.336615 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:11:37.336615 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:11:37.336615 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:11:37.336615 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:11:37.336615 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:11:37.336615 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:11:37.336615 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:11:37.336615 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:11:37.336615 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:11:37.336615 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:11:37.336615 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:11:37.336615 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:11:37.336615 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:11:37.336615 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:11:37.338084 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:11:37.338084 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:11:37.338084 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:11:37.338084 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:11:37.338084 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:11:37.338084 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:11:37.338084 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:11:37.338084 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:11:37.338084 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 629/1271] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jun 29 12:11:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:11:37.346540 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c6065-b954-468f-ad0b-7f5b4ca1ecfd None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:37.412997 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:37.464814 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c6065-b954-468f-ad0b-7f5b4ca1ecfd None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:37.500086 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b2963a-4c9c-4799-ba9e-88f0584b9106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:37.500742 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2963a-4c9c-4799-ba9e-88f0584b9106 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:37.501022 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2963a-4c9c-4799-ba9e-88f0584b9106 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:37.501293 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2963a-4c9c-4799-ba9e-88f0584b9106 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:37.502186 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b2963a-4c9c-4799-ba9e-88f0584b9106 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:11:37.502498 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b2963a-4c9c-4799-ba9e-88f0584b9106 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:37.503946 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b2963a-4c9c-4799-ba9e-88f0584b9106 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:37.523203 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 643/1272] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jun 29 12:11:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:11:37.529587 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a9955-5afd-4cd8-80d0-3214537429b4 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:37.631343 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:37.646079 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a9955-5afd-4cd8-80d0-3214537429b4 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:37.684681 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb70930-3e03-41a1-9253-76726487c57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:37.685490 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb70930-3e03-41a1-9253-76726487c57a None admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:37.685795 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb70930-3e03-41a1-9253-76726487c57a None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:37.686067 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb70930-3e03-41a1-9253-76726487c57a None admin] PATH_INFO: `/v3/projects/996db30845f84e57865fa40b9a730a05/users/286a99b42d9246db909040bf8ab18ea1/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:37.688144 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb70930-3e03-41a1-9253-76726487c57a None admin] RBAC: Authorizing `identity:create_grant(project_id=996db30845f84e57865fa40b9a730a05, user_id=286a99b42d9246db909040bf8ab18ea1, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:37.690071 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb70930-3e03-41a1-9253-76726487c57a None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:37.707746 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 630/1273] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jun 29 12:11:37 2022] PUT /identity/v3/projects/996db30845f84e57865fa40b9a730a05/users/286a99b42d9246db909040bf8ab18ea1/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:11:39.734947 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9e22c-e2d1-4df5-a878-77540df37e30 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:39.735562 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9e22c-e2d1-4df5-a878-77540df37e30 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:39.735562 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9e22c-e2d1-4df5-a878-77540df37e30 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:39.736886 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 644/1274] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:11:39.742357 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739879f-6c92-448d-a8e3-30ea1c5ffadd None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:39.742779 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739879f-6c92-448d-a8e3-30ea1c5ffadd None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:39.742907 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739879f-6c92-448d-a8e3-30ea1c5ffadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:39.760670 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-c739879f-6c92-448d-a8e3-30ea1c5ffadd None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:11:39.761909 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-c739879f-6c92-448d-a8e3-30ea1c5ffadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:11:39.832459 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 631/1275] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:11:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:11:39.869219 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9e22c-e2d1-4df5-a878-77540df37e30 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:39.986279 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9e22c-e2d1-4df5-a878-77540df37e30 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:40.003986 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:40.023150 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a763f5-e3de-4c15-bf3b-1364fa8e61cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:40.023928 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a763f5-e3de-4c15-bf3b-1364fa8e61cd None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:40.024206 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a763f5-e3de-4c15-bf3b-1364fa8e61cd None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:40.024472 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a763f5-e3de-4c15-bf3b-1364fa8e61cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:40.035373 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a763f5-e3de-4c15-bf3b-1364fa8e61cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 12:11:40.044254 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-d0a763f5-e3de-4c15-bf3b-1364fa8e61cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:11:40.044254 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:11:40.044254 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:11:40.044254 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:11:40.044254 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:11:40.044254 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:11:40.044254 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:11:40.044254 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:11:40.044254 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:11:40.044254 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:11:40.044254 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:11:40.044254 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:11:40.044254 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 12:11:40.044254 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 12:11:40.044254 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 12:11:40.044254 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 12:11:40.045416 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 12:11:40.045416 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 12:11:40.045416 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 12:11:40.045416 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 12:11:40.045416 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:11:40.045416 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:11:40.045416 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:11:40.045416 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:11:40.045416 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:11:40.045416 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:11:40.045416 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:11:40.045416 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:11:40.045416 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:11:40.045416 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:11:40.045416 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:11:40.045416 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:11:40.046512 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:11:40.046512 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:11:40.046512 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:11:40.046512 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:11:40.046512 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 12:11:40.046512 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 12:11:40.046512 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 12:11:40.046512 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 12:11:40.046512 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 12:11:40.046512 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 12:11:40.046512 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 12:11:40.046512 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:11:40.046512 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 645/1276] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jun 29 12:11:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:11:40.051562 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739879f-6c92-448d-a8e3-30ea1c5ffadd None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:40.143471 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:40.164860 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739879f-6c92-448d-a8e3-30ea1c5ffadd None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:40.205037 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d062b-2218-4bc0-96bc-90c5a1e52b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:40.206075 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d062b-2218-4bc0-96bc-90c5a1e52b7d None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:40.206449 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d062b-2218-4bc0-96bc-90c5a1e52b7d None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:40.206811 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d062b-2218-4bc0-96bc-90c5a1e52b7d None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:40.207965 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9d062b-2218-4bc0-96bc-90c5a1e52b7d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:11:40.208373 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9d062b-2218-4bc0-96bc-90c5a1e52b7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:40.210525 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9d062b-2218-4bc0-96bc-90c5a1e52b7d None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:40.224384 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 632/1277] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jun 29 12:11:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:11:40.230782 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a763f5-e3de-4c15-bf3b-1364fa8e61cd None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:40.338425 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a763f5-e3de-4c15-bf3b-1364fa8e61cd None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:40.373025 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f419da-15c9-4a45-8e18-418f1fab5c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:40.373826 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f419da-15c9-4a45-8e18-418f1fab5c6c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:40.374111 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f419da-15c9-4a45-8e18-418f1fab5c6c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:40.374381 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f419da-15c9-4a45-8e18-418f1fab5c6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:40.385901 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f419da-15c9-4a45-8e18-418f1fab5c6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:40.387358 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f419da-15c9-4a45-8e18-418f1fab5c6c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:40.404471 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-25f419da-15c9-4a45-8e18-418f1fab5c6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:11:40.404471 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:11:40.404471 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:11:40.404471 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:11:40.404471 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:11:40.404471 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:11:40.404471 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:11:40.404471 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:11:40.404471 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:11:40.404471 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:11:40.404471 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:11:40.404471 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:11:40.404471 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:11:40.404471 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:11:40.404471 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:11:40.405545 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:11:40.405545 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:11:40.405545 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:11:40.405545 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:11:40.405545 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:11:40.405545 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:11:40.405545 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:11:40.405545 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:11:40.405545 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:11:40.405545 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:11:40.405545 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:11:40.405545 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:11:40.405545 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:11:40.405545 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:11:40.405545 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:11:40.405545 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:11:40.405545 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:11:40.407187 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:11:40.407187 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:11:40.407187 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:11:40.407187 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:11:40.407187 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 646/1278] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:11:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:11:40.415348 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d062b-2218-4bc0-96bc-90c5a1e52b7d None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:40.531201 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d062b-2218-4bc0-96bc-90c5a1e52b7d None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:40.573989 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2031473f-9961-4559-8cb1-02172138045a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:40.574639 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031473f-9961-4559-8cb1-02172138045a None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:40.574913 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031473f-9961-4559-8cb1-02172138045a None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:40.575180 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031473f-9961-4559-8cb1-02172138045a None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:40.575896 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2031473f-9961-4559-8cb1-02172138045a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:11:40.576189 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2031473f-9961-4559-8cb1-02172138045a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:40.577558 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2031473f-9961-4559-8cb1-02172138045a None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:40.589673 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 633/1279] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:11:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:11:40.598901 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f419da-15c9-4a45-8e18-418f1fab5c6c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:40.639897 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:40.718867 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f419da-15c9-4a45-8e18-418f1fab5c6c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:40.762862 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc22fe9-5083-43a9-8ad7-34212877ff1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:40.763758 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc22fe9-5083-43a9-8ad7-34212877ff1a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:40.763956 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc22fe9-5083-43a9-8ad7-34212877ff1a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:40.764230 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc22fe9-5083-43a9-8ad7-34212877ff1a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:40.773109 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc22fe9-5083-43a9-8ad7-34212877ff1a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:40.774845 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc22fe9-5083-43a9-8ad7-34212877ff1a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:40.793778 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-0fc22fe9-5083-43a9-8ad7-34212877ff1a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 29 12:11:40.793778 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:11:40.793778 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:11:40.793778 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:11:40.793778 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:11:40.793778 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:11:40.793778 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:11:40.793778 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:11:40.793778 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:11:40.793778 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:11:40.793778 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:11:40.793778 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:11:40.793778 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 12:11:40.793778 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 12:11:40.793778 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 12:11:40.793778 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 12:11:40.794922 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:11:40.794922 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:11:40.794922 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 12:11:40.794922 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:11:40.794922 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 12:11:40.794922 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 12:11:40.794922 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:11:40.794922 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:11:40.794922 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:11:40.794922 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:11:40.794922 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:11:40.794922 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:11:40.794922 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:11:40.794922 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:11:40.794922 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:11:40.794922 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:11:40.794922 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:11:40.794922 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:11:40.795935 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:11:40.795935 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:11:40.795935 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 12:11:40.795935 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 12:11:40.795935 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 12:11:40.795935 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 12:11:40.795935 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 12:11:40.795935 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 12:11:40.795935 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 29 12:11:40.795935 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:11:40.795935 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 647/1280] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:11:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:11:40.801199 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2031473f-9961-4559-8cb1-02172138045a None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:40.805403 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:40.906860 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2031473f-9961-4559-8cb1-02172138045a None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:40.943692 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b9b707-fef7-42d3-a92e-a5981f4381b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:40.944355 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9b707-fef7-42d3-a92e-a5981f4381b6 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:40.944782 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9b707-fef7-42d3-a92e-a5981f4381b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:40.945061 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9b707-fef7-42d3-a92e-a5981f4381b6 None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:40.945925 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b9b707-fef7-42d3-a92e-a5981f4381b6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:11:40.946227 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b9b707-fef7-42d3-a92e-a5981f4381b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:40.947653 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b9b707-fef7-42d3-a92e-a5981f4381b6 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:40.964912 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 634/1281] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Jun 29 12:11:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:11:40.971027 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc22fe9-5083-43a9-8ad7-34212877ff1a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:41.077827 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:41.091702 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc22fe9-5083-43a9-8ad7-34212877ff1a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:41.130051 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea9d0c-6c2d-4eb6-ae5d-cba37a5fc55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:41.130685 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea9d0c-6c2d-4eb6-ae5d-cba37a5fc55b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:41.130963 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea9d0c-6c2d-4eb6-ae5d-cba37a5fc55b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:41.131226 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea9d0c-6c2d-4eb6-ae5d-cba37a5fc55b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:41.203986 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ea9d0c-6c2d-4eb6-ae5d-cba37a5fc55b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:41.205357 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ea9d0c-6c2d-4eb6-ae5d-cba37a5fc55b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:41.307828 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:41.320234 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 648/1282] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jun 29 12:11:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 12:11:41.327382 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b9b707-fef7-42d3-a92e-a5981f4381b6 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:41.399530 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:41.439144 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b9b707-fef7-42d3-a92e-a5981f4381b6 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:41.477541 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3cfba0-962b-4353-9469-97d668dcd86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:41.478279 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3cfba0-962b-4353-9469-97d668dcd86d None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:41.478560 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3cfba0-962b-4353-9469-97d668dcd86d None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:41.478827 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3cfba0-962b-4353-9469-97d668dcd86d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:41.489585 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3cfba0-962b-4353-9469-97d668dcd86d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:41.491010 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3cfba0-962b-4353-9469-97d668dcd86d None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:41.509469 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-ce3cfba0-962b-4353-9469-97d668dcd86d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:11:41.509469 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:11:41.509469 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:11:41.509469 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:11:41.509469 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:11:41.509469 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:11:41.509469 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:11:41.509469 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:11:41.509469 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:11:41.509469 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:11:41.509469 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:11:41.509469 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:11:41.509469 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 12:11:41.509469 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 12:11:41.509469 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 12:11:41.510457 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 12:11:41.510457 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:11:41.510457 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:11:41.510457 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:11:41.510457 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:11:41.510457 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:11:41.510457 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:11:41.510457 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:11:41.510457 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:11:41.510457 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:11:41.510457 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:11:41.510457 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:11:41.510457 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:11:41.510457 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:11:41.510457 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:11:41.510457 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:11:41.510457 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:11:41.511533 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 12:11:41.511533 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 12:11:41.511533 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 12:11:41.511533 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:11:41.511533 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 635/1283] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:11:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:11:41.518554 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea9d0c-6c2d-4eb6-ae5d-cba37a5fc55b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:41.619173 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea9d0c-6c2d-4eb6-ae5d-cba37a5fc55b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:41.655621 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990ac411-f60a-40e7-9ae2-377234e8cb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:41.656272 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ac411-f60a-40e7-9ae2-377234e8cb6e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:41.656554 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ac411-f60a-40e7-9ae2-377234e8cb6e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:41.656826 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ac411-f60a-40e7-9ae2-377234e8cb6e None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:41.657550 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990ac411-f60a-40e7-9ae2-377234e8cb6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:11:41.657891 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990ac411-f60a-40e7-9ae2-377234e8cb6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:41.659286 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990ac411-f60a-40e7-9ae2-377234e8cb6e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:41.670871 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 649/1284] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jun 29 12:11:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:11:41.680076 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3cfba0-962b-4353-9469-97d668dcd86d None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:41.791844 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3cfba0-962b-4353-9469-97d668dcd86d None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:41.806077 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:41.834397 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7d8305-5594-4862-8e18-6ca5739f6dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:41.835621 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d8305-5594-4862-8e18-6ca5739f6dee None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:41.836071 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d8305-5594-4862-8e18-6ca5739f6dee None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:41.836348 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d8305-5594-4862-8e18-6ca5739f6dee None admin] PATH_INFO: `/v3/projects/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:41.848347 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7d8305-5594-4862-8e18-6ca5739f6dee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:41.850767 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7d8305-5594-4862-8e18-6ca5739f6dee None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:41.871673 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-de7d8305-5594-4862-8e18-6ca5739f6dee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:11:41.871673 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:11:41.871673 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:11:41.871673 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:11:41.871673 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:11:41.871673 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:11:41.871673 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:11:41.871673 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:11:41.871673 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:11:41.871673 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:11:41.871673 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:11:41.871673 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:11:41.871673 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 12:11:41.871673 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 12:11:41.871673 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 12:11:41.872732 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 12:11:41.872732 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:11:41.872732 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:11:41.872732 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:11:41.872732 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:11:41.872732 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:11:41.872732 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:11:41.872732 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:11:41.872732 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jun 29 12:11:41.872732 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:11:41.872732 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:11:41.872732 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:11:41.872732 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:11:41.872732 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:11:41.872732 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:11:41.872732 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:11:41.872732 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:11:41.874012 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 12:11:41.874012 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 12:11:41.874012 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 12:11:41.874012 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 12:11:41.874012 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 12:11:41.874012 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 12:11:41.874012 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 12:11:41.874012 dv-cinder-797608-38-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jun 29 12:11:41.874012 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 636/1285] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jun 29 12:11:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:11:41.879417 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990ac411-f60a-40e7-9ae2-377234e8cb6e None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:41.939172 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:41.996859 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990ac411-f60a-40e7-9ae2-377234e8cb6e None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:42.039397 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beff377-1e6d-4f4f-8a55-28e4059b6ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:42.040149 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beff377-1e6d-4f4f-8a55-28e4059b6ead None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:42.040424 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beff377-1e6d-4f4f-8a55-28e4059b6ead None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:42.040693 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beff377-1e6d-4f4f-8a55-28e4059b6ead None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:42.041482 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beff377-1e6d-4f4f-8a55-28e4059b6ead None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:11:42.041823 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beff377-1e6d-4f4f-8a55-28e4059b6ead None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:42.043319 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beff377-1e6d-4f4f-8a55-28e4059b6ead None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:42.056051 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 650/1286] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jun 29 12:11:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:11:42.065019 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7d8305-5594-4862-8e18-6ca5739f6dee None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:42.181541 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7d8305-5594-4862-8e18-6ca5739f6dee None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:42.228650 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fa2d4b-e719-4055-ba95-de7ba89e4dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:42.229299 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa2d4b-e719-4055-ba95-de7ba89e4dc8 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:42.229575 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa2d4b-e719-4055-ba95-de7ba89e4dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:42.229882 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa2d4b-e719-4055-ba95-de7ba89e4dc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:42.230723 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fa2d4b-e719-4055-ba95-de7ba89e4dc8 None admin] RBAC: Adding query filter params (role.id=e0e69ac8a8bf4cc4baa6aa18f2fc9919, scope.project.id=996db30845f84e57865fa40b9a730a05, user.id=286a99b42d9246db909040bf8ab18ea1) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:11:42.231025 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fa2d4b-e719-4055-ba95-de7ba89e4dc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:42.232464 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fa2d4b-e719-4055-ba95-de7ba89e4dc8 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:42.238964 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 637/1287] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jun 29 12:11:42 2022] GET /identity/v3/role_assignments?user.id=286a99b42d9246db909040bf8ab18ea1&scope.project.id=996db30845f84e57865fa40b9a730a05&role.id=e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:11:44.282921 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85922781-c5cd-4879-bcd7-75b03d7beadf None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:44.283767 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85922781-c5cd-4879-bcd7-75b03d7beadf None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:44.283767 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85922781-c5cd-4879-bcd7-75b03d7beadf None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:44.286066 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 651/1288] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:11:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:11:44.294840 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57750415-3f71-48f3-9a06-cb7d1b6ad507 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:44.295271 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57750415-3f71-48f3-9a06-cb7d1b6ad507 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:44.295408 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57750415-3f71-48f3-9a06-cb7d1b6ad507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:44.318311 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-57750415-3f71-48f3-9a06-cb7d1b6ad507 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:11:44.320097 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-57750415-3f71-48f3-9a06-cb7d1b6ad507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:11:44.361502 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:44.401301 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 638/1289] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:11:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:11:44.425788 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85922781-c5cd-4879-bcd7-75b03d7beadf None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:44.535466 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85922781-c5cd-4879-bcd7-75b03d7beadf None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:44.546542 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:44.575430 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98036a44-adff-44e1-b8ea-c7cfae8aff79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:44.576153 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98036a44-adff-44e1-b8ea-c7cfae8aff79 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:44.576437 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98036a44-adff-44e1-b8ea-c7cfae8aff79 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:44.576708 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98036a44-adff-44e1-b8ea-c7cfae8aff79 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:44.577359 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98036a44-adff-44e1-b8ea-c7cfae8aff79 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:44.578776 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98036a44-adff-44e1-b8ea-c7cfae8aff79 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:44.591091 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-98036a44-adff-44e1-b8ea-c7cfae8aff79 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 12:11:44.591091 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:11:44.591091 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 12:11:44.591091 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 12:11:44.591091 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 12:11:44.591091 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 12:11:44.591091 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 12:11:44.591091 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:11:44.591091 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 12:11:44.591091 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:11:44.591091 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 12:11:44.591091 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:11:44.591091 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:11:44.591091 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:11:44.591091 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:11:44.591091 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:11:44.591091 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:11:44.592288 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:11:44.592288 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:11:44.592288 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:11:44.592288 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:11:44.592288 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:11:44.592288 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:11:44.592288 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 12:11:44.592288 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 12:11:44.592288 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 12:11:44.592288 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 12:11:44.592288 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:11:44.592288 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:11:44.592288 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:11:44.592288 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:11:44.592288 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:11:44.592288 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:11:44.593216 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:11:44.593216 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:11:44.593216 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:11:44.593216 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:11:44.593216 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:11:44.593216 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:11:44.593216 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:11:44.593216 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:11:44.593216 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:11:44.593216 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:11:44.593216 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 12:11:44.593216 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:11:44.593216 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 12:11:44.593216 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:11:44.593216 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 652/1290] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Jun 29 12:11:44 2022] GET /identity/v3/services/placement => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:11:44.598639 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57750415-3f71-48f3-9a06-cb7d1b6ad507 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:44.703554 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57750415-3f71-48f3-9a06-cb7d1b6ad507 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:44.742834 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8fa95-6326-404e-9b99-d6d911ad0b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:44.743578 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8fa95-6326-404e-9b99-d6d911ad0b94 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:44.743863 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8fa95-6326-404e-9b99-d6d911ad0b94 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:44.744215 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8fa95-6326-404e-9b99-d6d911ad0b94 None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:44.744919 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c8fa95-6326-404e-9b99-d6d911ad0b94 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:11:44.745230 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c8fa95-6326-404e-9b99-d6d911ad0b94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:44.746835 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c8fa95-6326-404e-9b99-d6d911ad0b94 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:44.752875 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 639/1291] 10.222.0.27 () {56 vars in 1116 bytes} [Wed Jun 29 12:11:44 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:11:44.759363 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98036a44-adff-44e1-b8ea-c7cfae8aff79 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:44.867785 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98036a44-adff-44e1-b8ea-c7cfae8aff79 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:44.902331 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c2208-4a67-4772-a744-98ab51751c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:44.902980 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c2208-4a67-4772-a744-98ab51751c52 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:44.903267 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c2208-4a67-4772-a744-98ab51751c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:44.903534 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c2208-4a67-4772-a744-98ab51751c52 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:44.904234 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0c2208-4a67-4772-a744-98ab51751c52 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:11:44.904540 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0c2208-4a67-4772-a744-98ab51751c52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:44.905926 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0c2208-4a67-4772-a744-98ab51751c52 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:44.910516 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 653/1292] 10.222.0.27 () {56 vars in 1116 bytes} [Wed Jun 29 12:11:44 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:11:46.928300 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85735b23-cfe0-4cf7-8d0b-b44c26fc503c None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:46.928877 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85735b23-cfe0-4cf7-8d0b-b44c26fc503c None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:46.928877 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85735b23-cfe0-4cf7-8d0b-b44c26fc503c None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:46.930301 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 640/1293] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:11:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:11:46.935692 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a6caa-6192-46b7-8c41-cfbf70e29cf4 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:46.936129 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a6caa-6192-46b7-8c41-cfbf70e29cf4 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:46.936220 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a6caa-6192-46b7-8c41-cfbf70e29cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:46.954862 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-194a6caa-6192-46b7-8c41-cfbf70e29cf4 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:11:46.956051 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-194a6caa-6192-46b7-8c41-cfbf70e29cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:11:46.989128 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:47.031871 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 654/1294] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:11:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:11:47.055046 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85735b23-cfe0-4cf7-8d0b-b44c26fc503c None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:47.089060 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:47.166781 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85735b23-cfe0-4cf7-8d0b-b44c26fc503c None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:47.204386 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d31c1b-cdd7-4e14-8d03-972bfeb29285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:47.204983 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d31c1b-cdd7-4e14-8d03-972bfeb29285 None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:47.205266 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d31c1b-cdd7-4e14-8d03-972bfeb29285 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:47.205541 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d31c1b-cdd7-4e14-8d03-972bfeb29285 None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:47.206321 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d31c1b-cdd7-4e14-8d03-972bfeb29285 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:47.207703 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d31c1b-cdd7-4e14-8d03-972bfeb29285 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:47.223266 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 641/1295] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Jun 29 12:11:47 2022] POST /identity/v3/services => generated 246 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:11:49.238403 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59017440-f74e-4224-8fe3-4dfbd2a8c81d None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:49.239305 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59017440-f74e-4224-8fe3-4dfbd2a8c81d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:49.239305 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59017440-f74e-4224-8fe3-4dfbd2a8c81d None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:49.241548 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 655/1296] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:11:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:11:49.250473 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1ff12-1fed-4d1b-9627-a01acfa80221 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:49.251194 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1ff12-1fed-4d1b-9627-a01acfa80221 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:49.251376 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1ff12-1fed-4d1b-9627-a01acfa80221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:49.278721 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-2bf1ff12-1fed-4d1b-9627-a01acfa80221 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:11:49.280505 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-2bf1ff12-1fed-4d1b-9627-a01acfa80221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:11:49.362289 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 642/1297] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:11:49 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 12:11:49.399166 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59017440-f74e-4224-8fe3-4dfbd2a8c81d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:49.533816 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59017440-f74e-4224-8fe3-4dfbd2a8c81d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:49.589573 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0cb80e-e088-4b87-9907-e0e6152d43f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:49.590417 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0cb80e-e088-4b87-9907-e0e6152d43f8 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:49.590691 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0cb80e-e088-4b87-9907-e0e6152d43f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:49.590959 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0cb80e-e088-4b87-9907-e0e6152d43f8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:49.591617 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0cb80e-e088-4b87-9907-e0e6152d43f8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:49.593019 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0cb80e-e088-4b87-9907-e0e6152d43f8 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:49.605586 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-0b0cb80e-e088-4b87-9907-e0e6152d43f8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 12:11:49.605586 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:11:49.605586 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 12:11:49.605586 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 12:11:49.605586 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 12:11:49.605586 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 12:11:49.605586 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 12:11:49.605586 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:11:49.605586 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 12:11:49.605586 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:11:49.605586 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 12:11:49.605586 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:11:49.605586 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:11:49.605586 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:11:49.605586 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:11:49.605586 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:11:49.605586 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:11:49.606770 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:11:49.606770 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:11:49.606770 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:11:49.606770 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:11:49.606770 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:11:49.606770 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:11:49.606770 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 12:11:49.606770 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 12:11:49.606770 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 12:11:49.606770 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 12:11:49.606770 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:11:49.606770 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:11:49.606770 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:11:49.606770 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:11:49.606770 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:11:49.606770 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:11:49.607684 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:11:49.607684 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:11:49.607684 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:11:49.607684 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:11:49.607684 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:11:49.607684 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:11:49.607684 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:11:49.607684 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:11:49.607684 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:11:49.607684 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:11:49.607684 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 12:11:49.607684 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:11:49.607684 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 12:11:49.607684 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:11:49.607684 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 656/1298] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Jun 29 12:11:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:11:49.615071 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf1ff12-1fed-4d1b-9627-a01acfa80221 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:49.634506 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:49.733584 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf1ff12-1fed-4d1b-9627-a01acfa80221 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:49.769114 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed8f542-cad7-4140-93d9-ff2b52a05f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:49.769801 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed8f542-cad7-4140-93d9-ff2b52a05f0d None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:49.770081 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed8f542-cad7-4140-93d9-ff2b52a05f0d None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:49.770351 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed8f542-cad7-4140-93d9-ff2b52a05f0d None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:49.771066 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed8f542-cad7-4140-93d9-ff2b52a05f0d None admin] RBAC: Adding query filter params (name=placement) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:11:49.771365 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed8f542-cad7-4140-93d9-ff2b52a05f0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:49.772829 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed8f542-cad7-4140-93d9-ff2b52a05f0d None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:49.778368 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 643/1299] 10.222.0.27 () {56 vars in 1116 bytes} [Wed Jun 29 12:11:49 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:11:49.788146 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0cb80e-e088-4b87-9907-e0e6152d43f8 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:49.824286 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:49.898697 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0cb80e-e088-4b87-9907-e0e6152d43f8 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:49.931488 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc2cff-0a43-4fd1-b510-21a78c92c581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:49.932142 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc2cff-0a43-4fd1-b510-21a78c92c581 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:49.932425 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc2cff-0a43-4fd1-b510-21a78c92c581 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:49.932700 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc2cff-0a43-4fd1-b510-21a78c92c581 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:49.933488 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc2cff-0a43-4fd1-b510-21a78c92c581 None admin] RBAC: Adding query filter params (interface=public, service_id=0f3158f17cdf407983ca489e2c44b026, region_id=RegionOne) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:11:49.933824 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc2cff-0a43-4fd1-b510-21a78c92c581 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:49.935217 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc2cff-0a43-4fd1-b510-21a78c92c581 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:49.940114 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 657/1300] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Jun 29 12:11:49 2022] GET /identity/v3/endpoints?service_id=0f3158f17cdf407983ca489e2c44b026&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:11:49.946200 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed8f542-cad7-4140-93d9-ff2b52a05f0d None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:50.033116 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:50.054377 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed8f542-cad7-4140-93d9-ff2b52a05f0d None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:50.090384 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1529b67-f38e-4b33-bbc0-bf9cdf0b1fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:50.091034 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1529b67-f38e-4b33-bbc0-bf9cdf0b1fd8 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:50.091313 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1529b67-f38e-4b33-bbc0-bf9cdf0b1fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:50.091579 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1529b67-f38e-4b33-bbc0-bf9cdf0b1fd8 None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:50.092257 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1529b67-f38e-4b33-bbc0-bf9cdf0b1fd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:50.093634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1529b67-f38e-4b33-bbc0-bf9cdf0b1fd8 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:50.101069 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 644/1301] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Jun 29 12:11:49 2022] GET /identity/v3/services => generated 2191 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:11:52.153211 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab1152-f741-4251-b3af-20ee0c8ac2c8 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:52.153816 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab1152-f741-4251-b3af-20ee0c8ac2c8 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:52.153816 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab1152-f741-4251-b3af-20ee0c8ac2c8 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:52.155977 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 658/1302] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:11:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:11:52.164502 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56bfb1-5c24-4cb9-b24e-d21bddc4da37 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:52.164973 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56bfb1-5c24-4cb9-b24e-d21bddc4da37 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:52.165078 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56bfb1-5c24-4cb9-b24e-d21bddc4da37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:52.184326 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-ac56bfb1-5c24-4cb9-b24e-d21bddc4da37 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:11:52.185489 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ac56bfb1-5c24-4cb9-b24e-d21bddc4da37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:11:52.278718 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 645/1303] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:11:52 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 12:11:52.307158 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab1152-f741-4251-b3af-20ee0c8ac2c8 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:52.414383 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:52.422637 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab1152-f741-4251-b3af-20ee0c8ac2c8 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:52.457733 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b86292-04a0-4dbf-9554-0c404575e4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:52.458543 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b86292-04a0-4dbf-9554-0c404575e4ba None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:52.458819 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b86292-04a0-4dbf-9554-0c404575e4ba None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:52.459091 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b86292-04a0-4dbf-9554-0c404575e4ba None admin] PATH_INFO: `/v3/services/placement` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:52.459735 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b86292-04a0-4dbf-9554-0c404575e4ba None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:52.461206 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b86292-04a0-4dbf-9554-0c404575e4ba None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:52.473062 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-c8b86292-04a0-4dbf-9554-0c404575e4ba None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 12:11:52.473062 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:11:52.473062 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 12:11:52.473062 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 12:11:52.473062 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 12:11:52.473062 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 12:11:52.473062 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 12:11:52.473062 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:11:52.473062 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 12:11:52.473062 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:11:52.473062 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 12:11:52.473062 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:11:52.473062 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 12:11:52.473062 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 12:11:52.473062 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 12:11:52.473062 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 12:11:52.473062 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 12:11:52.474212 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 12:11:52.474212 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 12:11:52.474212 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 12:11:52.474212 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 12:11:52.474212 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 12:11:52.474212 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 12:11:52.474212 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 12:11:52.474212 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 12:11:52.474212 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 12:11:52.474212 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 12:11:52.474212 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 12:11:52.474212 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 12:11:52.474212 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 12:11:52.474212 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 12:11:52.474212 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 12:11:52.474212 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 12:11:52.475294 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 12:11:52.475294 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jun 29 12:11:52.475294 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 12:11:52.475294 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jun 29 12:11:52.475294 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 12:11:52.475294 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 12:11:52.475294 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 12:11:52.475294 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jun 29 12:11:52.475294 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 12:11:52.475294 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jun 29 12:11:52.475294 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 12:11:52.475294 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 12:11:52.475294 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 12:11:52.475294 dv-cinder-797608-38-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jun 29 12:11:52.475294 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 659/1304] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Jun 29 12:11:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 12:11:52.480870 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac56bfb1-5c24-4cb9-b24e-d21bddc4da37 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:52.558833 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:11:52.585863 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac56bfb1-5c24-4cb9-b24e-d21bddc4da37 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:52.622640 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f8091e-1c53-4d78-bd7b-7ae3a04ecfc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:52.623314 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8091e-1c53-4d78-bd7b-7ae3a04ecfc2 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:52.623588 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8091e-1c53-4d78-bd7b-7ae3a04ecfc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:52.623856 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8091e-1c53-4d78-bd7b-7ae3a04ecfc2 None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:52.624569 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f8091e-1c53-4d78-bd7b-7ae3a04ecfc2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:11:52.624960 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f8091e-1c53-4d78-bd7b-7ae3a04ecfc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:52.626499 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f8091e-1c53-4d78-bd7b-7ae3a04ecfc2 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:52.632536 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 646/1305] 10.222.0.27 () {56 vars in 1116 bytes} [Wed Jun 29 12:11:52 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:11:52.638781 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b86292-04a0-4dbf-9554-0c404575e4ba None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:11:52.751684 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b86292-04a0-4dbf-9554-0c404575e4ba None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:11:52.786723 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce765a55-bfff-4e5b-9d42-1ce1b9bd4751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:11:52.787377 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce765a55-bfff-4e5b-9d42-1ce1b9bd4751 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:11:52.787659 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce765a55-bfff-4e5b-9d42-1ce1b9bd4751 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:11:52.787933 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce765a55-bfff-4e5b-9d42-1ce1b9bd4751 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:11:52.788959 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce765a55-bfff-4e5b-9d42-1ce1b9bd4751 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:11:52.790321 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce765a55-bfff-4e5b-9d42-1ce1b9bd4751 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:11:52.811343 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 660/1306] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Jun 29 12:11:52 2022] POST /identity/v3/endpoints => generated 331 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:12:02.629158 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=30 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:12:02.806985 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:12:57.022109 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767bcbbc-8ae1-4aa0-b5b9-ea5699ba299f None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:12:57.022771 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767bcbbc-8ae1-4aa0-b5b9-ea5699ba299f None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:12:57.023440 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767bcbbc-8ae1-4aa0-b5b9-ea5699ba299f None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:12:57.033746 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ff9db-9edc-4f02-9b85-71454b012504 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:12:57.033746 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ff9db-9edc-4f02-9b85-71454b012504 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:12:57.033746 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ff9db-9edc-4f02-9b85-71454b012504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:12:57.034654 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 647/1307] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:12:57 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:12:57.192588 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f09ff9db-9edc-4f02-9b85-71454b012504 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:12:57.196151 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f09ff9db-9edc-4f02-9b85-71454b012504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:12:57.417730 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 661/1308] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:12:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:12:57.458950 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af4cfb-3382-4315-be03-bc1e754cc061 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:12:57.459759 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af4cfb-3382-4315-be03-bc1e754cc061 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:12:57.460603 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af4cfb-3382-4315-be03-bc1e754cc061 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:12:57.462639 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 648/1309] 10.222.0.27 () {54 vars in 964 bytes} [Wed Jun 29 12:12:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:12:57.468378 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c4f23-bbeb-45aa-9dd7-d7f414a6db60 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:12:57.468681 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c4f23-bbeb-45aa-9dd7-d7f414a6db60 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:12:57.468964 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c4f23-bbeb-45aa-9dd7-d7f414a6db60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:12:57.555138 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-1d3c4f23-bbeb-45aa-9dd7-d7f414a6db60 None None] MFA Rules not processed for user `e94618bb382d46f7aaa2ef8f5d690bf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:12:57.556910 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1d3c4f23-bbeb-45aa-9dd7-d7f414a6db60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:12:57.580413 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:12:57.646172 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 662/1310] 10.222.0.27 () {58 vars in 1061 bytes} [Wed Jun 29 12:12:57 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:12:57.655018 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af4cfb-3382-4315-be03-bc1e754cc061 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:12:57.657142 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-41af4cfb-3382-4315-be03-bc1e754cc061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:12:57.775671 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af4cfb-3382-4315-be03-bc1e754cc061 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:12:57.862461 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fee64f-348c-4a12-9972-8a573d69bfe7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:12:57.863132 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fee64f-348c-4a12-9972-8a573d69bfe7 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:12:57.863417 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fee64f-348c-4a12-9972-8a573d69bfe7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:12:57.863691 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fee64f-348c-4a12-9972-8a573d69bfe7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:12:57.865400 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-d3fee64f-348c-4a12-9972-8a573d69bfe7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:12:57.930574 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:12:57.992843 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fee64f-348c-4a12-9972-8a573d69bfe7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:12:57.994479 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fee64f-348c-4a12-9972-8a573d69bfe7 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:12:58.034253 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 649/1311] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:12:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:13:00.332882 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf6ec7-c28b-4e9a-befa-1216df6df1f6 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:00.333486 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf6ec7-c28b-4e9a-befa-1216df6df1f6 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:00.333486 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf6ec7-c28b-4e9a-befa-1216df6df1f6 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:00.336993 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 663/1312] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:13:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:13:00.340779 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3081961d-736b-49b9-8053-6afec08f8e3a None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:00.341340 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3081961d-736b-49b9-8053-6afec08f8e3a None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:00.341340 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3081961d-736b-49b9-8053-6afec08f8e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:00.420467 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-3081961d-736b-49b9-8053-6afec08f8e3a None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:13:00.421736 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-3081961d-736b-49b9-8053-6afec08f8e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:00.528129 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 650/1313] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:13:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:13:00.581327 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32bdbb9-abec-4147-9b93-dfc38136aa99 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:00.581593 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32bdbb9-abec-4147-9b93-dfc38136aa99 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:00.581921 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32bdbb9-abec-4147-9b93-dfc38136aa99 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:00.583415 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 664/1314] 10.222.0.27 () {54 vars in 964 bytes} [Wed Jun 29 12:13:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:13:00.589474 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92413721-6851-4c62-92fb-b42cbede4980 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:00.589793 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92413721-6851-4c62-92fb-b42cbede4980 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:00.590093 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92413721-6851-4c62-92fb-b42cbede4980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:00.600937 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:13:00.671313 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-92413721-6851-4c62-92fb-b42cbede4980 None None] MFA Rules not processed for user `e94618bb382d46f7aaa2ef8f5d690bf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:13:00.672519 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-92413721-6851-4c62-92fb-b42cbede4980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:00.753916 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 651/1315] 10.222.0.27 () {58 vars in 1061 bytes} [Wed Jun 29 12:13:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:13:00.763867 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32bdbb9-abec-4147-9b93-dfc38136aa99 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:13:00.765736 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c32bdbb9-abec-4147-9b93-dfc38136aa99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:00.881638 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32bdbb9-abec-4147-9b93-dfc38136aa99 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:13:00.961566 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:13:00.964553 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0800c1-f778-499f-b5c9-4e2c9767b95f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:13:00.965206 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0800c1-f778-499f-b5c9-4e2c9767b95f service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:00.965489 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0800c1-f778-499f-b5c9-4e2c9767b95f service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:00.965794 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0800c1-f778-499f-b5c9-4e2c9767b95f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:00.968182 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ca0800c1-f778-499f-b5c9-4e2c9767b95f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:01.095550 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0800c1-f778-499f-b5c9-4e2c9767b95f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:13:01.097018 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0800c1-f778-499f-b5c9-4e2c9767b95f service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:13:01.116142 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 665/1316] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:13:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:13:03.680217 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109806c-f213-4813-9332-4cd195f7d3cc None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:03.680818 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109806c-f213-4813-9332-4cd195f7d3cc None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:03.680818 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109806c-f213-4813-9332-4cd195f7d3cc None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:03.682221 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 652/1317] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:13:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:13:03.688561 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f1aa9-f5f8-44cb-8529-8d4ea27ed6aa None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:03.689257 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f1aa9-f5f8-44cb-8529-8d4ea27ed6aa None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:03.689579 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f1aa9-f5f8-44cb-8529-8d4ea27ed6aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:03.766547 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-025f1aa9-f5f8-44cb-8529-8d4ea27ed6aa None None] MFA Rules not processed for user `444fe6680fcc4d189dc9e38aeebd3b11`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:13:03.767745 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-025f1aa9-f5f8-44cb-8529-8d4ea27ed6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:03.824053 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:13:03.873024 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 666/1318] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:13:03 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:13:03.916445 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109806c-f213-4813-9332-4cd195f7d3cc None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:13:03.918951 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-8109806c-f213-4813-9332-4cd195f7d3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:04.040425 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109806c-f213-4813-9332-4cd195f7d3cc None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:13:04.043244 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:13:04.118280 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed92a0c1-63e4-468b-9c68-c8da41483cb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:13:04.118941 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92a0c1-63e4-468b-9c68-c8da41483cb6 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:04.119215 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92a0c1-63e4-468b-9c68-c8da41483cb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:04.119484 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92a0c1-63e4-468b-9c68-c8da41483cb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:04.121128 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ed92a0c1-63e4-468b-9c68-c8da41483cb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:04.239959 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed92a0c1-63e4-468b-9c68-c8da41483cb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:13:04.241481 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed92a0c1-63e4-468b-9c68-c8da41483cb6 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:13:04.260296 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 653/1319] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:13:03 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:13:06.812617 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37080207-474d-4bf6-973a-d9d8c61bad31 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:06.813196 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37080207-474d-4bf6-973a-d9d8c61bad31 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:06.813447 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37080207-474d-4bf6-973a-d9d8c61bad31 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:06.814930 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 667/1320] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:13:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:13:06.821035 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981dd86-9f08-4e10-84ac-1923d793fc43 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:06.821487 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981dd86-9f08-4e10-84ac-1923d793fc43 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:06.821677 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981dd86-9f08-4e10-84ac-1923d793fc43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:06.863135 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:13:06.889730 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-2981dd86-9f08-4e10-84ac-1923d793fc43 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:13:06.890934 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-2981dd86-9f08-4e10-84ac-1923d793fc43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:06.992967 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 654/1321] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:13:06 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:13:07.033161 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37080207-474d-4bf6-973a-d9d8c61bad31 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:13:07.035509 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-37080207-474d-4bf6-973a-d9d8c61bad31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:07.153526 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37080207-474d-4bf6-973a-d9d8c61bad31 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:13:07.234437 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd037e57-c105-4288-8bf0-7ecc7c179e2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:13:07.235125 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd037e57-c105-4288-8bf0-7ecc7c179e2e service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:07.235411 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd037e57-c105-4288-8bf0-7ecc7c179e2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:07.235690 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd037e57-c105-4288-8bf0-7ecc7c179e2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:07.237363 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-fd037e57-c105-4288-8bf0-7ecc7c179e2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:07.245382 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:13:07.355541 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd037e57-c105-4288-8bf0-7ecc7c179e2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:13:07.356983 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd037e57-c105-4288-8bf0-7ecc7c179e2e service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:13:07.378761 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 668/1322] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:13:07 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:13:10.124761 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff720c96-5ef3-489e-ac0b-fbe8efd17394 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:10.125384 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff720c96-5ef3-489e-ac0b-fbe8efd17394 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:10.125384 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff720c96-5ef3-489e-ac0b-fbe8efd17394 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:10.126742 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 655/1323] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:13:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:13:10.132047 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c09bf-8d9f-47dd-80e4-084ec7179ca5 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:10.132500 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c09bf-8d9f-47dd-80e4-084ec7179ca5 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:10.132603 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c09bf-8d9f-47dd-80e4-084ec7179ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:10.202358 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-002c09bf-8d9f-47dd-80e4-084ec7179ca5 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:13:10.203594 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-002c09bf-8d9f-47dd-80e4-084ec7179ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:10.268293 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:13:10.316050 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 669/1324] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:13:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:13:10.353494 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff720c96-5ef3-489e-ac0b-fbe8efd17394 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:13:10.355173 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ff720c96-5ef3-489e-ac0b-fbe8efd17394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:10.475541 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff720c96-5ef3-489e-ac0b-fbe8efd17394 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:13:10.489506 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:13:10.558825 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44062f9d-3d57-4dfb-82f7-5d0459fbe175 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:13:10.559487 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44062f9d-3d57-4dfb-82f7-5d0459fbe175 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:10.559765 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44062f9d-3d57-4dfb-82f7-5d0459fbe175 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:10.560034 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44062f9d-3d57-4dfb-82f7-5d0459fbe175 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:10.561684 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-44062f9d-3d57-4dfb-82f7-5d0459fbe175 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:10.675452 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44062f9d-3d57-4dfb-82f7-5d0459fbe175 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:13:10.676827 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44062f9d-3d57-4dfb-82f7-5d0459fbe175 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:13:10.696490 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 656/1325] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:13:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:13:12.764916 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914213e9-b151-4fa6-860c-9d0f8578d8df None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:12.765451 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914213e9-b151-4fa6-860c-9d0f8578d8df None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:12.765451 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914213e9-b151-4fa6-860c-9d0f8578d8df None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:12.766902 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 670/1326] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:13:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:13:12.772377 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8e1dc-af2a-4b7e-bab5-5e504548c0e6 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:12.772828 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8e1dc-af2a-4b7e-bab5-5e504548c0e6 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:12.772828 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8e1dc-af2a-4b7e-bab5-5e504548c0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:12.821361 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:13:12.840575 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-2fc8e1dc-af2a-4b7e-bab5-5e504548c0e6 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:13:12.841797 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-2fc8e1dc-af2a-4b7e-bab5-5e504548c0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:12.943775 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 657/1327] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:13:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:13:12.979327 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914213e9-b151-4fa6-860c-9d0f8578d8df None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:13:12.980862 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-914213e9-b151-4fa6-860c-9d0f8578d8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:13.090973 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914213e9-b151-4fa6-860c-9d0f8578d8df None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:13:13.169524 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75584b88-3344-4650-ac82-2ecf9bfcf5fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:13:13.170253 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75584b88-3344-4650-ac82-2ecf9bfcf5fc service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:13.170537 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75584b88-3344-4650-ac82-2ecf9bfcf5fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:13.170812 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75584b88-3344-4650-ac82-2ecf9bfcf5fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:13.172668 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-75584b88-3344-4650-ac82-2ecf9bfcf5fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:13.192447 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:13:13.293727 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75584b88-3344-4650-ac82-2ecf9bfcf5fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:13:13.295354 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75584b88-3344-4650-ac82-2ecf9bfcf5fc service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:13:13.317059 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 671/1328] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:13:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:13:15.397179 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd97ae-af7d-4e78-80f5-9e6ef196cba8 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:15.397887 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd97ae-af7d-4e78-80f5-9e6ef196cba8 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:15.397996 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd97ae-af7d-4e78-80f5-9e6ef196cba8 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:15.399407 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 658/1329] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:13:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:13:15.404861 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da57e4f-c9a3-475e-b2af-e7d978194f64 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:15.405321 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da57e4f-c9a3-475e-b2af-e7d978194f64 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:15.405429 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da57e4f-c9a3-475e-b2af-e7d978194f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:15.475816 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-5da57e4f-c9a3-475e-b2af-e7d978194f64 None None] MFA Rules not processed for user `444fe6680fcc4d189dc9e38aeebd3b11`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:13:15.477048 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5da57e4f-c9a3-475e-b2af-e7d978194f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:15.547166 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:13:15.584730 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 672/1330] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:13:15 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:13:15.623301 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd97ae-af7d-4e78-80f5-9e6ef196cba8 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:13:15.624931 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-dcfd97ae-af7d-4e78-80f5-9e6ef196cba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:15.736114 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd97ae-af7d-4e78-80f5-9e6ef196cba8 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:13:15.757632 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:13:15.820944 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e9e68-f3f8-45e8-b657-1ca205da795f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:13:15.821597 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e9e68-f3f8-45e8-b657-1ca205da795f service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:15.821906 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e9e68-f3f8-45e8-b657-1ca205da795f service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:15.822178 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e9e68-f3f8-45e8-b657-1ca205da795f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:15.823834 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-4e6e9e68-f3f8-45e8-b657-1ca205da795f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:15.937036 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6e9e68-f3f8-45e8-b657-1ca205da795f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:13:15.938528 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6e9e68-f3f8-45e8-b657-1ca205da795f service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:13:15.958037 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 659/1331] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:13:15 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:13:18.454935 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e17ccf-8b0e-493a-bd10-3a1e7be626c1 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:18.455919 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e17ccf-8b0e-493a-bd10-3a1e7be626c1 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:18.455919 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e17ccf-8b0e-493a-bd10-3a1e7be626c1 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:18.458194 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 673/1332] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:13:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:13:18.467260 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49de2e-814d-4abd-b6b1-9a3f49025daa None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:18.467987 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49de2e-814d-4abd-b6b1-9a3f49025daa None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:18.468191 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49de2e-814d-4abd-b6b1-9a3f49025daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:18.547500 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:13:18.550960 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-1a49de2e-814d-4abd-b6b1-9a3f49025daa None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:13:18.552711 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-1a49de2e-814d-4abd-b6b1-9a3f49025daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:18.660892 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 660/1333] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:13:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:13:18.700278 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e17ccf-8b0e-493a-bd10-3a1e7be626c1 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:13:18.702552 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-03e17ccf-8b0e-493a-bd10-3a1e7be626c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:18.817982 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e17ccf-8b0e-493a-bd10-3a1e7be626c1 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:13:18.899079 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3770c8a6-ea11-4a5d-abc3-bc1a381db45d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:13:18.899717 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770c8a6-ea11-4a5d-abc3-bc1a381db45d service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:18.899991 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770c8a6-ea11-4a5d-abc3-bc1a381db45d service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:18.900278 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770c8a6-ea11-4a5d-abc3-bc1a381db45d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:18.901938 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3770c8a6-ea11-4a5d-abc3-bc1a381db45d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:18.931173 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:13:19.031138 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3770c8a6-ea11-4a5d-abc3-bc1a381db45d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:13:19.032562 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3770c8a6-ea11-4a5d-abc3-bc1a381db45d service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:13:19.053339 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 674/1334] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:13:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:13:21.123688 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310d435-698e-45ea-8be8-8a877403a3b9 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:21.124242 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310d435-698e-45ea-8be8-8a877403a3b9 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:21.124242 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310d435-698e-45ea-8be8-8a877403a3b9 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:21.125647 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 661/1335] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:13:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:13:21.131149 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee211ed8-361d-4627-ae2e-9e7f8d48591f None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:21.131586 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee211ed8-361d-4627-ae2e-9e7f8d48591f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:21.131768 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee211ed8-361d-4627-ae2e-9e7f8d48591f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:21.214649 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-ee211ed8-361d-4627-ae2e-9e7f8d48591f None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:13:21.215865 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ee211ed8-361d-4627-ae2e-9e7f8d48591f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:21.296516 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:13:21.327599 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 675/1336] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:13:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:13:21.371532 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6310d435-698e-45ea-8be8-8a877403a3b9 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:13:21.374067 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-6310d435-698e-45ea-8be8-8a877403a3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:21.490807 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6310d435-698e-45ea-8be8-8a877403a3b9 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:13:21.524359 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:13:21.576239 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d9c6c8-3b49-4320-b527-840c3cac3352 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:13:21.576885 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9c6c8-3b49-4320-b527-840c3cac3352 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:21.577161 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9c6c8-3b49-4320-b527-840c3cac3352 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:21.577430 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9c6c8-3b49-4320-b527-840c3cac3352 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:21.579190 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-89d9c6c8-3b49-4320-b527-840c3cac3352 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:21.696387 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d9c6c8-3b49-4320-b527-840c3cac3352 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:13:21.697913 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d9c6c8-3b49-4320-b527-840c3cac3352 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:13:21.717788 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 662/1337] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:13:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:13:24.077767 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d85bc8-c3b6-4f36-9f38-9832cea6f42c None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:24.078495 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d85bc8-c3b6-4f36-9f38-9832cea6f42c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:24.078729 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d85bc8-c3b6-4f36-9f38-9832cea6f42c None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:24.080974 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 676/1338] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:13:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:13:24.086772 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec50d4f-20df-499b-97ea-e2afcebf7f2e None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:24.087234 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec50d4f-20df-499b-97ea-e2afcebf7f2e None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:24.087337 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec50d4f-20df-499b-97ea-e2afcebf7f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:24.159315 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-7ec50d4f-20df-499b-97ea-e2afcebf7f2e None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:13:24.160523 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-7ec50d4f-20df-499b-97ea-e2afcebf7f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:24.170361 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:13:24.272215 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 663/1339] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:13:24 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:13:24.311769 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d85bc8-c3b6-4f36-9f38-9832cea6f42c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:13:24.314270 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d9d85bc8-c3b6-4f36-9f38-9832cea6f42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:24.440005 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d85bc8-c3b6-4f36-9f38-9832cea6f42c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:13:24.526503 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af5ef1-9a31-41aa-91ad-eab8229820b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:13:24.527157 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af5ef1-9a31-41aa-91ad-eab8229820b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:24.527436 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af5ef1-9a31-41aa-91ad-eab8229820b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:24.527709 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af5ef1-9a31-41aa-91ad-eab8229820b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:24.529361 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-49af5ef1-9a31-41aa-91ad-eab8229820b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:24.566812 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:13:24.643057 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49af5ef1-9a31-41aa-91ad-eab8229820b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:13:24.644522 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49af5ef1-9a31-41aa-91ad-eab8229820b0 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:13:24.664500 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 677/1340] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:13:24 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:13:28.697715 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3f6b4-2c54-4e24-b2b7-7bcc31368265 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:28.698282 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3f6b4-2c54-4e24-b2b7-7bcc31368265 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:28.698282 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3f6b4-2c54-4e24-b2b7-7bcc31368265 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:28.699682 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 664/1341] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:13:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:13:28.705385 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ecd49-f730-4640-af5b-0ed9ead6da30 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:28.705862 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ecd49-f730-4640-af5b-0ed9ead6da30 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:28.706292 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ecd49-f730-4640-af5b-0ed9ead6da30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:28.782161 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-911ecd49-f730-4640-af5b-0ed9ead6da30 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:13:28.783358 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-911ecd49-f730-4640-af5b-0ed9ead6da30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:28.883237 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:13:28.897278 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 678/1342] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:13:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:13:28.936811 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa3f6b4-2c54-4e24-b2b7-7bcc31368265 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:13:28.939182 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-faa3f6b4-2c54-4e24-b2b7-7bcc31368265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:29.037901 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa3f6b4-2c54-4e24-b2b7-7bcc31368265 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:13:29.041545 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c5e1af-fc89-4164-aaca-dedf35ddb039 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:13:29.042235 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5e1af-fc89-4164-aaca-dedf35ddb039 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:29.042516 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5e1af-fc89-4164-aaca-dedf35ddb039 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:29.042793 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5e1af-fc89-4164-aaca-dedf35ddb039 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:29.056740 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c5e1af-fc89-4164-aaca-dedf35ddb039 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:13:29.058248 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c5e1af-fc89-4164-aaca-dedf35ddb039 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:13:29.068409 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 665/1343] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:13:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:13:31.813799 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d2eb8-dffd-4625-87c9-d895db2158c9 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:31.814362 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d2eb8-dffd-4625-87c9-d895db2158c9 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:31.814362 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d2eb8-dffd-4625-87c9-d895db2158c9 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:31.815828 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 679/1344] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:13:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:13:31.821998 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376220c7-7c23-4566-b908-8a718ad71210 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:31.822507 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376220c7-7c23-4566-b908-8a718ad71210 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:31.822701 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376220c7-7c23-4566-b908-8a718ad71210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:31.852796 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-376220c7-7c23-4566-b908-8a718ad71210 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:13:31.854021 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-376220c7-7c23-4566-b908-8a718ad71210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:31.884946 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:13:31.947698 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 666/1345] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:13:31 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:13:31.986296 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d2eb8-dffd-4625-87c9-d895db2158c9 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:13:31.988457 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a87d2eb8-dffd-4625-87c9-d895db2158c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:32.004169 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d2eb8-dffd-4625-87c9-d895db2158c9 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:13:32.008510 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a0958f-0195-4c02-bd43-8f1808f49cf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:13:32.009182 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0958f-0195-4c02-bd43-8f1808f49cf3 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:32.009473 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0958f-0195-4c02-bd43-8f1808f49cf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:32.009748 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0958f-0195-4c02-bd43-8f1808f49cf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:32.020531 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a0958f-0195-4c02-bd43-8f1808f49cf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:13:32.022198 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a0958f-0195-4c02-bd43-8f1808f49cf3 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:13:32.033099 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 680/1346] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:13:31 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:13:36.445874 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb0b485-4f2b-4749-bc1b-2a4398ec5319 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:36.446451 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb0b485-4f2b-4749-bc1b-2a4398ec5319 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:36.446549 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb0b485-4f2b-4749-bc1b-2a4398ec5319 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:36.448030 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 667/1347] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:13:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:13:36.453406 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b30d42-77fe-4080-873a-e0f97bb896af None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:36.453870 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b30d42-77fe-4080-873a-e0f97bb896af None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:36.454100 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b30d42-77fe-4080-873a-e0f97bb896af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:36.472530 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-b9b30d42-77fe-4080-873a-e0f97bb896af None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:13:36.473765 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b9b30d42-77fe-4080-873a-e0f97bb896af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:36.481981 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 681/1348] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:13:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:13:36.520191 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb0b485-4f2b-4749-bc1b-2a4398ec5319 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:13:36.531155 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb0b485-4f2b-4749-bc1b-2a4398ec5319 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:13:36.534881 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e1964e-c6bc-454f-a947-2b2854759172 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:13:36.535518 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1964e-c6bc-454f-a947-2b2854759172 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:36.535786 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1964e-c6bc-454f-a947-2b2854759172 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:36.536047 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1964e-c6bc-454f-a947-2b2854759172 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:36.545499 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e1964e-c6bc-454f-a947-2b2854759172 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:13:36.546971 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e1964e-c6bc-454f-a947-2b2854759172 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:13:36.556957 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 668/1349] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:13:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:13:41.503044 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2bfa2-cc33-4aeb-be98-905d08c4e372 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:41.503637 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2bfa2-cc33-4aeb-be98-905d08c4e372 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:41.503637 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2bfa2-cc33-4aeb-be98-905d08c4e372 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:41.505347 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 682/1350] 10.222.0.27 () {54 vars in 921 bytes} [Wed Jun 29 12:13:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:13:41.511261 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54207ead-4afc-4954-9fae-e1668320fe82 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:41.512069 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54207ead-4afc-4954-9fae-e1668320fe82 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:41.512069 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54207ead-4afc-4954-9fae-e1668320fe82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:41.613478 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-54207ead-4afc-4954-9fae-e1668320fe82 None None] MFA Rules not processed for user `286a99b42d9246db909040bf8ab18ea1`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:13:41.615196 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-54207ead-4afc-4954-9fae-e1668320fe82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:41.695116 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 669/1351] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Jun 29 12:13:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:13:46.034255 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4b0ba-2e80-41d3-aae8-ca0e9a9fd132 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:46.034898 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4b0ba-2e80-41d3-aae8-ca0e9a9fd132 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:46.034898 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4b0ba-2e80-41d3-aae8-ca0e9a9fd132 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:46.036485 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 683/1352] 10.222.0.27 () {54 vars in 921 bytes} [Wed Jun 29 12:13:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:13:46.041824 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd01a7-f77a-4742-9a68-b5c6b9295f67 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:46.042328 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd01a7-f77a-4742-9a68-b5c6b9295f67 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:46.042328 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd01a7-f77a-4742-9a68-b5c6b9295f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:46.064948 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-fddd01a7-f77a-4742-9a68-b5c6b9295f67 None None] MFA Rules not processed for user `286a99b42d9246db909040bf8ab18ea1`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:13:46.066441 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-fddd01a7-f77a-4742-9a68-b5c6b9295f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:46.076573 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 670/1353] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Jun 29 12:13:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:13:46.467451 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=13 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:13:47.529357 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ac6c1-e570-44b8-9e57-ccee2b9d28bf None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:47.530061 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ac6c1-e570-44b8-9e57-ccee2b9d28bf None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:47.530061 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ac6c1-e570-44b8-9e57-ccee2b9d28bf None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:47.531373 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 684/1354] 10.222.0.27 () {54 vars in 921 bytes} [Wed Jun 29 12:13:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:13:47.536900 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf81ea1-8bfb-4e1d-8aae-9a38fb66f12e None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:47.537318 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf81ea1-8bfb-4e1d-8aae-9a38fb66f12e None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:47.537894 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf81ea1-8bfb-4e1d-8aae-9a38fb66f12e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:47.557759 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-0cf81ea1-8bfb-4e1d-8aae-9a38fb66f12e None None] MFA Rules not processed for user `286a99b42d9246db909040bf8ab18ea1`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:13:47.559064 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-0cf81ea1-8bfb-4e1d-8aae-9a38fb66f12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:47.568550 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 671/1355] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Jun 29 12:13:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:13:51.132610 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04b4b7-67a9-4279-9601-6469a3324c22 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:51.133163 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04b4b7-67a9-4279-9601-6469a3324c22 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:51.133426 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04b4b7-67a9-4279-9601-6469a3324c22 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:51.135008 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 685/1356] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:13:51.141501 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76397e-cdbf-4c61-b0c3-cc244f29fb05 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:51.142992 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76397e-cdbf-4c61-b0c3-cc244f29fb05 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:51.143554 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76397e-cdbf-4c61-b0c3-cc244f29fb05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:51.165904 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-cb76397e-cdbf-4c61-b0c3-cc244f29fb05 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:13:51.168238 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-cb76397e-cdbf-4c61-b0c3-cc244f29fb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:51.177062 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 672/1357] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:13:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:13:51.242680 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0deff2-74f2-4482-8704-8e2ed7af6f2e None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:51.243067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0deff2-74f2-4482-8704-8e2ed7af6f2e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:51.243417 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0deff2-74f2-4482-8704-8e2ed7af6f2e None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:51.244908 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 686/1358] 10.222.0.27 () {54 vars in 961 bytes} [Wed Jun 29 12:13:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:13:51.254664 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f711c7-b571-4b64-a0cf-8d49db44f6ad None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:51.255598 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f711c7-b571-4b64-a0cf-8d49db44f6ad None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:51.256164 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f711c7-b571-4b64-a0cf-8d49db44f6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:51.308518 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:13:51.319354 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-b1f711c7-b571-4b64-a0cf-8d49db44f6ad None None] MFA Rules not processed for user `7adaa2ef440941aa8214f2b2fd49b54e`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:13:51.320679 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-b1f711c7-b571-4b64-a0cf-8d49db44f6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:51.408392 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 673/1359] 10.222.0.27 () {58 vars in 1058 bytes} [Wed Jun 29 12:13:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:13:51.416760 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0deff2-74f2-4482-8704-8e2ed7af6f2e None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:13:51.434358 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0deff2-74f2-4482-8704-8e2ed7af6f2e None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:13:51.440009 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675a3f0-0fc4-46ab-b681-7721aa6ec5da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7adaa2ef440941aa8214f2b2fd49b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:13:51.440652 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675a3f0-0fc4-46ab-b681-7721aa6ec5da service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:51.440937 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675a3f0-0fc4-46ab-b681-7721aa6ec5da service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:51.441207 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675a3f0-0fc4-46ab-b681-7721aa6ec5da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:51.451379 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c675a3f0-0fc4-46ab-b681-7721aa6ec5da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:13:51.452984 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c675a3f0-0fc4-46ab-b681-7721aa6ec5da service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:13:51.465113 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 687/1360] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:13:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:13:53.719361 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bac629-19ef-42de-9784-d40473e4bbaa None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:53.719756 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bac629-19ef-42de-9784-d40473e4bbaa None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:53.719926 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bac629-19ef-42de-9784-d40473e4bbaa None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:53.721486 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 674/1361] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:13:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:13:53.726797 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d9ef7-3f6a-467b-b2e0-c3d090f45262 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:53.727590 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d9ef7-3f6a-467b-b2e0-c3d090f45262 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:53.728084 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d9ef7-3f6a-467b-b2e0-c3d090f45262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:53.747581 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e21d9ef7-3f6a-467b-b2e0-c3d090f45262 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:13:53.748996 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e21d9ef7-3f6a-467b-b2e0-c3d090f45262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:53.766493 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 688/1362] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:13:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:13:53.803408 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bac629-19ef-42de-9784-d40473e4bbaa None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:13:53.819578 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bac629-19ef-42de-9784-d40473e4bbaa None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:13:53.825436 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe9c4d-3306-4cea-befd-646962621854 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7adaa2ef440941aa8214f2b2fd49b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:13:53.826346 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe9c4d-3306-4cea-befd-646962621854 service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:53.826622 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe9c4d-3306-4cea-befd-646962621854 service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:53.826896 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe9c4d-3306-4cea-befd-646962621854 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:53.837075 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbe9c4d-3306-4cea-befd-646962621854 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:13:53.838733 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbe9c4d-3306-4cea-befd-646962621854 service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:13:53.849940 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 675/1363] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:13:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:13:56.204979 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c976bea-c8f2-4994-80cf-62014a335882 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:56.205457 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c976bea-c8f2-4994-80cf-62014a335882 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:56.205676 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c976bea-c8f2-4994-80cf-62014a335882 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:56.207243 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 689/1364] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:13:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:13:56.213218 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9daeb-2130-4921-98ee-0bef865c311b None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:56.213614 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9daeb-2130-4921-98ee-0bef865c311b None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:56.213794 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9daeb-2130-4921-98ee-0bef865c311b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:56.233170 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-1ba9daeb-2130-4921-98ee-0bef865c311b None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:13:56.234422 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-1ba9daeb-2130-4921-98ee-0bef865c311b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:56.243494 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 676/1365] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:13:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:13:56.295173 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ea8ff-b005-4b59-816b-6ca1bf9c0606 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:56.295552 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ea8ff-b005-4b59-816b-6ca1bf9c0606 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:56.295982 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ea8ff-b005-4b59-816b-6ca1bf9c0606 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:56.298408 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 690/1366] 10.222.0.27 () {54 vars in 961 bytes} [Wed Jun 29 12:13:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:13:56.304194 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d10aa8-a2e6-4aa2-9a55-4ad7462a9b90 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:56.304627 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d10aa8-a2e6-4aa2-9a55-4ad7462a9b90 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:56.304905 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d10aa8-a2e6-4aa2-9a55-4ad7462a9b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:56.331790 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-02d10aa8-a2e6-4aa2-9a55-4ad7462a9b90 None None] MFA Rules not processed for user `7adaa2ef440941aa8214f2b2fd49b54e`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:13:56.333563 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-02d10aa8-a2e6-4aa2-9a55-4ad7462a9b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:56.344171 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 677/1367] 10.222.0.27 () {58 vars in 1058 bytes} [Wed Jun 29 12:13:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:13:56.352465 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ea8ff-b005-4b59-816b-6ca1bf9c0606 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:13:56.368463 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ea8ff-b005-4b59-816b-6ca1bf9c0606 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:13:56.374052 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a953550-a3e9-413d-be2c-6ff126d07b32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7adaa2ef440941aa8214f2b2fd49b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:13:56.374698 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a953550-a3e9-413d-be2c-6ff126d07b32 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:56.374969 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a953550-a3e9-413d-be2c-6ff126d07b32 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:56.375239 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a953550-a3e9-413d-be2c-6ff126d07b32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:56.384055 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a953550-a3e9-413d-be2c-6ff126d07b32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:13:56.385645 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a953550-a3e9-413d-be2c-6ff126d07b32 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:13:56.395153 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 691/1368] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:13:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:13:58.526469 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7277742-1dbf-427f-89bb-ab8e7f030b59 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:58.527078 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7277742-1dbf-427f-89bb-ab8e7f030b59 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:58.527078 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7277742-1dbf-427f-89bb-ab8e7f030b59 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:58.528389 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 678/1369] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:13:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:13:58.533960 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaed207-8fa0-45c8-96cd-d3a97df2722d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:58.534389 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaed207-8fa0-45c8-96cd-d3a97df2722d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:58.534571 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaed207-8fa0-45c8-96cd-d3a97df2722d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:58.553295 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-ecaed207-8fa0-45c8-96cd-d3a97df2722d None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:13:58.554531 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ecaed207-8fa0-45c8-96cd-d3a97df2722d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:58.563080 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 692/1370] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:13:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:13:58.607560 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7277742-1dbf-427f-89bb-ab8e7f030b59 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:13:58.623136 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7277742-1dbf-427f-89bb-ab8e7f030b59 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:13:58.629000 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59f4fec-fa36-42fe-99a2-ae182ea02ff1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7adaa2ef440941aa8214f2b2fd49b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:13:58.630119 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f4fec-fa36-42fe-99a2-ae182ea02ff1 service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:58.630403 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f4fec-fa36-42fe-99a2-ae182ea02ff1 service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:58.630674 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f4fec-fa36-42fe-99a2-ae182ea02ff1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:58.640330 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59f4fec-fa36-42fe-99a2-ae182ea02ff1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:13:58.642002 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59f4fec-fa36-42fe-99a2-ae182ea02ff1 service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:13:58.652914 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 679/1371] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:13:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:13:59.359375 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea80387-afae-4626-a4eb-43c19807b13f None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:59.359677 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea80387-afae-4626-a4eb-43c19807b13f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:59.359881 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea80387-afae-4626-a4eb-43c19807b13f None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:59.361459 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 693/1372] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:13:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:13:59.367600 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9282cd1-de9b-416c-b20d-9a2c145a6f5e None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:59.368199 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9282cd1-de9b-416c-b20d-9a2c145a6f5e None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:59.368437 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9282cd1-de9b-416c-b20d-9a2c145a6f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:59.387185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-e9282cd1-de9b-416c-b20d-9a2c145a6f5e None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:13:59.388797 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e9282cd1-de9b-416c-b20d-9a2c145a6f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:59.397534 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 680/1373] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:13:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:13:59.718735 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11bd283-b8c7-4f80-a467-ea6f9c695d73 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:59.719244 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11bd283-b8c7-4f80-a467-ea6f9c695d73 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:59.719352 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11bd283-b8c7-4f80-a467-ea6f9c695d73 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:59.720913 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 694/1374] 10.222.0.27 () {54 vars in 963 bytes} [Wed Jun 29 12:13:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:13:59.727583 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a2c52-6043-4df3-a4d3-d5942b9deb85 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:59.728070 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a2c52-6043-4df3-a4d3-d5942b9deb85 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:59.728377 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a2c52-6043-4df3-a4d3-d5942b9deb85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:59.784071 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-0b0a2c52-6043-4df3-a4d3-d5942b9deb85 None None] MFA Rules not processed for user `f72f0602e17f4ab4a48e3aaa7022d28d`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:13:59.785771 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-0b0a2c52-6043-4df3-a4d3-d5942b9deb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:13:59.857624 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 681/1375] 10.222.0.27 () {58 vars in 1060 bytes} [Wed Jun 29 12:13:59 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:13:59.866102 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11bd283-b8c7-4f80-a467-ea6f9c695d73 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:13:59.879993 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11bd283-b8c7-4f80-a467-ea6f9c695d73 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:13:59.884541 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0148ffd4-e4c9-4409-a5db-aceab7b9e5b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:13:59.885280 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0148ffd4-e4c9-4409-a5db-aceab7b9e5b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:13:59.885853 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0148ffd4-e4c9-4409-a5db-aceab7b9e5b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:13:59.886360 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0148ffd4-e4c9-4409-a5db-aceab7b9e5b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:13:59.901685 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0148ffd4-e4c9-4409-a5db-aceab7b9e5b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:13:59.904350 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0148ffd4-e4c9-4409-a5db-aceab7b9e5b4 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:13:59.915891 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 695/1376] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:13:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:14:00.730873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ef430-9b70-4098-9eef-49e70408701a None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:00.731756 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ef430-9b70-4098-9eef-49e70408701a None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:00.731756 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ef430-9b70-4098-9eef-49e70408701a None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:00.734182 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 682/1377] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:14:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:14:00.738359 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c254750-a799-4a90-9897-21050405a9e4 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:00.739217 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c254750-a799-4a90-9897-21050405a9e4 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:00.739217 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c254750-a799-4a90-9897-21050405a9e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:00.759206 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-2c254750-a799-4a90-9897-21050405a9e4 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:14:00.760415 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2c254750-a799-4a90-9897-21050405a9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:14:00.769938 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 696/1378] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:14:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:14:00.814171 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ef430-9b70-4098-9eef-49e70408701a None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:14:00.829604 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ef430-9b70-4098-9eef-49e70408701a None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:14:00.836296 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af621c9b-a0ce-43c6-b3fd-5a95a22c28a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7adaa2ef440941aa8214f2b2fd49b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:14:00.836977 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af621c9b-a0ce-43c6-b3fd-5a95a22c28a2 service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:00.837258 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af621c9b-a0ce-43c6-b3fd-5a95a22c28a2 service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:00.837533 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af621c9b-a0ce-43c6-b3fd-5a95a22c28a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:00.846262 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af621c9b-a0ce-43c6-b3fd-5a95a22c28a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:14:00.847851 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af621c9b-a0ce-43c6-b3fd-5a95a22c28a2 service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:14:00.851881 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:14:00.859212 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 683/1379] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:14:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:14:02.936273 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0063d-4073-461c-a9ed-5d283aabfb88 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:02.936822 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0063d-4073-461c-a9ed-5d283aabfb88 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:02.936822 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0063d-4073-461c-a9ed-5d283aabfb88 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:02.938449 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 697/1380] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:14:02.945276 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c0659-1dc0-484a-a035-2a725270366f None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:02.946145 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c0659-1dc0-484a-a035-2a725270366f None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:02.946421 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c0659-1dc0-484a-a035-2a725270366f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:02.978797 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-3b3c0659-1dc0-484a-a035-2a725270366f None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:14:02.980288 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-3b3c0659-1dc0-484a-a035-2a725270366f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:14:03.005604 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 684/1381] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:14:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:14:03.043485 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0063d-4073-461c-a9ed-5d283aabfb88 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:14:03.058756 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0063d-4073-461c-a9ed-5d283aabfb88 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:14:03.064135 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235b487-6807-46f8-85f8-0440e7f3673e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7adaa2ef440941aa8214f2b2fd49b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:14:03.064785 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235b487-6807-46f8-85f8-0440e7f3673e service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:03.065068 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235b487-6807-46f8-85f8-0440e7f3673e service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:03.065366 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235b487-6807-46f8-85f8-0440e7f3673e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:03.074232 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7235b487-6807-46f8-85f8-0440e7f3673e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:14:03.075829 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7235b487-6807-46f8-85f8-0440e7f3673e service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:14:03.085636 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 698/1382] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:14:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:14:05.187814 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3181f18-c7c1-4adf-884e-46a61f161117 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:05.188335 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3181f18-c7c1-4adf-884e-46a61f161117 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:05.188335 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3181f18-c7c1-4adf-884e-46a61f161117 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:05.189971 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 685/1383] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:14:05.195948 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb7d49-38c2-4efe-bf49-2b2c7a74c392 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:05.196368 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb7d49-38c2-4efe-bf49-2b2c7a74c392 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:05.196368 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb7d49-38c2-4efe-bf49-2b2c7a74c392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:05.216297 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-8aeb7d49-38c2-4efe-bf49-2b2c7a74c392 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:14:05.217492 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8aeb7d49-38c2-4efe-bf49-2b2c7a74c392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:14:05.226717 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 699/1384] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:14:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:14:05.268930 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3181f18-c7c1-4adf-884e-46a61f161117 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:14:05.283986 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3181f18-c7c1-4adf-884e-46a61f161117 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:14:05.289903 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9852e12-73fd-4444-ac2c-9614a73284d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7adaa2ef440941aa8214f2b2fd49b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:14:05.290542 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9852e12-73fd-4444-ac2c-9614a73284d2 service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:05.290804 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9852e12-73fd-4444-ac2c-9614a73284d2 service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:05.291089 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9852e12-73fd-4444-ac2c-9614a73284d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:05.299914 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9852e12-73fd-4444-ac2c-9614a73284d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:14:05.301975 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9852e12-73fd-4444-ac2c-9614a73284d2 service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:14:05.312310 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 686/1385] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:14:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:14:07.355970 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5582f-1592-41ee-b088-859de3144d29 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:07.356766 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5582f-1592-41ee-b088-859de3144d29 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:07.356766 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5582f-1592-41ee-b088-859de3144d29 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:07.358186 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 700/1386] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:14:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:14:07.363113 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837bece-8684-40e3-85c0-aaaa1a0c53ae None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:07.363113 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837bece-8684-40e3-85c0-aaaa1a0c53ae None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:07.364177 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837bece-8684-40e3-85c0-aaaa1a0c53ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:07.388640 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-8837bece-8684-40e3-85c0-aaaa1a0c53ae None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:14:07.389856 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-8837bece-8684-40e3-85c0-aaaa1a0c53ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:14:07.398284 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 687/1387] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:14:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:14:07.445187 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf5582f-1592-41ee-b088-859de3144d29 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:14:07.465498 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf5582f-1592-41ee-b088-859de3144d29 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:14:07.471096 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e26da-e0bc-41c9-88c2-78fc6792111c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7adaa2ef440941aa8214f2b2fd49b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:14:07.471752 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e26da-e0bc-41c9-88c2-78fc6792111c service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:07.472037 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e26da-e0bc-41c9-88c2-78fc6792111c service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:07.472316 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e26da-e0bc-41c9-88c2-78fc6792111c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:07.481276 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0e26da-e0bc-41c9-88c2-78fc6792111c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:14:07.482908 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0e26da-e0bc-41c9-88c2-78fc6792111c service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:14:07.492897 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 701/1388] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:14:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:14:09.849149 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6c87c-4ee6-426b-89ed-e249d88cb969 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:09.849917 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6c87c-4ee6-426b-89ed-e249d88cb969 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:09.849917 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6c87c-4ee6-426b-89ed-e249d88cb969 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:09.851250 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 688/1389] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:14:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:14:09.858475 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8699574-0afd-46a9-bd49-b7a3dc17f59f None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:09.858988 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8699574-0afd-46a9-bd49-b7a3dc17f59f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:09.859239 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8699574-0afd-46a9-bd49-b7a3dc17f59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:09.883245 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-a8699574-0afd-46a9-bd49-b7a3dc17f59f None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:14:09.884972 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a8699574-0afd-46a9-bd49-b7a3dc17f59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:14:09.896304 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 702/1390] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:14:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:14:09.945940 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6c87c-4ee6-426b-89ed-e249d88cb969 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:14:09.963028 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6c87c-4ee6-426b-89ed-e249d88cb969 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:14:09.969473 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9982ae0-2bab-42ec-852b-98735681031d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7adaa2ef440941aa8214f2b2fd49b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:14:09.970174 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9982ae0-2bab-42ec-852b-98735681031d service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:09.970452 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9982ae0-2bab-42ec-852b-98735681031d service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:09.970743 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9982ae0-2bab-42ec-852b-98735681031d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:09.980084 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9982ae0-2bab-42ec-852b-98735681031d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:14:09.981717 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9982ae0-2bab-42ec-852b-98735681031d service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:14:09.992262 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 689/1391] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:14:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:14:12.684423 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b454d-fdbf-4d4c-85b2-767814d763af None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:12.685406 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b454d-fdbf-4d4c-85b2-767814d763af None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:12.685709 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b454d-fdbf-4d4c-85b2-767814d763af None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:12.687286 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 703/1392] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:14:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:14:12.693573 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ce4de-e6ff-4a39-aa29-88368647e6a9 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:12.694093 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ce4de-e6ff-4a39-aa29-88368647e6a9 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:12.694183 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ce4de-e6ff-4a39-aa29-88368647e6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:12.713536 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-6d0ce4de-e6ff-4a39-aa29-88368647e6a9 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:14:12.714827 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-6d0ce4de-e6ff-4a39-aa29-88368647e6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:14:12.723246 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 690/1393] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:14:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:14:12.770618 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b454d-fdbf-4d4c-85b2-767814d763af None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:14:12.788561 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b454d-fdbf-4d4c-85b2-767814d763af None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:14:12.794757 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af0cd5c-6289-4dee-8c71-839a367c8c21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7adaa2ef440941aa8214f2b2fd49b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:14:12.795457 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0cd5c-6289-4dee-8c71-839a367c8c21 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:12.795750 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0cd5c-6289-4dee-8c71-839a367c8c21 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:12.796032 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0cd5c-6289-4dee-8c71-839a367c8c21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:12.805353 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af0cd5c-6289-4dee-8c71-839a367c8c21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:14:12.807080 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af0cd5c-6289-4dee-8c71-839a367c8c21 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:14:12.817557 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 704/1394] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:14:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:14:15.126668 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c10e9-d08f-43ce-8689-897f885ec586 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:15.127258 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c10e9-d08f-43ce-8689-897f885ec586 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:15.127258 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c10e9-d08f-43ce-8689-897f885ec586 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:15.128618 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 691/1395] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:14:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:14:15.134041 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60db58-b6d6-458d-9855-eaeec3abb9d4 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:15.134505 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60db58-b6d6-458d-9855-eaeec3abb9d4 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:15.134614 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60db58-b6d6-458d-9855-eaeec3abb9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:15.152556 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-3c60db58-b6d6-458d-9855-eaeec3abb9d4 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:14:15.153883 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3c60db58-b6d6-458d-9855-eaeec3abb9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:14:15.161872 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 705/1396] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:14:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:14:15.206471 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c10e9-d08f-43ce-8689-897f885ec586 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:14:15.222876 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c10e9-d08f-43ce-8689-897f885ec586 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:14:15.228972 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26297efc-999a-40dd-ad73-f3a071b606a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7adaa2ef440941aa8214f2b2fd49b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:14:15.229622 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26297efc-999a-40dd-ad73-f3a071b606a1 service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:15.229948 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26297efc-999a-40dd-ad73-f3a071b606a1 service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:15.230229 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26297efc-999a-40dd-ad73-f3a071b606a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:15.238785 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26297efc-999a-40dd-ad73-f3a071b606a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:14:15.240387 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26297efc-999a-40dd-ad73-f3a071b606a1 service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:14:15.250815 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 692/1397] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:14:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:14:15.877018 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31edb93-298a-4f63-883e-fb631219edde None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:15.877303 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31edb93-298a-4f63-883e-fb631219edde None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:15.877570 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31edb93-298a-4f63-883e-fb631219edde None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:15.878958 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 706/1398] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:14:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:14:15.884792 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76039a6f-80bb-42ac-83ab-1573135951ae None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:15.885083 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76039a6f-80bb-42ac-83ab-1573135951ae None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:15.885358 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76039a6f-80bb-42ac-83ab-1573135951ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:15.904710 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-76039a6f-80bb-42ac-83ab-1573135951ae None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:14:15.905944 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-76039a6f-80bb-42ac-83ab-1573135951ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:14:15.915153 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 693/1399] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:14:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:14:15.971559 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d04f42-ec5b-413b-a6f3-7879cced1e89 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:15.971847 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d04f42-ec5b-413b-a6f3-7879cced1e89 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:15.972121 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d04f42-ec5b-413b-a6f3-7879cced1e89 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:15.973518 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 707/1400] 10.222.0.27 () {54 vars in 962 bytes} [Wed Jun 29 12:14:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:14:15.978723 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b15fa-f08c-46b8-a6a8-8d00c8fc1f25 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:15.979132 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b15fa-f08c-46b8-a6a8-8d00c8fc1f25 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:15.979403 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b15fa-f08c-46b8-a6a8-8d00c8fc1f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:16.035362 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-b49b15fa-f08c-46b8-a6a8-8d00c8fc1f25 None None] MFA Rules not processed for user `d865d1b935a54ca2b44beda5b0277336`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:14:16.036591 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-b49b15fa-f08c-46b8-a6a8-8d00c8fc1f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:14:16.104062 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 694/1401] 10.222.0.27 () {58 vars in 1059 bytes} [Wed Jun 29 12:14:15 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:14:16.112029 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d04f42-ec5b-413b-a6f3-7879cced1e89 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:14:16.124077 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d04f42-ec5b-413b-a6f3-7879cced1e89 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:14:16.128208 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5182b1-1bd5-4e3c-b2f6-9074e27d8bf5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd865d1b935a54ca2b44beda5b0277336', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:14:16.128898 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5182b1-1bd5-4e3c-b2f6-9074e27d8bf5 service glance] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:16.129239 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5182b1-1bd5-4e3c-b2f6-9074e27d8bf5 service glance] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:16.129583 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5182b1-1bd5-4e3c-b2f6-9074e27d8bf5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:16.139914 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5182b1-1bd5-4e3c-b2f6-9074e27d8bf5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:14:16.141386 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5182b1-1bd5-4e3c-b2f6-9074e27d8bf5 service glance] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:14:16.151501 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 708/1402] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:14:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:14:16.902031 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5d711-fa07-4b37-a637-655650d86993 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:16.902560 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5d711-fa07-4b37-a637-655650d86993 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:16.902560 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5d711-fa07-4b37-a637-655650d86993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:16.952465 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-daf5d711-fa07-4b37-a637-655650d86993 None None] MFA Rules not processed for user `cad33601754a462c828566fb54c6e100`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:14:16.953725 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-daf5d711-fa07-4b37-a637-655650d86993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:14:16.994318 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:14:17.020010 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 695/1403] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Jun 29 12:14:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:14:17.061607 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6888e-707f-4432-ba97-2887bbd1cec8 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:17.061940 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6888e-707f-4432-ba97-2887bbd1cec8 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:17.062252 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6888e-707f-4432-ba97-2887bbd1cec8 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:17.063658 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 709/1404] 10.222.0.27 () {54 vars in 942 bytes} [Wed Jun 29 12:14:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:14:17.070653 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e15a0-955f-4db0-b13d-ca990ef7db95 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:17.070983 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e15a0-955f-4db0-b13d-ca990ef7db95 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:17.071327 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e15a0-955f-4db0-b13d-ca990ef7db95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:17.123270 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-5d2e15a0-955f-4db0-b13d-ca990ef7db95 None None] MFA Rules not processed for user `cc92f8232bda407c84365eb10ede737f`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:14:17.124479 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-5d2e15a0-955f-4db0-b13d-ca990ef7db95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:14:17.207310 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 696/1405] 10.222.0.27 () {58 vars in 1039 bytes} [Wed Jun 29 12:14:17 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:14:17.216907 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc6888e-707f-4432-ba97-2887bbd1cec8 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:14:17.224395 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=61 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:14:17.231989 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc6888e-707f-4432-ba97-2887bbd1cec8 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:14:17.236958 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d802d3d6-e716-45e3-9528-611cb5afaea7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc92f8232bda407c84365eb10ede737f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:14:17.237607 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802d3d6-e716-45e3-9528-611cb5afaea7 service swift] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:17.237936 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802d3d6-e716-45e3-9528-611cb5afaea7 service swift] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:17.238199 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802d3d6-e716-45e3-9528-611cb5afaea7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:17.246420 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d802d3d6-e716-45e3-9528-611cb5afaea7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:14:17.248015 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d802d3d6-e716-45e3-9528-611cb5afaea7 service swift] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:14:17.256159 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 710/1406] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Jun 29 12:14:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 12:14:17.311857 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f881b9-3923-4c50-8590-bcba66b4e387 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:17.312142 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f881b9-3923-4c50-8590-bcba66b4e387 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:17.312451 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f881b9-3923-4c50-8590-bcba66b4e387 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:17.313930 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 697/1407] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:14:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:14:17.320089 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c519c6-6709-40fd-9ff0-2ba85262c1af None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:17.320446 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c519c6-6709-40fd-9ff0-2ba85262c1af None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:17.320889 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c519c6-6709-40fd-9ff0-2ba85262c1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:17.339725 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-75c519c6-6709-40fd-9ff0-2ba85262c1af None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:14:17.340960 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-75c519c6-6709-40fd-9ff0-2ba85262c1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:14:17.382613 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 711/1408] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:14:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:14:17.400632 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f881b9-3923-4c50-8590-bcba66b4e387 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:14:17.416224 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f881b9-3923-4c50-8590-bcba66b4e387 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:14:17.422874 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94831a08-950d-4158-8fa2-c8e6a6f0fa07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7adaa2ef440941aa8214f2b2fd49b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:14:17.424008 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94831a08-950d-4158-8fa2-c8e6a6f0fa07 service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:17.424345 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94831a08-950d-4158-8fa2-c8e6a6f0fa07 service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:17.424678 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94831a08-950d-4158-8fa2-c8e6a6f0fa07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:17.434072 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94831a08-950d-4158-8fa2-c8e6a6f0fa07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:14:17.435686 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94831a08-950d-4158-8fa2-c8e6a6f0fa07 service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:14:17.446633 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 698/1409] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:14:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:14:27.335399 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=8 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:14:27.441119 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=59 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:14:39.146475 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89318a2-4c3b-43d9-8323-f288422da419 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:39.147110 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89318a2-4c3b-43d9-8323-f288422da419 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:39.147110 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89318a2-4c3b-43d9-8323-f288422da419 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:39.148462 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 712/1410] 10.222.0.27 () {54 vars in 918 bytes} [Wed Jun 29 12:14:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:14:39.153724 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6740fc38-7f67-4980-85d2-49708ba4e4e3 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:39.154209 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6740fc38-7f67-4980-85d2-49708ba4e4e3 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:39.154316 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6740fc38-7f67-4980-85d2-49708ba4e4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:39.173393 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-6740fc38-7f67-4980-85d2-49708ba4e4e3 None None] MFA Rules not processed for user `286a99b42d9246db909040bf8ab18ea1`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:14:39.174641 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-6740fc38-7f67-4980-85d2-49708ba4e4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:14:39.184272 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 699/1411] 10.222.0.27 () {58 vars in 1015 bytes} [Wed Jun 29 12:14:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:14:39.199323 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d644cb-4373-44c8-86f5-309f8af19af7 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:39.199636 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d644cb-4373-44c8-86f5-309f8af19af7 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:39.199915 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d644cb-4373-44c8-86f5-309f8af19af7 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:39.201371 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 713/1412] 10.222.0.27 () {54 vars in 918 bytes} [Wed Jun 29 12:14:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:14:39.206048 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3c886-0d7f-4dfe-8d7b-5f54f1ebcf82 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:39.206338 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3c886-0d7f-4dfe-8d7b-5f54f1ebcf82 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:39.206612 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3c886-0d7f-4dfe-8d7b-5f54f1ebcf82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:39.225511 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-b2c3c886-0d7f-4dfe-8d7b-5f54f1ebcf82 None None] MFA Rules not processed for user `7adaa2ef440941aa8214f2b2fd49b54e`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:14:39.226757 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-b2c3c886-0d7f-4dfe-8d7b-5f54f1ebcf82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:14:39.236789 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 700/1413] 10.222.0.27 () {58 vars in 1015 bytes} [Wed Jun 29 12:14:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:14:41.775072 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e78a93-739d-4391-9c38-e58c8bec1aff None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:41.775604 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e78a93-739d-4391-9c38-e58c8bec1aff None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:41.775604 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e78a93-739d-4391-9c38-e58c8bec1aff None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:41.777565 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 714/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 12:14:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:14:41.785681 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41bd98-35b0-40ad-82b0-4b3c192281e7 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:41.786164 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41bd98-35b0-40ad-82b0-4b3c192281e7 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:41.786266 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41bd98-35b0-40ad-82b0-4b3c192281e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:41.804759 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-1d41bd98-35b0-40ad-82b0-4b3c192281e7 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:14:41.805995 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-1d41bd98-35b0-40ad-82b0-4b3c192281e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:14:41.814496 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 701/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 12:14:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:14:41.863571 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e78a93-739d-4391-9c38-e58c8bec1aff None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:14:41.883576 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e78a93-739d-4391-9c38-e58c8bec1aff None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:14:41.889522 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c9535-c7f8-4332-9205-c3f8f3393a57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7adaa2ef440941aa8214f2b2fd49b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:14:41.890198 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c9535-c7f8-4332-9205-c3f8f3393a57 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:41.890479 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c9535-c7f8-4332-9205-c3f8f3393a57 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:41.890745 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c9535-c7f8-4332-9205-c3f8f3393a57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:41.899539 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2c9535-c7f8-4332-9205-c3f8f3393a57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:14:41.901133 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2c9535-c7f8-4332-9205-c3f8f3393a57 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:14:41.913068 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 715/1416] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:14:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:14:42.830643 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c6898-7071-4a0d-a551-fc5ef2141cdf None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:42.831136 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c6898-7071-4a0d-a551-fc5ef2141cdf None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:42.831253 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c6898-7071-4a0d-a551-fc5ef2141cdf None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:42.833413 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 702/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 29 12:14:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:14:42.839212 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1aa28b-efd7-47c8-a578-40f461a2ca61 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:42.839679 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1aa28b-efd7-47c8-a578-40f461a2ca61 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:42.839781 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1aa28b-efd7-47c8-a578-40f461a2ca61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:42.858965 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-de1aa28b-efd7-47c8-a578-40f461a2ca61 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:14:42.860251 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-de1aa28b-efd7-47c8-a578-40f461a2ca61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:14:42.869896 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 716/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 29 12:14:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:14:43.028676 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c6898-7071-4a0d-a551-fc5ef2141cdf None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:14:43.052488 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c6898-7071-4a0d-a551-fc5ef2141cdf None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:14:43.059806 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03ca65-3003-4f67-8d43-aab130c24e78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7adaa2ef440941aa8214f2b2fd49b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:14:43.060451 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03ca65-3003-4f67-8d43-aab130c24e78 service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:43.060727 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03ca65-3003-4f67-8d43-aab130c24e78 service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:43.060990 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03ca65-3003-4f67-8d43-aab130c24e78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:43.070851 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b03ca65-3003-4f67-8d43-aab130c24e78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:14:43.072462 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b03ca65-3003-4f67-8d43-aab130c24e78 service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:14:43.082653 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 703/1419] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:14:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:14:43.954309 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ca10c-b6ee-4633-8397-66cfa389ea0d None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:43.955180 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ca10c-b6ee-4633-8397-66cfa389ea0d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:43.955180 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ca10c-b6ee-4633-8397-66cfa389ea0d None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:43.957305 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 717/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 29 12:14:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:14:43.966462 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5249e15-af30-4354-93c7-e321980cda22 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:43.966908 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5249e15-af30-4354-93c7-e321980cda22 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:43.967209 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5249e15-af30-4354-93c7-e321980cda22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:43.992163 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-f5249e15-af30-4354-93c7-e321980cda22 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:14:43.994013 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-f5249e15-af30-4354-93c7-e321980cda22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:14:44.007533 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 704/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 29 12:14:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:14:44.166200 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ca10c-b6ee-4633-8397-66cfa389ea0d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:14:44.182026 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ca10c-b6ee-4633-8397-66cfa389ea0d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:14:44.190368 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0745bb75-dfff-408b-9130-44c6939d6495 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7adaa2ef440941aa8214f2b2fd49b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:14:44.191279 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745bb75-dfff-408b-9130-44c6939d6495 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:44.191591 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745bb75-dfff-408b-9130-44c6939d6495 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:44.191969 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745bb75-dfff-408b-9130-44c6939d6495 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:44.202717 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0745bb75-dfff-408b-9130-44c6939d6495 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:14:44.204289 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0745bb75-dfff-408b-9130-44c6939d6495 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:14:44.214457 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 718/1422] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:14:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:14:45.102152 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1d236-42ec-4214-a502-7833005c7302 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:45.102667 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1d236-42ec-4214-a502-7833005c7302 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:45.102667 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1d236-42ec-4214-a502-7833005c7302 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:45.104106 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 705/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 29 12:14:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:14:45.110423 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab2c3a9-130c-421d-9fc1-78b5b70c2906 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:45.111199 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab2c3a9-130c-421d-9fc1-78b5b70c2906 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:45.111329 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab2c3a9-130c-421d-9fc1-78b5b70c2906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:45.134029 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-4ab2c3a9-130c-421d-9fc1-78b5b70c2906 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:14:45.135240 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4ab2c3a9-130c-421d-9fc1-78b5b70c2906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:14:45.144371 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 719/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 29 12:14:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:14:45.295055 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b1d236-42ec-4214-a502-7833005c7302 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:14:45.315045 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b1d236-42ec-4214-a502-7833005c7302 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:14:45.321399 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94015e2e-bb72-427e-b8d3-730c16855e06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7adaa2ef440941aa8214f2b2fd49b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:14:45.322077 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94015e2e-bb72-427e-b8d3-730c16855e06 service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:45.322356 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94015e2e-bb72-427e-b8d3-730c16855e06 service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:45.322622 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94015e2e-bb72-427e-b8d3-730c16855e06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:45.331436 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94015e2e-bb72-427e-b8d3-730c16855e06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:14:45.333011 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94015e2e-bb72-427e-b8d3-730c16855e06 service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:14:45.342479 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 706/1425] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:14:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:14:46.217270 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d3d46-7424-4a75-badd-0ca8dde32f4d None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:46.217857 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d3d46-7424-4a75-badd-0ca8dde32f4d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:46.217972 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d3d46-7424-4a75-badd-0ca8dde32f4d None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:46.220115 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 720/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 29 12:14:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:14:46.228828 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12351964-1d94-4966-91d1-b9202634d324 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:46.229511 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12351964-1d94-4966-91d1-b9202634d324 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:46.229612 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12351964-1d94-4966-91d1-b9202634d324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:46.258500 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-12351964-1d94-4966-91d1-b9202634d324 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:14:46.259760 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-12351964-1d94-4966-91d1-b9202634d324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:14:46.267612 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 707/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 29 12:14:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:14:46.421984 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d3d46-7424-4a75-badd-0ca8dde32f4d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:14:46.443413 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d3d46-7424-4a75-badd-0ca8dde32f4d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:14:46.450861 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24507e5a-8d90-47ed-9108-35f6bea14a27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7adaa2ef440941aa8214f2b2fd49b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:14:46.451508 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24507e5a-8d90-47ed-9108-35f6bea14a27 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:46.451792 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24507e5a-8d90-47ed-9108-35f6bea14a27 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:46.452069 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24507e5a-8d90-47ed-9108-35f6bea14a27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:46.460647 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24507e5a-8d90-47ed-9108-35f6bea14a27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:14:46.462271 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24507e5a-8d90-47ed-9108-35f6bea14a27 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:14:46.471811 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 721/1428] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:14:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:14:47.292293 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8693be-1c22-41f2-a9b1-3c7395730232 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:47.292895 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8693be-1c22-41f2-a9b1-3c7395730232 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:47.292895 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8693be-1c22-41f2-a9b1-3c7395730232 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:47.295011 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 708/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 29 12:14:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:14:47.303758 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d91b6-4d8f-4e0a-8b42-36fa6dd63442 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:47.304639 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d91b6-4d8f-4e0a-8b42-36fa6dd63442 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:47.304639 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d91b6-4d8f-4e0a-8b42-36fa6dd63442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:47.330528 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-ce6d91b6-4d8f-4e0a-8b42-36fa6dd63442 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:14:47.331735 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ce6d91b6-4d8f-4e0a-8b42-36fa6dd63442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:14:47.341488 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 722/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 29 12:14:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:14:47.495117 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8693be-1c22-41f2-a9b1-3c7395730232 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:14:47.512728 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8693be-1c22-41f2-a9b1-3c7395730232 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:14:47.519967 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84db52-3855-419f-833b-d0f91c21c7c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7adaa2ef440941aa8214f2b2fd49b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:14:47.520612 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84db52-3855-419f-833b-d0f91c21c7c1 service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:47.520898 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84db52-3855-419f-833b-d0f91c21c7c1 service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:47.521171 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84db52-3855-419f-833b-d0f91c21c7c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:47.529887 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f84db52-3855-419f-833b-d0f91c21c7c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:14:47.531519 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f84db52-3855-419f-833b-d0f91c21c7c1 service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:14:47.541054 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 709/1431] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:14:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:14:48.356313 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd9404-fe87-4f6c-a948-5c71bfca9da9 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:48.356909 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd9404-fe87-4f6c-a948-5c71bfca9da9 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:48.356909 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd9404-fe87-4f6c-a948-5c71bfca9da9 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:48.358287 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 723/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 29 12:14:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:14:48.363622 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929aaa9f-cb08-48e2-bbd5-5105a4d5a4c0 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:48.364053 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929aaa9f-cb08-48e2-bbd5-5105a4d5a4c0 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:48.364167 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929aaa9f-cb08-48e2-bbd5-5105a4d5a4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:48.383190 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-929aaa9f-cb08-48e2-bbd5-5105a4d5a4c0 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:14:48.384396 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-929aaa9f-cb08-48e2-bbd5-5105a4d5a4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:14:48.393617 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 710/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 29 12:14:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:14:48.561450 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd9404-fe87-4f6c-a948-5c71bfca9da9 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:14:48.581380 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd9404-fe87-4f6c-a948-5c71bfca9da9 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:14:48.588049 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f8b18-0cd4-4b83-99df-b88d844d7882 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7adaa2ef440941aa8214f2b2fd49b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:14:48.588682 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f8b18-0cd4-4b83-99df-b88d844d7882 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:48.588959 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f8b18-0cd4-4b83-99df-b88d844d7882 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:48.589228 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f8b18-0cd4-4b83-99df-b88d844d7882 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:48.598035 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f8b18-0cd4-4b83-99df-b88d844d7882 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:14:48.599614 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f8b18-0cd4-4b83-99df-b88d844d7882 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:14:48.610316 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 724/1434] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:14:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:14:49.414521 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce85e7-11d5-4787-8941-7e15cea47644 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:49.415401 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce85e7-11d5-4787-8941-7e15cea47644 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:49.415401 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce85e7-11d5-4787-8941-7e15cea47644 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:49.417503 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 711/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 29 12:14:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:14:49.425975 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f49de5-1efd-4291-b17e-86fa246564d2 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:49.426707 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f49de5-1efd-4291-b17e-86fa246564d2 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:49.426868 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f49de5-1efd-4291-b17e-86fa246564d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:49.456479 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-14f49de5-1efd-4291-b17e-86fa246564d2 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:14:49.458309 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-14f49de5-1efd-4291-b17e-86fa246564d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:14:49.471619 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 725/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 29 12:14:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:14:49.634804 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce85e7-11d5-4787-8941-7e15cea47644 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:14:49.656606 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce85e7-11d5-4787-8941-7e15cea47644 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:14:49.663462 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4bcea1-5179-4dca-8032-64fec949acd6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7adaa2ef440941aa8214f2b2fd49b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:14:49.664198 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4bcea1-5179-4dca-8032-64fec949acd6 service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:49.664483 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4bcea1-5179-4dca-8032-64fec949acd6 service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:49.664818 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4bcea1-5179-4dca-8032-64fec949acd6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:49.673145 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4bcea1-5179-4dca-8032-64fec949acd6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:14:49.674755 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4bcea1-5179-4dca-8032-64fec949acd6 service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:14:49.684594 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 712/1437] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:14:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:14:50.507152 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640c024-4a83-4cb9-b05d-b11c39fabdef None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:50.507731 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640c024-4a83-4cb9-b05d-b11c39fabdef None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:50.508016 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640c024-4a83-4cb9-b05d-b11c39fabdef None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:50.509534 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 726/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 29 12:14:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:14:50.514961 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d6ee1-0ba9-48ce-85b8-a571dcd0a0f1 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:50.515417 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d6ee1-0ba9-48ce-85b8-a571dcd0a0f1 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:50.515547 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d6ee1-0ba9-48ce-85b8-a571dcd0a0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:50.534678 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-b62d6ee1-0ba9-48ce-85b8-a571dcd0a0f1 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:14:50.535867 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-b62d6ee1-0ba9-48ce-85b8-a571dcd0a0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:14:50.544565 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 713/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 29 12:14:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:14:50.697415 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1640c024-4a83-4cb9-b05d-b11c39fabdef None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:14:50.716381 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1640c024-4a83-4cb9-b05d-b11c39fabdef None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:14:50.722819 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f042a-44da-4a74-a8a2-0e1c4907a4e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7adaa2ef440941aa8214f2b2fd49b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:14:50.723466 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f042a-44da-4a74-a8a2-0e1c4907a4e2 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:50.723752 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f042a-44da-4a74-a8a2-0e1c4907a4e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:50.724030 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f042a-44da-4a74-a8a2-0e1c4907a4e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:50.733345 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389f042a-44da-4a74-a8a2-0e1c4907a4e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:14:50.734970 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389f042a-44da-4a74-a8a2-0e1c4907a4e2 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:14:50.745508 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 727/1440] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:14:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:14:52.677495 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053663b9-5c31-4ec5-baa0-24d010bd32c7 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:52.678514 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053663b9-5c31-4ec5-baa0-24d010bd32c7 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:52.678514 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053663b9-5c31-4ec5-baa0-24d010bd32c7 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:52.680164 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 714/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 12:14:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:14:52.685842 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a11d23-10fc-4311-be9b-0c9f44cb568f None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:52.686290 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a11d23-10fc-4311-be9b-0c9f44cb568f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:52.686391 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a11d23-10fc-4311-be9b-0c9f44cb568f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:52.705551 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-30a11d23-10fc-4311-be9b-0c9f44cb568f None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:14:52.706802 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-30a11d23-10fc-4311-be9b-0c9f44cb568f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:14:52.716867 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 728/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 12:14:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:14:52.755102 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053663b9-5c31-4ec5-baa0-24d010bd32c7 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:14:52.768356 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053663b9-5c31-4ec5-baa0-24d010bd32c7 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:14:52.772916 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1811f-0719-4dfa-b1eb-df72e7bdaa3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:14:52.773628 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1811f-0719-4dfa-b1eb-df72e7bdaa3b service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:52.773939 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1811f-0719-4dfa-b1eb-df72e7bdaa3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:52.774214 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1811f-0719-4dfa-b1eb-df72e7bdaa3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:52.784346 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b1811f-0719-4dfa-b1eb-df72e7bdaa3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:14:52.785841 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b1811f-0719-4dfa-b1eb-df72e7bdaa3b service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:14:52.795975 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 715/1443] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:14:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:14:55.006501 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df0dd6-d143-4213-a21f-aa886eb90909 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:55.007591 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df0dd6-d143-4213-a21f-aa886eb90909 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:55.008216 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df0dd6-d143-4213-a21f-aa886eb90909 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:55.010535 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 729/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 12:14:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:14:55.016887 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000a914-a226-4a7c-8135-e2657b5777dd None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:55.017354 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000a914-a226-4a7c-8135-e2657b5777dd None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:55.017481 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000a914-a226-4a7c-8135-e2657b5777dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:55.038657 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-1000a914-a226-4a7c-8135-e2657b5777dd None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:14:55.039987 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-1000a914-a226-4a7c-8135-e2657b5777dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:14:55.049074 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 716/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 12:14:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:14:55.088313 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df0dd6-d143-4213-a21f-aa886eb90909 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:14:55.102028 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df0dd6-d143-4213-a21f-aa886eb90909 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:14:55.106884 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a25465-559b-4d5c-b287-757de2d35922 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:14:55.107599 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a25465-559b-4d5c-b287-757de2d35922 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:55.107900 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a25465-559b-4d5c-b287-757de2d35922 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:55.108167 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a25465-559b-4d5c-b287-757de2d35922 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:55.118974 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a25465-559b-4d5c-b287-757de2d35922 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:14:55.120414 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a25465-559b-4d5c-b287-757de2d35922 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:14:55.130192 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 730/1446] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:14:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:14:57.495172 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35083d-5f39-47e8-b62b-28370c891e25 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:57.495795 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35083d-5f39-47e8-b62b-28370c891e25 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:57.495795 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35083d-5f39-47e8-b62b-28370c891e25 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:57.497108 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 717/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 12:14:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:14:57.502826 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cfe6ce-94ba-48d4-bd43-3a189f874d61 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:57.503273 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cfe6ce-94ba-48d4-bd43-3a189f874d61 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:57.503387 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cfe6ce-94ba-48d4-bd43-3a189f874d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:57.530016 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-58cfe6ce-94ba-48d4-bd43-3a189f874d61 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:14:57.531927 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-58cfe6ce-94ba-48d4-bd43-3a189f874d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:14:57.543396 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 731/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 12:14:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:14:57.586471 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c35083d-5f39-47e8-b62b-28370c891e25 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:14:57.606731 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c35083d-5f39-47e8-b62b-28370c891e25 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:14:57.614123 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4e1bb8-fc5b-4f91-9cd6-d407c22d60bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:14:57.615092 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e1bb8-fc5b-4f91-9cd6-d407c22d60bd service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:57.615547 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e1bb8-fc5b-4f91-9cd6-d407c22d60bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:57.615831 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e1bb8-fc5b-4f91-9cd6-d407c22d60bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:57.631998 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4e1bb8-fc5b-4f91-9cd6-d407c22d60bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:14:57.633867 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4e1bb8-fc5b-4f91-9cd6-d407c22d60bd service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:14:57.643657 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 718/1449] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:14:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:14:59.831617 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ff9bb-4ab0-4dfc-9636-1f5bcb38f9f2 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:59.832250 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ff9bb-4ab0-4dfc-9636-1f5bcb38f9f2 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:59.832250 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ff9bb-4ab0-4dfc-9636-1f5bcb38f9f2 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:59.833566 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 732/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 12:14:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:14:59.840101 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89402e-9bae-4d5f-b7e8-6591f0912662 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:59.840875 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89402e-9bae-4d5f-b7e8-6591f0912662 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:59.841042 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89402e-9bae-4d5f-b7e8-6591f0912662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:59.864200 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-2b89402e-9bae-4d5f-b7e8-6591f0912662 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:14:59.865401 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-2b89402e-9bae-4d5f-b7e8-6591f0912662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:14:59.874478 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 719/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 12:14:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:14:59.915780 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69ff9bb-4ab0-4dfc-9636-1f5bcb38f9f2 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:14:59.928051 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69ff9bb-4ab0-4dfc-9636-1f5bcb38f9f2 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:14:59.932817 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38cdecb-dc76-41f4-baae-f13f07d46f0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:14:59.933465 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cdecb-dc76-41f4-baae-f13f07d46f0d service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:14:59.933751 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cdecb-dc76-41f4-baae-f13f07d46f0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:14:59.934051 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cdecb-dc76-41f4-baae-f13f07d46f0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:14:59.944340 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38cdecb-dc76-41f4-baae-f13f07d46f0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:14:59.945916 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38cdecb-dc76-41f4-baae-f13f07d46f0d service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:14:59.955706 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 733/1452] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:14:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:15:02.086655 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23805e9e-d67e-4196-99c3-5fcf199a8471 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:15:02.087187 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23805e9e-d67e-4196-99c3-5fcf199a8471 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:15:02.087187 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23805e9e-d67e-4196-99c3-5fcf199a8471 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:15:02.089172 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 720/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 12:15:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:15:02.094521 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292da14d-ba0c-4417-ac3e-039a29315a22 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:15:02.094997 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292da14d-ba0c-4417-ac3e-039a29315a22 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:15:02.095113 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292da14d-ba0c-4417-ac3e-039a29315a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:15:02.114455 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-292da14d-ba0c-4417-ac3e-039a29315a22 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:15:02.115666 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-292da14d-ba0c-4417-ac3e-039a29315a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:15:02.124738 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 734/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 12:15:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:15:02.165507 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23805e9e-d67e-4196-99c3-5fcf199a8471 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:15:02.178744 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23805e9e-d67e-4196-99c3-5fcf199a8471 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:15:02.183605 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d954e-3f7c-4410-ac70-3258e34a9889 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:15:02.184246 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d954e-3f7c-4410-ac70-3258e34a9889 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:15:02.184529 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d954e-3f7c-4410-ac70-3258e34a9889 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:15:02.184800 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d954e-3f7c-4410-ac70-3258e34a9889 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:15:02.196531 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d954e-3f7c-4410-ac70-3258e34a9889 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:15:02.198109 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d954e-3f7c-4410-ac70-3258e34a9889 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:15:02.208212 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 721/1455] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:15:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:15:04.324622 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348dae4f-ef74-4f43-9c68-c337c8ed4e23 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:15:04.325531 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348dae4f-ef74-4f43-9c68-c337c8ed4e23 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:15:04.325531 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348dae4f-ef74-4f43-9c68-c337c8ed4e23 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:15:04.327381 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 735/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 12:15:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:15:04.333752 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f54174-75d9-4808-be3f-49f1b41e04ec None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:15:04.334515 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f54174-75d9-4808-be3f-49f1b41e04ec None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:15:04.334691 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f54174-75d9-4808-be3f-49f1b41e04ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:15:04.360388 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-20f54174-75d9-4808-be3f-49f1b41e04ec None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:15:04.361598 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-20f54174-75d9-4808-be3f-49f1b41e04ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:15:04.371114 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 722/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 12:15:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:15:04.409143 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348dae4f-ef74-4f43-9c68-c337c8ed4e23 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:15:04.421317 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348dae4f-ef74-4f43-9c68-c337c8ed4e23 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:15:04.425963 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328d07ae-0f01-45df-a320-00f73d22bdf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:15:04.426617 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d07ae-0f01-45df-a320-00f73d22bdf3 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:15:04.426897 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d07ae-0f01-45df-a320-00f73d22bdf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:15:04.427166 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d07ae-0f01-45df-a320-00f73d22bdf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:15:04.436806 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328d07ae-0f01-45df-a320-00f73d22bdf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:15:04.438274 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328d07ae-0f01-45df-a320-00f73d22bdf3 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:15:04.447896 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 736/1458] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:15:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:15:06.531215 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fed116-6df2-4ec6-8faa-939bbc75e22a None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:15:06.531806 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fed116-6df2-4ec6-8faa-939bbc75e22a None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:15:06.531806 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fed116-6df2-4ec6-8faa-939bbc75e22a None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:15:06.534063 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 723/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 12:15:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:15:06.542032 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7935bb2c-0ed9-44a4-a140-c1622f554d8c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:15:06.542423 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7935bb2c-0ed9-44a4-a140-c1622f554d8c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:15:06.542615 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7935bb2c-0ed9-44a4-a140-c1622f554d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:15:06.568940 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-7935bb2c-0ed9-44a4-a140-c1622f554d8c None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:15:06.571041 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7935bb2c-0ed9-44a4-a140-c1622f554d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:15:06.581634 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 737/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 12:15:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:15:06.627155 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fed116-6df2-4ec6-8faa-939bbc75e22a None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:15:06.641927 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fed116-6df2-4ec6-8faa-939bbc75e22a None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:15:06.645896 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac07cc-73ee-4e73-b36c-cac4e3eef9cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:15:06.646543 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac07cc-73ee-4e73-b36c-cac4e3eef9cd service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:15:06.646829 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac07cc-73ee-4e73-b36c-cac4e3eef9cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:15:06.647106 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac07cc-73ee-4e73-b36c-cac4e3eef9cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:15:06.657024 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ac07cc-73ee-4e73-b36c-cac4e3eef9cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:15:06.658511 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ac07cc-73ee-4e73-b36c-cac4e3eef9cd service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:15:06.668783 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 724/1461] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:15:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:15:08.790279 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a549be5-7aa5-4aed-ae51-e2852042618f None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:15:08.790830 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a549be5-7aa5-4aed-ae51-e2852042618f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:15:08.790830 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a549be5-7aa5-4aed-ae51-e2852042618f None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:15:08.792266 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 738/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 12:15:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:15:08.798618 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7d89f-95ea-45b3-a103-b421dbb3c223 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:15:08.799348 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7d89f-95ea-45b3-a103-b421dbb3c223 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:15:08.799466 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7d89f-95ea-45b3-a103-b421dbb3c223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:15:08.809186 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=79 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:15:08.827838 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-0fa7d89f-95ea-45b3-a103-b421dbb3c223 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:15:08.829045 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-0fa7d89f-95ea-45b3-a103-b421dbb3c223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:15:08.838524 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 725/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 12:15:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:15:08.879296 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a549be5-7aa5-4aed-ae51-e2852042618f None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:15:08.887516 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=73 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:15:08.894752 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a549be5-7aa5-4aed-ae51-e2852042618f None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:15:08.899038 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83c604-1442-479e-b8de-130eda74d4db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:15:08.899679 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83c604-1442-479e-b8de-130eda74d4db service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:15:08.900068 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83c604-1442-479e-b8de-130eda74d4db service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:15:08.900346 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83c604-1442-479e-b8de-130eda74d4db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:15:08.910022 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df83c604-1442-479e-b8de-130eda74d4db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:15:08.911484 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df83c604-1442-479e-b8de-130eda74d4db service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:15:08.921320 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 739/1464] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:15:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:15:11.002663 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38065c8b-198e-4ff4-96dd-ff9af672c3d9 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:15:11.003251 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38065c8b-198e-4ff4-96dd-ff9af672c3d9 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:15:11.003251 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38065c8b-198e-4ff4-96dd-ff9af672c3d9 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:15:11.004598 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 726/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 12:15:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:15:11.010795 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ac41a-a707-4544-9015-4d7f59aa27c5 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:15:11.011225 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ac41a-a707-4544-9015-4d7f59aa27c5 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:15:11.011318 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ac41a-a707-4544-9015-4d7f59aa27c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:15:11.036525 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c62ac41a-a707-4544-9015-4d7f59aa27c5 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:15:11.037807 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c62ac41a-a707-4544-9015-4d7f59aa27c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:15:11.046333 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 740/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 12:15:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:15:11.086959 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38065c8b-198e-4ff4-96dd-ff9af672c3d9 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:15:11.104866 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38065c8b-198e-4ff4-96dd-ff9af672c3d9 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:15:11.109169 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08b2f5-5eda-46d2-b6fb-f5304f19874d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:15:11.109867 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08b2f5-5eda-46d2-b6fb-f5304f19874d service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:15:11.110147 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08b2f5-5eda-46d2-b6fb-f5304f19874d service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:15:11.110412 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08b2f5-5eda-46d2-b6fb-f5304f19874d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:15:11.120295 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff08b2f5-5eda-46d2-b6fb-f5304f19874d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:15:11.121739 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff08b2f5-5eda-46d2-b6fb-f5304f19874d service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:15:11.131622 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 727/1467] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:15:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:15:13.168970 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d254acde-b667-4bb5-bb44-b2be525d5252 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:15:13.169931 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d254acde-b667-4bb5-bb44-b2be525d5252 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:15:13.169931 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d254acde-b667-4bb5-bb44-b2be525d5252 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:15:13.172168 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 741/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 12:15:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:15:13.180725 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833bbe6-1365-4fac-a4ea-3e1f5e5177ab None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:15:13.181233 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833bbe6-1365-4fac-a4ea-3e1f5e5177ab None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:15:13.181349 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833bbe6-1365-4fac-a4ea-3e1f5e5177ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:15:13.206333 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-9833bbe6-1365-4fac-a4ea-3e1f5e5177ab None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:15:13.207539 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-9833bbe6-1365-4fac-a4ea-3e1f5e5177ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:15:13.216292 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 728/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 12:15:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:15:13.253172 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d254acde-b667-4bb5-bb44-b2be525d5252 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:15:13.266437 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d254acde-b667-4bb5-bb44-b2be525d5252 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:15:13.270779 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0862a662-f0b1-4d26-aef1-d44bcd05525d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:15:13.271550 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862a662-f0b1-4d26-aef1-d44bcd05525d service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:15:13.271832 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862a662-f0b1-4d26-aef1-d44bcd05525d service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:15:13.272202 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862a662-f0b1-4d26-aef1-d44bcd05525d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:15:13.287752 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0862a662-f0b1-4d26-aef1-d44bcd05525d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:15:13.290028 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0862a662-f0b1-4d26-aef1-d44bcd05525d service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:15:13.300190 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 742/1470] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:15:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:15:23.200897 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=11 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:15:23.295372 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=14 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:15:33.292748 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57e487-7035-4dce-8026-69ad485d0872 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:15:33.293318 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57e487-7035-4dce-8026-69ad485d0872 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:15:33.293318 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57e487-7035-4dce-8026-69ad485d0872 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:15:33.294645 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 729/1471] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:15:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:15:33.300641 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70e115-a12a-4cfa-9e1f-709bc8fa2d88 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:15:33.301112 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70e115-a12a-4cfa-9e1f-709bc8fa2d88 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:15:33.301227 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70e115-a12a-4cfa-9e1f-709bc8fa2d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:15:33.320887 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-be70e115-a12a-4cfa-9e1f-709bc8fa2d88 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:15:33.322151 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-be70e115-a12a-4cfa-9e1f-709bc8fa2d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:15:33.330653 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 743/1472] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:15:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:15:33.385112 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf354c-7b64-4c99-a0bb-1f55f9508658 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:15:33.385680 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf354c-7b64-4c99-a0bb-1f55f9508658 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:15:33.386023 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf354c-7b64-4c99-a0bb-1f55f9508658 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:15:33.387404 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 730/1473] 10.222.0.27 () {54 vars in 962 bytes} [Wed Jun 29 12:15:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:15:33.392631 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaab19c-53cb-48d5-9e00-ed1da91baa86 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:15:33.392920 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaab19c-53cb-48d5-9e00-ed1da91baa86 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:15:33.393210 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaab19c-53cb-48d5-9e00-ed1da91baa86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:15:33.413101 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-0eaab19c-53cb-48d5-9e00-ed1da91baa86 None None] MFA Rules not processed for user `d865d1b935a54ca2b44beda5b0277336`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:15:33.414336 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0eaab19c-53cb-48d5-9e00-ed1da91baa86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:15:33.422263 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 744/1474] 10.222.0.27 () {58 vars in 1059 bytes} [Wed Jun 29 12:15:33 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:15:33.431263 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf354c-7b64-4c99-a0bb-1f55f9508658 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:15:33.445222 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf354c-7b64-4c99-a0bb-1f55f9508658 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:15:33.449659 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14dd478-0ba7-4cbe-9bd9-cffb991aa35c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd865d1b935a54ca2b44beda5b0277336', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:15:33.450386 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14dd478-0ba7-4cbe-9bd9-cffb991aa35c service glance] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:15:33.450665 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14dd478-0ba7-4cbe-9bd9-cffb991aa35c service glance] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:15:33.450937 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14dd478-0ba7-4cbe-9bd9-cffb991aa35c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:15:33.460811 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14dd478-0ba7-4cbe-9bd9-cffb991aa35c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:15:33.462493 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14dd478-0ba7-4cbe-9bd9-cffb991aa35c service glance] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:15:33.478297 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 731/1475] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:15:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:15:35.634731 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331cba5-f138-48a7-b5e0-ea587a860cf1 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:15:35.635672 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331cba5-f138-48a7-b5e0-ea587a860cf1 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:15:35.635672 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331cba5-f138-48a7-b5e0-ea587a860cf1 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:15:35.637863 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 745/1476] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:15:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:15:35.647004 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d3775-0b8c-4413-8e11-10c4a3bed37c None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:15:35.647742 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d3775-0b8c-4413-8e11-10c4a3bed37c None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:15:35.647919 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d3775-0b8c-4413-8e11-10c4a3bed37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:15:35.668005 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-324d3775-0b8c-4413-8e11-10c4a3bed37c None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:15:35.669198 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-324d3775-0b8c-4413-8e11-10c4a3bed37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:15:35.678758 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 732/1477] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:15:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:15:35.703082 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e331cba5-f138-48a7-b5e0-ea587a860cf1 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:15:35.724688 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e331cba5-f138-48a7-b5e0-ea587a860cf1 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:15:35.731155 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf11b09-a41c-45f3-8ea1-9449fcbf423d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:15:35.731809 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf11b09-a41c-45f3-8ea1-9449fcbf423d admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:15:35.732091 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf11b09-a41c-45f3-8ea1-9449fcbf423d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:15:35.732367 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf11b09-a41c-45f3-8ea1-9449fcbf423d admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:15:35.733113 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf11b09-a41c-45f3-8ea1-9449fcbf423d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:15:35.734934 dv-cinder-797608-38-smb devstack@keystone.service[80135]: WARNING py.warnings [None req-daf11b09-a41c-45f3-8ea1-9449fcbf423d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 29 12:15:35.734934 dv-cinder-797608-38-smb devstack@keystone.service[80135]: warnings.warn(msg) Jun 29 12:15:35.734934 dv-cinder-797608-38-smb devstack@keystone.service[80135]: Jun 29 12:15:35.736074 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf11b09-a41c-45f3-8ea1-9449fcbf423d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:15:35.755447 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 746/1478] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jun 29 12:15:35 2022] GET /identity/v3/projects => generated 2553 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:15:37.839602 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9093f3-07da-4677-a504-0b2ef1ce5dc9 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:15:37.840523 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9093f3-07da-4677-a504-0b2ef1ce5dc9 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:15:37.840523 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9093f3-07da-4677-a504-0b2ef1ce5dc9 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:15:37.842747 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 733/1479] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:15:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:15:37.851333 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced5f10-0348-4a4f-a061-3e9fbf727743 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:15:37.851786 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced5f10-0348-4a4f-a061-3e9fbf727743 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:15:37.851973 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced5f10-0348-4a4f-a061-3e9fbf727743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:15:37.878090 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-0ced5f10-0348-4a4f-a061-3e9fbf727743 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:15:37.879297 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0ced5f10-0348-4a4f-a061-3e9fbf727743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:15:37.887931 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 747/1480] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:15:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:15:37.934905 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9093f3-07da-4677-a504-0b2ef1ce5dc9 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:15:37.952075 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9093f3-07da-4677-a504-0b2ef1ce5dc9 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:15:37.957975 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64535ce2-fd6a-4be0-b11f-9f40990d8c2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7adaa2ef440941aa8214f2b2fd49b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:15:37.958619 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64535ce2-fd6a-4be0-b11f-9f40990d8c2d service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:15:37.958901 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64535ce2-fd6a-4be0-b11f-9f40990d8c2d service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:15:37.959174 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64535ce2-fd6a-4be0-b11f-9f40990d8c2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:15:37.968131 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64535ce2-fd6a-4be0-b11f-9f40990d8c2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:15:37.969771 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64535ce2-fd6a-4be0-b11f-9f40990d8c2d service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:15:37.980049 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 734/1481] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:15:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:15:40.220544 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd0093-0ea4-44c3-9527-98bc32b93080 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:15:40.221489 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd0093-0ea4-44c3-9527-98bc32b93080 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:15:40.221489 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd0093-0ea4-44c3-9527-98bc32b93080 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:15:40.223654 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 748/1482] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:15:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:15:40.231033 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c06d50d-2d47-4407-b409-f0ab1742297a None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:15:40.231480 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c06d50d-2d47-4407-b409-f0ab1742297a None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:15:40.231575 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c06d50d-2d47-4407-b409-f0ab1742297a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:15:40.258984 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-6c06d50d-2d47-4407-b409-f0ab1742297a None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:15:40.260212 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-6c06d50d-2d47-4407-b409-f0ab1742297a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:15:40.268788 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 735/1483] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:15:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:15:40.305885 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dd0093-0ea4-44c3-9527-98bc32b93080 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:15:40.323696 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dd0093-0ea4-44c3-9527-98bc32b93080 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:15:40.327979 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515fafb8-35f4-4c1e-b4a8-6ddeee73d063 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:15:40.328621 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fafb8-35f4-4c1e-b4a8-6ddeee73d063 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:15:40.328904 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fafb8-35f4-4c1e-b4a8-6ddeee73d063 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:15:40.329170 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fafb8-35f4-4c1e-b4a8-6ddeee73d063 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:15:40.339160 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515fafb8-35f4-4c1e-b4a8-6ddeee73d063 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:15:40.340607 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515fafb8-35f4-4c1e-b4a8-6ddeee73d063 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:15:40.350185 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 749/1484] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:15:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:15:42.415624 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe726efe-0799-479c-9dd6-a084bbb7b3b3 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:15:42.416252 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe726efe-0799-479c-9dd6-a084bbb7b3b3 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:15:42.416252 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe726efe-0799-479c-9dd6-a084bbb7b3b3 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:15:42.417550 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 736/1485] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:15:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:15:42.423982 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a138f10-8527-4bb6-82ac-76b1d608e68c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:15:42.424408 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a138f10-8527-4bb6-82ac-76b1d608e68c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:15:42.424585 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a138f10-8527-4bb6-82ac-76b1d608e68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:15:42.450799 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-5a138f10-8527-4bb6-82ac-76b1d608e68c None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:15:42.452005 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5a138f10-8527-4bb6-82ac-76b1d608e68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:15:42.461038 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 750/1486] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:15:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:15:42.500955 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe726efe-0799-479c-9dd6-a084bbb7b3b3 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:15:42.513657 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe726efe-0799-479c-9dd6-a084bbb7b3b3 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:15:42.517521 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f62a92-c943-4ce8-8c4d-bf380fd05d41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:15:42.518188 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f62a92-c943-4ce8-8c4d-bf380fd05d41 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:15:42.518461 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f62a92-c943-4ce8-8c4d-bf380fd05d41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:15:42.518726 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f62a92-c943-4ce8-8c4d-bf380fd05d41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:15:42.528218 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f62a92-c943-4ce8-8c4d-bf380fd05d41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:15:42.529649 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f62a92-c943-4ce8-8c4d-bf380fd05d41 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:15:42.539434 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 737/1487] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:15:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:15:44.674646 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336781e5-3c6c-448f-9fca-b7eea3d35783 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:15:44.675280 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336781e5-3c6c-448f-9fca-b7eea3d35783 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:15:44.675280 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336781e5-3c6c-448f-9fca-b7eea3d35783 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:15:44.677216 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 751/1488] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:15:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:15:44.683559 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e1bad-7a63-41c5-aaf0-2797fb8b2a64 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:15:44.684007 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e1bad-7a63-41c5-aaf0-2797fb8b2a64 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:15:44.684113 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e1bad-7a63-41c5-aaf0-2797fb8b2a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:15:44.707546 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-030e1bad-7a63-41c5-aaf0-2797fb8b2a64 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:15:44.708783 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-030e1bad-7a63-41c5-aaf0-2797fb8b2a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:15:44.718606 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 738/1489] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:15:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:15:44.759148 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336781e5-3c6c-448f-9fca-b7eea3d35783 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:15:44.772355 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336781e5-3c6c-448f-9fca-b7eea3d35783 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:15:44.777587 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ced22-d019-4da5-899d-55bf68df8151 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:15:44.778267 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ced22-d019-4da5-899d-55bf68df8151 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:15:44.778545 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ced22-d019-4da5-899d-55bf68df8151 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:15:44.778814 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ced22-d019-4da5-899d-55bf68df8151 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:15:44.788959 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ced22-d019-4da5-899d-55bf68df8151 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:15:44.790506 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ced22-d019-4da5-899d-55bf68df8151 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:15:44.800031 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 752/1490] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:15:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:15:47.038166 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe0b1f-2419-4fdf-8b1a-2187e9dad02f None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:15:47.038969 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe0b1f-2419-4fdf-8b1a-2187e9dad02f None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:15:47.039177 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe0b1f-2419-4fdf-8b1a-2187e9dad02f None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:15:47.041098 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 739/1491] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jun 29 12:15:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:15:47.047112 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd41d74-5445-402a-b4d0-ed3e671bce08 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:15:47.047563 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd41d74-5445-402a-b4d0-ed3e671bce08 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:15:47.047658 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd41d74-5445-402a-b4d0-ed3e671bce08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:15:47.074979 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-afd41d74-5445-402a-b4d0-ed3e671bce08 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:15:47.076221 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-afd41d74-5445-402a-b4d0-ed3e671bce08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:15:47.084824 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 753/1492] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jun 29 12:15:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:15:47.124806 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe0b1f-2419-4fdf-8b1a-2187e9dad02f None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:15:47.140949 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe0b1f-2419-4fdf-8b1a-2187e9dad02f None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:15:47.145131 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e876601b-000f-454c-97d7-4a2de2024738 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:15:47.145803 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876601b-000f-454c-97d7-4a2de2024738 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:15:47.146081 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876601b-000f-454c-97d7-4a2de2024738 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:15:47.146360 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876601b-000f-454c-97d7-4a2de2024738 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:15:47.155894 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e876601b-000f-454c-97d7-4a2de2024738 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:15:47.157350 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e876601b-000f-454c-97d7-4a2de2024738 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:15:47.168714 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 740/1493] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:15:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:15:57.066120 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=33 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:15:57.163643 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=33 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:17:14.436125 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6ea8d-3530-488e-9f94-008fe7b6dcca None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:17:14.436769 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6ea8d-3530-488e-9f94-008fe7b6dcca None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:17:14.436769 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6ea8d-3530-488e-9f94-008fe7b6dcca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:17:14.457413 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-ffb6ea8d-3530-488e-9f94-008fe7b6dcca None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:17:14.458645 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ffb6ea8d-3530-488e-9f94-008fe7b6dcca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:17:14.468108 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 754/1494] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:17:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:17:14.476158 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd777b53-2f5e-48b4-984e-87a4f155fa37 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:17:14.476690 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd777b53-2f5e-48b4-984e-87a4f155fa37 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:17:14.476690 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd777b53-2f5e-48b4-984e-87a4f155fa37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:17:14.497181 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-dd777b53-2f5e-48b4-984e-87a4f155fa37 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:17:14.498459 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-dd777b53-2f5e-48b4-984e-87a4f155fa37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:17:14.507602 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 741/1495] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:17:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:17:14.512503 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb6ea8d-3530-488e-9f94-008fe7b6dcca None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:17:14.522660 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb6ea8d-3530-488e-9f94-008fe7b6dcca None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:17:14.528740 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ffc83-ab20-4c6d-9499-53c20bcc8bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:17:14.529391 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ffc83-ab20-4c6d-9499-53c20bcc8bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:17:14.529676 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ffc83-ab20-4c6d-9499-53c20bcc8bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:17:14.529973 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ffc83-ab20-4c6d-9499-53c20bcc8bc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:17:14.530699 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0ffc83-ab20-4c6d-9499-53c20bcc8bc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:17:14.531000 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0ffc83-ab20-4c6d-9499-53c20bcc8bc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:17:14.532026 dv-cinder-797608-38-smb devstack@keystone.service[80135]: WARNING py.warnings [None req-0f0ffc83-ab20-4c6d-9499-53c20bcc8bc3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 12:17:14.532026 dv-cinder-797608-38-smb devstack@keystone.service[80135]: warnings.warn(msg) Jun 29 12:17:14.532026 dv-cinder-797608-38-smb devstack@keystone.service[80135]: Jun 29 12:17:14.532924 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0ffc83-ab20-4c6d-9499-53c20bcc8bc3 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:17:14.546222 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 755/1496] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:17:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:17:14.554614 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd777b53-2f5e-48b4-984e-87a4f155fa37 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:17:14.564217 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd777b53-2f5e-48b4-984e-87a4f155fa37 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:17:14.570436 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6771b-382c-4c18-ae77-e7ef80bb1962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:17:14.571092 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6771b-382c-4c18-ae77-e7ef80bb1962 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:17:14.571375 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6771b-382c-4c18-ae77-e7ef80bb1962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:17:14.571646 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6771b-382c-4c18-ae77-e7ef80bb1962 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:17:14.572338 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e6771b-382c-4c18-ae77-e7ef80bb1962 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:17:14.574594 dv-cinder-797608-38-smb devstack@keystone.service[80134]: WARNING py.warnings [None req-14e6771b-382c-4c18-ae77-e7ef80bb1962 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 29 12:17:14.574594 dv-cinder-797608-38-smb devstack@keystone.service[80134]: warnings.warn(msg) Jun 29 12:17:14.574594 dv-cinder-797608-38-smb devstack@keystone.service[80134]: Jun 29 12:17:14.575826 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e6771b-382c-4c18-ae77-e7ef80bb1962 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:17:14.618390 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 742/1497] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:17:14 2022] POST /identity/v3/projects => generated 375 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:17:14.626215 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ffc83-ab20-4c6d-9499-53c20bcc8bc3 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:17:14.638838 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ffc83-ab20-4c6d-9499-53c20bcc8bc3 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:17:14.713021 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ae699-8542-4326-aa30-ce94383f88f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:17:14.713792 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ae699-8542-4326-aa30-ce94383f88f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:17:14.714124 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ae699-8542-4326-aa30-ce94383f88f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:17:14.714374 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ae699-8542-4326-aa30-ce94383f88f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:17:14.715378 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ae699-8542-4326-aa30-ce94383f88f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:17:14.716810 dv-cinder-797608-38-smb devstack@keystone.service[80135]: WARNING py.warnings [None req-7d5ae699-8542-4326-aa30-ce94383f88f4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 29 12:17:14.716810 dv-cinder-797608-38-smb devstack@keystone.service[80135]: warnings.warn(msg) Jun 29 12:17:14.716810 dv-cinder-797608-38-smb devstack@keystone.service[80135]: Jun 29 12:17:14.718550 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ae699-8542-4326-aa30-ce94383f88f4 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:17:14.744018 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 756/1498] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:17:14 2022] POST /identity/v3/users => generated 288 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:17:14.748705 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6771b-382c-4c18-ae77-e7ef80bb1962 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:17:14.759368 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6771b-382c-4c18-ae77-e7ef80bb1962 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:17:14.764340 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6218a83-58dc-4734-9782-00aa85c068ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:17:14.764998 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6218a83-58dc-4734-9782-00aa85c068ea admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:17:14.765277 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6218a83-58dc-4734-9782-00aa85c068ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:17:14.765546 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6218a83-58dc-4734-9782-00aa85c068ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:17:14.766311 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6218a83-58dc-4734-9782-00aa85c068ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:17:14.767327 dv-cinder-797608-38-smb devstack@keystone.service[80134]: WARNING py.warnings [None req-e6218a83-58dc-4734-9782-00aa85c068ea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 12:17:14.767327 dv-cinder-797608-38-smb devstack@keystone.service[80134]: warnings.warn(msg) Jun 29 12:17:14.767327 dv-cinder-797608-38-smb devstack@keystone.service[80134]: Jun 29 12:17:14.768202 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6218a83-58dc-4734-9782-00aa85c068ea admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:17:14.781665 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 743/1499] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:17:14.785670 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ae699-8542-4326-aa30-ce94383f88f4 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:17:14.796237 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ae699-8542-4326-aa30-ce94383f88f4 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:17:14.802569 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d3876-3f28-4dc6-8a23-6cdea079bf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:17:14.803238 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d3876-3f28-4dc6-8a23-6cdea079bf31 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:17:14.803516 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d3876-3f28-4dc6-8a23-6cdea079bf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:17:14.803768 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d3876-3f28-4dc6-8a23-6cdea079bf31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:17:14.804525 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03d3876-3f28-4dc6-8a23-6cdea079bf31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:17:14.805564 dv-cinder-797608-38-smb devstack@keystone.service[80135]: WARNING py.warnings [None req-e03d3876-3f28-4dc6-8a23-6cdea079bf31 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 12:17:14.805564 dv-cinder-797608-38-smb devstack@keystone.service[80135]: warnings.warn(msg) Jun 29 12:17:14.805564 dv-cinder-797608-38-smb devstack@keystone.service[80135]: Jun 29 12:17:14.806485 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03d3876-3f28-4dc6-8a23-6cdea079bf31 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:17:14.821678 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 757/1500] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:17:14.826655 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6218a83-58dc-4734-9782-00aa85c068ea admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:17:14.837877 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6218a83-58dc-4734-9782-00aa85c068ea admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:17:14.843418 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f7f61-e045-4193-94b1-f2dfcab3c862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:17:14.844316 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f7f61-e045-4193-94b1-f2dfcab3c862 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:17:14.844598 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f7f61-e045-4193-94b1-f2dfcab3c862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:17:14.844872 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f7f61-e045-4193-94b1-f2dfcab3c862 admin admin] PATH_INFO: `/v3/projects/febda21b5dfd4a7885fb05a5ca98e39a/users/8c040559b92e4dd4a91bbd1ed2591e19/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:17:14.862243 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f7f61-e045-4193-94b1-f2dfcab3c862 admin admin] RBAC: Authorizing `identity:create_grant(project_id=febda21b5dfd4a7885fb05a5ca98e39a, user_id=8c040559b92e4dd4a91bbd1ed2591e19, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:17:14.863299 dv-cinder-797608-38-smb devstack@keystone.service[80134]: WARNING py.warnings [None req-5c0f7f61-e045-4193-94b1-f2dfcab3c862 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 29 12:17:14.863299 dv-cinder-797608-38-smb devstack@keystone.service[80134]: warnings.warn(msg) Jun 29 12:17:14.863299 dv-cinder-797608-38-smb devstack@keystone.service[80134]: Jun 29 12:17:14.865214 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f7f61-e045-4193-94b1-f2dfcab3c862 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:17:14.880958 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 744/1501] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:17:14 2022] PUT /identity/v3/projects/febda21b5dfd4a7885fb05a5ca98e39a/users/8c040559b92e4dd4a91bbd1ed2591e19/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:17:14.893778 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e3f74-1284-4982-b9d0-a5f677780058 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:17:14.894072 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e3f74-1284-4982-b9d0-a5f677780058 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:17:14.894352 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e3f74-1284-4982-b9d0-a5f677780058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:17:14.922111 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-dd3e3f74-1284-4982-b9d0-a5f677780058 None None] MFA Rules not processed for user `8c040559b92e4dd4a91bbd1ed2591e19`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:17:14.923304 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-dd3e3f74-1284-4982-b9d0-a5f677780058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:17:15.005860 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 758/1502] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:17:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:17:15.021248 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbebbb5-6070-440a-948d-f575da0bacf0 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:17:15.021535 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbebbb5-6070-440a-948d-f575da0bacf0 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:17:15.021871 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbebbb5-6070-440a-948d-f575da0bacf0 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:17:15.023289 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 745/1503] 10.222.0.27 () {54 vars in 963 bytes} [Wed Jun 29 12:17:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:17:15.031480 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e529d9c-ae18-4df2-a8ce-689dbc52b5f8 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:17:15.031480 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e529d9c-ae18-4df2-a8ce-689dbc52b5f8 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:17:15.031480 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e529d9c-ae18-4df2-a8ce-689dbc52b5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:17:15.048936 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-8e529d9c-ae18-4df2-a8ce-689dbc52b5f8 None None] MFA Rules not processed for user `f72f0602e17f4ab4a48e3aaa7022d28d`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:17:15.050196 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8e529d9c-ae18-4df2-a8ce-689dbc52b5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:17:15.106031 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:17:15.115376 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 759/1504] 10.222.0.27 () {58 vars in 1060 bytes} [Wed Jun 29 12:17:15 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:17:15.123580 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbebbb5-6070-440a-948d-f575da0bacf0 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:17:15.136883 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbebbb5-6070-440a-948d-f575da0bacf0 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:17:15.143033 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f43c6-cb64-4f9c-ac7a-62432a0c92b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:17:15.143732 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f43c6-cb64-4f9c-ac7a-62432a0c92b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:17:15.144042 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f43c6-cb64-4f9c-ac7a-62432a0c92b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:17:15.144310 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f43c6-cb64-4f9c-ac7a-62432a0c92b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:17:15.154134 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57f43c6-cb64-4f9c-ac7a-62432a0c92b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:17:15.155579 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57f43c6-cb64-4f9c-ac7a-62432a0c92b2 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:17:15.165129 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 746/1505] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:17:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:17:15.208554 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71c15e-30b0-4d00-b450-1dac5e7325dd None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:17:15.208839 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71c15e-30b0-4d00-b450-1dac5e7325dd None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:17:15.209118 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71c15e-30b0-4d00-b450-1dac5e7325dd None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:17:15.210479 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 760/1506] 10.222.0.27 () {52 vars in 829 bytes} [Wed Jun 29 12:17:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:17:15.214353 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f43c6-cb64-4f9c-ac7a-62432a0c92b2 service cinder] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:17:15.276925 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f43c6-cb64-4f9c-ac7a-62432a0c92b2 service cinder] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:17:15.283498 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ee578-cf76-4b0e-ab35-f0a3699815cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:17:15.284761 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ee578-cf76-4b0e-ab35-f0a3699815cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:17:15.285147 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ee578-cf76-4b0e-ab35-f0a3699815cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:17:15.285548 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ee578-cf76-4b0e-ab35-f0a3699815cb admin admin] PATH_INFO: `/v3/users/8c040559b92e4dd4a91bbd1ed2591e19` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:17:15.287659 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ee578-cf76-4b0e-ab35-f0a3699815cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c040559b92e4dd4a91bbd1ed2591e19)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:17:15.289242 dv-cinder-797608-38-smb devstack@keystone.service[80134]: WARNING py.warnings [None req-4c3ee578-cf76-4b0e-ab35-f0a3699815cb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 29 12:17:15.289242 dv-cinder-797608-38-smb devstack@keystone.service[80134]: warnings.warn(msg) Jun 29 12:17:15.289242 dv-cinder-797608-38-smb devstack@keystone.service[80134]: Jun 29 12:17:15.291073 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ee578-cf76-4b0e-ab35-f0a3699815cb admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:17:15.365899 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-4c3ee578-cf76-4b0e-ab35-f0a3699815cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c040559b92e4dd4a91bbd1ed2591e19'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:17:15.384283 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-4c3ee578-cf76-4b0e-ab35-f0a3699815cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c040559b92e4dd4a91bbd1ed2591e19'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:17:15.399690 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-4c3ee578-cf76-4b0e-ab35-f0a3699815cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c040559b92e4dd4a91bbd1ed2591e19'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:17:15.400912 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-4c3ee578-cf76-4b0e-ab35-f0a3699815cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c040559b92e4dd4a91bbd1ed2591e19'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:17:15.407420 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:17:15.416631 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-4c3ee578-cf76-4b0e-ab35-f0a3699815cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c040559b92e4dd4a91bbd1ed2591e19'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:17:15.424596 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 747/1507] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:17:15 2022] DELETE /identity/v3/users/8c040559b92e4dd4a91bbd1ed2591e19 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:17:15.429169 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b2eec-3255-4b94-8e79-3b17471aec31 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:17:15.429459 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b2eec-3255-4b94-8e79-3b17471aec31 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:17:15.429765 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b2eec-3255-4b94-8e79-3b17471aec31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:17:15.448565 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-618b2eec-3255-4b94-8e79-3b17471aec31 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:17:15.449816 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-618b2eec-3255-4b94-8e79-3b17471aec31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:17:15.511495 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 761/1508] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:17:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:17:15.522036 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ee578-cf76-4b0e-ab35-f0a3699815cb admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:17:15.523546 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-4c3ee578-cf76-4b0e-ab35-f0a3699815cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:17:15.593884 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ee578-cf76-4b0e-ab35-f0a3699815cb admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:17:15.600308 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8fde77-3e5b-4d8d-abb5-3d1615cd5aea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:17:15.600973 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8fde77-3e5b-4d8d-abb5-3d1615cd5aea service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:17:15.601327 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8fde77-3e5b-4d8d-abb5-3d1615cd5aea service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:17:15.601655 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8fde77-3e5b-4d8d-abb5-3d1615cd5aea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:17:15.614058 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8fde77-3e5b-4d8d-abb5-3d1615cd5aea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:17:15.615522 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8fde77-3e5b-4d8d-abb5-3d1615cd5aea service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:17:15.625166 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 748/1509] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:17:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:17:16.018773 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b2eec-3255-4b94-8e79-3b17471aec31 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:17:16.020529 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-618b2eec-3255-4b94-8e79-3b17471aec31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:17:16.033439 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b2eec-3255-4b94-8e79-3b17471aec31 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:17:16.038790 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575fe4f2-0ae3-4116-8562-1bc15b1f0f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:17:16.039673 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575fe4f2-0ae3-4116-8562-1bc15b1f0f52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:17:16.039954 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575fe4f2-0ae3-4116-8562-1bc15b1f0f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:17:16.040205 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575fe4f2-0ae3-4116-8562-1bc15b1f0f52 admin admin] PATH_INFO: `/v3/projects/febda21b5dfd4a7885fb05a5ca98e39a` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:17:16.042527 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575fe4f2-0ae3-4116-8562-1bc15b1f0f52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=febda21b5dfd4a7885fb05a5ca98e39a)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:17:16.043588 dv-cinder-797608-38-smb devstack@keystone.service[80135]: WARNING py.warnings [None req-575fe4f2-0ae3-4116-8562-1bc15b1f0f52 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 29 12:17:16.043588 dv-cinder-797608-38-smb devstack@keystone.service[80135]: warnings.warn(msg) Jun 29 12:17:16.043588 dv-cinder-797608-38-smb devstack@keystone.service[80135]: Jun 29 12:17:16.045028 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575fe4f2-0ae3-4116-8562-1bc15b1f0f52 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:17:16.115242 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-575fe4f2-0ae3-4116-8562-1bc15b1f0f52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'febda21b5dfd4a7885fb05a5ca98e39a', 'request_id': 'req-575fe4f2-0ae3-4116-8562-1bc15b1f0f52'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:17:16.121640 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-575fe4f2-0ae3-4116-8562-1bc15b1f0f52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'febda21b5dfd4a7885fb05a5ca98e39a', 'request_id': 'req-575fe4f2-0ae3-4116-8562-1bc15b1f0f52'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:17:16.133981 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-575fe4f2-0ae3-4116-8562-1bc15b1f0f52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'febda21b5dfd4a7885fb05a5ca98e39a', 'request_id': 'req-575fe4f2-0ae3-4116-8562-1bc15b1f0f52'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:17:16.154170 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-575fe4f2-0ae3-4116-8562-1bc15b1f0f52 admin admin] The token cache is being invalidate because project febda21b5dfd4a7885fb05a5ca98e39a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:17:16.154478 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-575fe4f2-0ae3-4116-8562-1bc15b1f0f52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:17:16.155172 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-575fe4f2-0ae3-4116-8562-1bc15b1f0f52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:17:16.156866 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 762/1510] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:17:16 2022] DELETE /identity/v3/projects/febda21b5dfd4a7885fb05a5ca98e39a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:17:25.620830 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:17:26.151144 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:19:00.326998 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6cf06-3597-48c3-91f7-26e78190b5a1 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:19:00.327755 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6cf06-3597-48c3-91f7-26e78190b5a1 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:19:00.327755 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6cf06-3597-48c3-91f7-26e78190b5a1 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:19:00.329329 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 749/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 29 12:19:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:19:00.335863 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd9a52-1386-4972-a97d-d5fbba01e635 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:19:00.336634 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd9a52-1386-4972-a97d-d5fbba01e635 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:19:00.336787 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd9a52-1386-4972-a97d-d5fbba01e635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:19:00.360155 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f1cd9a52-1386-4972-a97d-d5fbba01e635 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:19:00.361407 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f1cd9a52-1386-4972-a97d-d5fbba01e635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:19:00.434231 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 763/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 29 12:19:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:19:00.589715 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a6cf06-3597-48c3-91f7-26e78190b5a1 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:19:00.591618 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e7a6cf06-3597-48c3-91f7-26e78190b5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:19:00.681454 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a6cf06-3597-48c3-91f7-26e78190b5a1 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:19:00.688052 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238705ca-8014-407b-a7d5-9a7c0fb28008 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7adaa2ef440941aa8214f2b2fd49b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:19:00.688737 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238705ca-8014-407b-a7d5-9a7c0fb28008 service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:19:00.689011 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238705ca-8014-407b-a7d5-9a7c0fb28008 service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:19:00.689281 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238705ca-8014-407b-a7d5-9a7c0fb28008 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:19:00.699363 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238705ca-8014-407b-a7d5-9a7c0fb28008 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:19:00.701007 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238705ca-8014-407b-a7d5-9a7c0fb28008 service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:19:00.711711 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 750/1513] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:19:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:19:01.548830 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb140147-ab38-4b7a-8d45-d6129824eda1 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:19:01.549721 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb140147-ab38-4b7a-8d45-d6129824eda1 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:19:01.549721 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb140147-ab38-4b7a-8d45-d6129824eda1 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:19:01.550927 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 764/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 29 12:19:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:19:01.558589 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7cccd-528e-4f72-9ff0-c1c373ee2017 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:19:01.559379 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7cccd-528e-4f72-9ff0-c1c373ee2017 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:19:01.559379 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7cccd-528e-4f72-9ff0-c1c373ee2017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:19:01.587678 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-bce7cccd-528e-4f72-9ff0-c1c373ee2017 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:19:01.589094 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-bce7cccd-528e-4f72-9ff0-c1c373ee2017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:19:01.604345 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 751/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 29 12:19:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:19:01.767476 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb140147-ab38-4b7a-8d45-d6129824eda1 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:19:01.783533 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb140147-ab38-4b7a-8d45-d6129824eda1 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:19:01.791828 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b00251e-39c1-42dd-86bc-c71da03a2f83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7adaa2ef440941aa8214f2b2fd49b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:19:01.793040 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00251e-39c1-42dd-86bc-c71da03a2f83 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:19:01.793411 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00251e-39c1-42dd-86bc-c71da03a2f83 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:19:01.793937 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00251e-39c1-42dd-86bc-c71da03a2f83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:19:01.809668 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b00251e-39c1-42dd-86bc-c71da03a2f83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:19:01.812517 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b00251e-39c1-42dd-86bc-c71da03a2f83 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:19:01.828947 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 765/1516] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:19:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:19:01.934538 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907788cd-b904-46d2-8360-98101362b34f None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:19:01.934806 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907788cd-b904-46d2-8360-98101362b34f None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:19:01.935089 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907788cd-b904-46d2-8360-98101362b34f None None] PATH_INFO: `/v3` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:19:01.936503 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 752/1517] 10.222.0.58 () {54 vars in 925 bytes} [Wed Jun 29 12:19:01 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:19:01.944324 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd240a-89fe-430c-9513-6418c40c4d95 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:19:01.944609 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd240a-89fe-430c-9513-6418c40c4d95 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:19:01.944886 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd240a-89fe-430c-9513-6418c40c4d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:19:01.964800 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-1bcd240a-89fe-430c-9513-6418c40c4d95 None None] MFA Rules not processed for user `286a99b42d9246db909040bf8ab18ea1`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:19:01.966105 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1bcd240a-89fe-430c-9513-6418c40c4d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:19:02.031176 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 766/1518] 10.222.0.58 () {58 vars in 1015 bytes} [Wed Jun 29 12:19:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:19:05.849077 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd3c8e-20ea-49aa-af69-0d33eca39bc5 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:19:05.849600 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd3c8e-20ea-49aa-af69-0d33eca39bc5 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:19:05.849600 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd3c8e-20ea-49aa-af69-0d33eca39bc5 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:19:05.851127 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 753/1519] 10.222.0.27 () {54 vars in 960 bytes} [Wed Jun 29 12:19:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:19:05.856609 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de390cee-a96f-4879-be2c-83a38ce10633 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:19:05.857108 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de390cee-a96f-4879-be2c-83a38ce10633 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:19:05.857231 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de390cee-a96f-4879-be2c-83a38ce10633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:19:05.876578 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-de390cee-a96f-4879-be2c-83a38ce10633 None None] MFA Rules not processed for user `286a99b42d9246db909040bf8ab18ea1`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:19:05.877844 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-de390cee-a96f-4879-be2c-83a38ce10633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:19:05.889897 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 767/1520] 10.222.0.27 () {58 vars in 1057 bytes} [Wed Jun 29 12:19:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:19:05.898835 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd3c8e-20ea-49aa-af69-0d33eca39bc5 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:19:05.916275 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd3c8e-20ea-49aa-af69-0d33eca39bc5 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:19:05.923547 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e5f91-3bfd-4f15-91ad-1f6e32658712 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '286a99b42d9246db909040bf8ab18ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:19:05.924575 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e5f91-3bfd-4f15-91ad-1f6e32658712 service placement] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:19:05.925045 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e5f91-3bfd-4f15-91ad-1f6e32658712 service placement] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:19:05.925458 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e5f91-3bfd-4f15-91ad-1f6e32658712 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:19:05.936028 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4e5f91-3bfd-4f15-91ad-1f6e32658712 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:19:05.937643 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4e5f91-3bfd-4f15-91ad-1f6e32658712 service placement] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:19:05.948545 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 754/1521] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:19:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:19:13.080427 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a28b81-3982-419c-8c97-9257b7d22828 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:19:13.080930 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a28b81-3982-419c-8c97-9257b7d22828 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:19:13.081027 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a28b81-3982-419c-8c97-9257b7d22828 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:19:13.082521 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 768/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 29 12:19:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:19:13.088764 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6346f6-bf22-4e88-b107-d4da56c58db9 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:19:13.089216 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6346f6-bf22-4e88-b107-d4da56c58db9 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:19:13.089324 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6346f6-bf22-4e88-b107-d4da56c58db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:19:13.112478 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-bd6346f6-bf22-4e88-b107-d4da56c58db9 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:19:13.113679 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-bd6346f6-bf22-4e88-b107-d4da56c58db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:19:13.123561 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 755/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 29 12:19:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:19:13.293432 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a28b81-3982-419c-8c97-9257b7d22828 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:19:13.315322 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a28b81-3982-419c-8c97-9257b7d22828 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:19:13.322883 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687d991-44ab-42c1-b816-64fd01eab650 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7adaa2ef440941aa8214f2b2fd49b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:19:13.323537 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687d991-44ab-42c1-b816-64fd01eab650 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:19:13.323821 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687d991-44ab-42c1-b816-64fd01eab650 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:19:13.324094 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687d991-44ab-42c1-b816-64fd01eab650 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:19:13.333514 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9687d991-44ab-42c1-b816-64fd01eab650 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:19:13.337900 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9687d991-44ab-42c1-b816-64fd01eab650 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:19:13.355990 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 769/1524] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:19:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:19:14.188806 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393385b5-e66c-4123-85dc-eb2b37c7ca7a None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:19:14.189361 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393385b5-e66c-4123-85dc-eb2b37c7ca7a None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:19:14.189361 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393385b5-e66c-4123-85dc-eb2b37c7ca7a None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:19:14.190812 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 756/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 29 12:19:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:19:14.196548 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba7066-8564-4e66-914c-5dd9d448abb7 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:19:14.196978 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba7066-8564-4e66-914c-5dd9d448abb7 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:19:14.197102 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba7066-8564-4e66-914c-5dd9d448abb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:19:14.216980 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-95ba7066-8564-4e66-914c-5dd9d448abb7 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:19:14.218248 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-95ba7066-8564-4e66-914c-5dd9d448abb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:19:14.227435 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 770/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 29 12:19:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:19:14.386044 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393385b5-e66c-4123-85dc-eb2b37c7ca7a None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:19:14.403306 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393385b5-e66c-4123-85dc-eb2b37c7ca7a None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:19:14.409327 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd64c6e-5dc9-479a-9e92-f3c729001ea2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7adaa2ef440941aa8214f2b2fd49b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:19:14.410007 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd64c6e-5dc9-479a-9e92-f3c729001ea2 service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:19:14.410288 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd64c6e-5dc9-479a-9e92-f3c729001ea2 service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:19:14.410559 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd64c6e-5dc9-479a-9e92-f3c729001ea2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:19:14.420661 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd64c6e-5dc9-479a-9e92-f3c729001ea2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:19:14.422304 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd64c6e-5dc9-479a-9e92-f3c729001ea2 service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:19:14.432368 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 757/1527] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:19:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:19:18.574131 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd9d90-5a4b-48d1-b5d0-11c77626f850 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:19:18.574980 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd9d90-5a4b-48d1-b5d0-11c77626f850 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:19:18.574980 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd9d90-5a4b-48d1-b5d0-11c77626f850 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:19:18.577043 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 771/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 12:19:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:19:18.582876 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c127a-98ff-4fbf-b989-cd3ede6d75bd None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:19:18.583332 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c127a-98ff-4fbf-b989-cd3ede6d75bd None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:19:18.583442 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c127a-98ff-4fbf-b989-cd3ede6d75bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:19:18.602522 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-4c9c127a-98ff-4fbf-b989-cd3ede6d75bd None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:19:18.603861 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-4c9c127a-98ff-4fbf-b989-cd3ede6d75bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:19:18.612560 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 758/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 12:19:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:19:18.649627 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd9d90-5a4b-48d1-b5d0-11c77626f850 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:19:18.652396 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f7bd9d90-5a4b-48d1-b5d0-11c77626f850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:19:18.730400 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd9d90-5a4b-48d1-b5d0-11c77626f850 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:19:18.734483 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5510a29-3340-46ad-90d4-35e7afc82639 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:19:18.735139 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5510a29-3340-46ad-90d4-35e7afc82639 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:19:18.735428 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5510a29-3340-46ad-90d4-35e7afc82639 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:19:18.735706 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5510a29-3340-46ad-90d4-35e7afc82639 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:19:18.746960 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5510a29-3340-46ad-90d4-35e7afc82639 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:19:18.749240 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5510a29-3340-46ad-90d4-35e7afc82639 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:19:18.757023 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:19:18.764962 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 772/1530] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:19:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:19:20.809790 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38698b94-55ad-4da7-9ce8-9aca4df45dfc None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:19:20.810401 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38698b94-55ad-4da7-9ce8-9aca4df45dfc None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:19:20.810401 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38698b94-55ad-4da7-9ce8-9aca4df45dfc None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:19:20.811746 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 759/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 12:19:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:19:20.818156 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e85db-a449-4bcd-b0eb-a08422893d1d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:19:20.818659 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e85db-a449-4bcd-b0eb-a08422893d1d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:19:20.818659 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e85db-a449-4bcd-b0eb-a08422893d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:19:20.839722 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-9e3e85db-a449-4bcd-b0eb-a08422893d1d None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:19:20.840966 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9e3e85db-a449-4bcd-b0eb-a08422893d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:19:20.850295 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 773/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 12:19:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:19:20.888246 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38698b94-55ad-4da7-9ce8-9aca4df45dfc None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:19:20.900882 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38698b94-55ad-4da7-9ce8-9aca4df45dfc None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:19:20.904671 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85238465-5dfd-4c0f-bc4b-293c90767c73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:19:20.905345 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85238465-5dfd-4c0f-bc4b-293c90767c73 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:19:20.905624 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85238465-5dfd-4c0f-bc4b-293c90767c73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:19:20.905939 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85238465-5dfd-4c0f-bc4b-293c90767c73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:19:20.916671 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85238465-5dfd-4c0f-bc4b-293c90767c73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:19:20.918158 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85238465-5dfd-4c0f-bc4b-293c90767c73 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:19:20.928212 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 760/1533] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:19:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:19:24.540953 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4642792c-7e37-48e9-8be0-5f1fdf22c76c None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:19:24.541652 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4642792c-7e37-48e9-8be0-5f1fdf22c76c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:19:24.542030 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4642792c-7e37-48e9-8be0-5f1fdf22c76c None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:19:24.544611 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 774/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 12:19:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:19:24.550549 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8cd0a5-954a-453b-856f-3625d558ae17 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:19:24.551264 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8cd0a5-954a-453b-856f-3625d558ae17 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:19:24.551264 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8cd0a5-954a-453b-856f-3625d558ae17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:19:24.571605 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-cd8cd0a5-954a-453b-856f-3625d558ae17 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:19:24.572871 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-cd8cd0a5-954a-453b-856f-3625d558ae17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:19:24.583502 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 761/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 12:19:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:19:24.892505 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4642792c-7e37-48e9-8be0-5f1fdf22c76c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:19:24.894685 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4642792c-7e37-48e9-8be0-5f1fdf22c76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:19:24.967632 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4642792c-7e37-48e9-8be0-5f1fdf22c76c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:19:24.971983 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bddd1f3-1420-474a-89c9-18e239be0dee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:19:24.972677 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bddd1f3-1420-474a-89c9-18e239be0dee service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:19:24.972958 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bddd1f3-1420-474a-89c9-18e239be0dee service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:19:24.973227 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bddd1f3-1420-474a-89c9-18e239be0dee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:19:24.983912 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bddd1f3-1420-474a-89c9-18e239be0dee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:19:24.985364 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bddd1f3-1420-474a-89c9-18e239be0dee service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:19:24.995623 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 775/1536] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:19:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:19:27.092998 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee969e1c-2f4d-445b-95d1-2f36d98a55ba None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:19:27.093896 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee969e1c-2f4d-445b-95d1-2f36d98a55ba None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:19:27.093896 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee969e1c-2f4d-445b-95d1-2f36d98a55ba None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:19:27.096330 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 762/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 12:19:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:19:27.102969 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1981678-49e6-48aa-a838-9dcd98bcf5f1 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:19:27.103442 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1981678-49e6-48aa-a838-9dcd98bcf5f1 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:19:27.103539 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1981678-49e6-48aa-a838-9dcd98bcf5f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:19:27.130868 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-b1981678-49e6-48aa-a838-9dcd98bcf5f1 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:19:27.132578 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b1981678-49e6-48aa-a838-9dcd98bcf5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:19:27.142755 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 776/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 12:19:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:19:27.462407 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee969e1c-2f4d-445b-95d1-2f36d98a55ba None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:19:27.465585 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ee969e1c-2f4d-445b-95d1-2f36d98a55ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:19:27.478754 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=65 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:19:27.485833 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee969e1c-2f4d-445b-95d1-2f36d98a55ba None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:19:27.489794 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0df512-ec3a-498c-9183-3f2cc92bd6a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:19:27.490440 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0df512-ec3a-498c-9183-3f2cc92bd6a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:19:27.490721 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0df512-ec3a-498c-9183-3f2cc92bd6a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:19:27.490991 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0df512-ec3a-498c-9183-3f2cc92bd6a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:19:27.501195 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0df512-ec3a-498c-9183-3f2cc92bd6a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:19:27.502680 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0df512-ec3a-498c-9183-3f2cc92bd6a8 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:19:27.512985 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 763/1539] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:19:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:19:37.122658 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=32 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:19:37.508311 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=5 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:00.432706 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b3e9d-9b3c-4805-83eb-d4fe5ecfc659 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:00.433448 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b3e9d-9b3c-4805-83eb-d4fe5ecfc659 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:00.433448 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b3e9d-9b3c-4805-83eb-d4fe5ecfc659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:00.453153 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0919a8-d7e7-4077-ad24-28b9cd320da7 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:00.453802 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0919a8-d7e7-4077-ad24-28b9cd320da7 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:00.453802 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0919a8-d7e7-4077-ad24-28b9cd320da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:00.466001 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c50b3e9d-9b3c-4805-83eb-d4fe5ecfc659 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:00.467239 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c50b3e9d-9b3c-4805-83eb-d4fe5ecfc659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:00.483081 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-fc0919a8-d7e7-4077-ad24-28b9cd320da7 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:00.483319 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 777/1540] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:00.484884 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-fc0919a8-d7e7-4077-ad24-28b9cd320da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:00.492258 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8549c0-7b1c-417e-8add-c51c259f335c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:00.492664 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8549c0-7b1c-417e-8add-c51c259f335c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:00.492887 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8549c0-7b1c-417e-8add-c51c259f335c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:00.500785 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 764/1541] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:21:00.510949 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4c248-38d4-4b7f-9b30-9ff84661cbca None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:00.511318 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4c248-38d4-4b7f-9b30-9ff84661cbca None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:00.511516 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4c248-38d4-4b7f-9b30-9ff84661cbca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:00.530922 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-1d8549c0-7b1c-417e-8add-c51c259f335c None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:00.532172 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1d8549c0-7b1c-417e-8add-c51c259f335c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:00.543813 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-86e4c248-38d4-4b7f-9b30-9ff84661cbca None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:00.545091 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-86e4c248-38d4-4b7f-9b30-9ff84661cbca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:00.556139 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 778/1542] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:21:00.557617 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b6cc8-0414-4e85-840c-19b62067ed26 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:00.557946 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b6cc8-0414-4e85-840c-19b62067ed26 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:00.558220 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b6cc8-0414-4e85-840c-19b62067ed26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:00.561645 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 765/1543] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:21:00.567109 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e4c248-38d4-4b7f-9b30-9ff84661cbca None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:00.579988 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e4c248-38d4-4b7f-9b30-9ff84661cbca None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:00.591764 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b64278-d87f-4032-bd10-e49e2457fdf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:00.592478 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b64278-d87f-4032-bd10-e49e2457fdf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:00.592913 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b64278-d87f-4032-bd10-e49e2457fdf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:00.593202 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b64278-d87f-4032-bd10-e49e2457fdf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:00.594017 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b64278-d87f-4032-bd10-e49e2457fdf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:21:00.594331 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b64278-d87f-4032-bd10-e49e2457fdf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:00.594874 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-921b6cc8-0414-4e85-840c-19b62067ed26 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:00.595676 dv-cinder-797608-38-smb devstack@keystone.service[80134]: WARNING py.warnings [None req-64b64278-d87f-4032-bd10-e49e2457fdf0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 12:21:00.595676 dv-cinder-797608-38-smb devstack@keystone.service[80134]: warnings.warn(msg) Jun 29 12:21:00.595676 dv-cinder-797608-38-smb devstack@keystone.service[80134]: Jun 29 12:21:00.596112 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-921b6cc8-0414-4e85-840c-19b62067ed26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:00.596613 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b64278-d87f-4032-bd10-e49e2457fdf0 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:00.613678 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 766/1544] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:21:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:21:00.614671 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b64278-d87f-4032-bd10-e49e2457fdf0 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:00.619628 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 779/1545] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:00.623159 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75d552-bdd9-44b4-9c0f-64604cfe0b0f None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:00.624125 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75d552-bdd9-44b4-9c0f-64604cfe0b0f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:00.625162 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75d552-bdd9-44b4-9c0f-64604cfe0b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:00.627262 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b64278-d87f-4032-bd10-e49e2457fdf0 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:00.633278 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389354da-19ac-4cc9-b1b2-cf2a5c38f6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:00.634024 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389354da-19ac-4cc9-b1b2-cf2a5c38f6e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:00.634318 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389354da-19ac-4cc9-b1b2-cf2a5c38f6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:00.634585 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389354da-19ac-4cc9-b1b2-cf2a5c38f6e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:00.635355 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389354da-19ac-4cc9-b1b2-cf2a5c38f6e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:21:00.635671 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389354da-19ac-4cc9-b1b2-cf2a5c38f6e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:00.637760 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389354da-19ac-4cc9-b1b2-cf2a5c38f6e8 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:00.652772 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-3d75d552-bdd9-44b4-9c0f-64604cfe0b0f None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:00.653452 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 767/1546] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:21:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:21:00.654699 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3d75d552-bdd9-44b4-9c0f-64604cfe0b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:00.654846 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e29501-f61d-4a3c-8ecc-5f03c1efcd1c None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:00.655146 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e29501-f61d-4a3c-8ecc-5f03c1efcd1c None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:00.657875 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e29501-f61d-4a3c-8ecc-5f03c1efcd1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:00.671289 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 780/1547] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:00.672750 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847def1-f0de-4a17-bdf1-6b95d01ea5bb None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:00.673048 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847def1-f0de-4a17-bdf1-6b95d01ea5bb None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:00.673323 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847def1-f0de-4a17-bdf1-6b95d01ea5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:00.685487 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-d2e29501-f61d-4a3c-8ecc-5f03c1efcd1c None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:00.687273 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-d2e29501-f61d-4a3c-8ecc-5f03c1efcd1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:00.698056 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 768/1548] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:00.699293 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e29501-f61d-4a3c-8ecc-5f03c1efcd1c None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:00.707265 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-5847def1-f0de-4a17-bdf1-6b95d01ea5bb None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:00.708847 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5847def1-f0de-4a17-bdf1-6b95d01ea5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:00.718743 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e29501-f61d-4a3c-8ecc-5f03c1efcd1c None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:00.720851 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 781/1549] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:00.722619 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec6bce-6518-44de-8802-5b3841601e2a None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:00.723183 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec6bce-6518-44de-8802-5b3841601e2a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:00.723686 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec6bce-6518-44de-8802-5b3841601e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:00.734053 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a670430-bb1f-43a0-b2ae-26f684b69fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:00.735286 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a670430-bb1f-43a0-b2ae-26f684b69fa5 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:00.735785 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a670430-bb1f-43a0-b2ae-26f684b69fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:00.737187 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a670430-bb1f-43a0-b2ae-26f684b69fa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:00.738186 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a670430-bb1f-43a0-b2ae-26f684b69fa5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:00.740192 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a670430-bb1f-43a0-b2ae-26f684b69fa5 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:00.747260 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-a4ec6bce-6518-44de-8802-5b3841601e2a None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:00.749287 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a4ec6bce-6518-44de-8802-5b3841601e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:00.759591 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 782/1550] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:00.762615 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec6bce-6518-44de-8802-5b3841601e2a None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:00.775314 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec6bce-6518-44de-8802-5b3841601e2a None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:00.779072 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 769/1551] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:21:00 2022] POST /identity/v3/projects => generated 373 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:00.779072 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6adfe-a892-41e7-87ad-b75ef7ce60ad None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:00.779072 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6adfe-a892-41e7-87ad-b75ef7ce60ad None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:00.779072 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6adfe-a892-41e7-87ad-b75ef7ce60ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:00.800962 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-91d6adfe-a892-41e7-87ad-b75ef7ce60ad None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:00.802527 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-91d6adfe-a892-41e7-87ad-b75ef7ce60ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:00.847084 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c997ffb-821c-4261-a619-5b784c887440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:00.847929 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c997ffb-821c-4261-a619-5b784c887440 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:00.848311 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c997ffb-821c-4261-a619-5b784c887440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:00.848654 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c997ffb-821c-4261-a619-5b784c887440 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:00.849468 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c997ffb-821c-4261-a619-5b784c887440 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:00.850727 dv-cinder-797608-38-smb devstack@keystone.service[80135]: WARNING py.warnings [None req-5c997ffb-821c-4261-a619-5b784c887440 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 29 12:21:00.850727 dv-cinder-797608-38-smb devstack@keystone.service[80135]: warnings.warn(msg) Jun 29 12:21:00.850727 dv-cinder-797608-38-smb devstack@keystone.service[80135]: Jun 29 12:21:00.852249 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c997ffb-821c-4261-a619-5b784c887440 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:00.876732 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 770/1552] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:00.878206 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1db76c-7b0a-44a1-95cc-363a905a3e07 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:00.878553 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1db76c-7b0a-44a1-95cc-363a905a3e07 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:00.878886 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1db76c-7b0a-44a1-95cc-363a905a3e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:00.893653 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 783/1553] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:21:00 2022] POST /identity/v3/projects => generated 385 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:00.895420 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475eadba-22f6-40d6-9eb7-6ae71932db0e None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:00.895703 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475eadba-22f6-40d6-9eb7-6ae71932db0e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:00.895975 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475eadba-22f6-40d6-9eb7-6ae71932db0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:00.904385 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-8d1db76c-7b0a-44a1-95cc-363a905a3e07 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:00.905940 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-8d1db76c-7b0a-44a1-95cc-363a905a3e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:00.916326 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-475eadba-22f6-40d6-9eb7-6ae71932db0e None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:00.917569 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-475eadba-22f6-40d6-9eb7-6ae71932db0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:00.975571 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 771/1554] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:00.977042 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949eea72-01d9-4a9e-945f-9a005c589baa None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:00.977362 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949eea72-01d9-4a9e-945f-9a005c589baa None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:00.977683 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949eea72-01d9-4a9e-945f-9a005c589baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:00.997324 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-949eea72-01d9-4a9e-945f-9a005c589baa None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:00.997588 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 784/1555] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:00.998481 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475eadba-22f6-40d6-9eb7-6ae71932db0e None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:00.998663 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-949eea72-01d9-4a9e-945f-9a005c589baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:01.008552 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475eadba-22f6-40d6-9eb7-6ae71932db0e None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:01.008775 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 772/1556] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:01.013277 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e492cb3e-e02b-4657-9929-0cf5862be1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:01.013987 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e492cb3e-e02b-4657-9929-0cf5862be1f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:01.014263 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e492cb3e-e02b-4657-9929-0cf5862be1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:01.014625 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e492cb3e-e02b-4657-9929-0cf5862be1f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:01.014855 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949eea72-01d9-4a9e-945f-9a005c589baa None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:01.015269 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e492cb3e-e02b-4657-9929-0cf5862be1f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:21:01.015570 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e492cb3e-e02b-4657-9929-0cf5862be1f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:01.017512 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e492cb3e-e02b-4657-9929-0cf5862be1f5 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:01.025165 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949eea72-01d9-4a9e-945f-9a005c589baa None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:01.031214 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59ee7b-7314-462f-a0a3-acb6e32f54b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:01.031948 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59ee7b-7314-462f-a0a3-acb6e32f54b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:01.032179 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59ee7b-7314-462f-a0a3-acb6e32f54b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:01.032315 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 785/1557] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:21:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:21:01.032536 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59ee7b-7314-462f-a0a3-acb6e32f54b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:01.033199 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed59ee7b-7314-462f-a0a3-acb6e32f54b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:01.033418 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e492cb3e-e02b-4657-9929-0cf5862be1f5 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:01.034224 dv-cinder-797608-38-smb devstack@keystone.service[80134]: WARNING py.warnings [None req-ed59ee7b-7314-462f-a0a3-acb6e32f54b7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 29 12:21:01.034224 dv-cinder-797608-38-smb devstack@keystone.service[80134]: warnings.warn(msg) Jun 29 12:21:01.034224 dv-cinder-797608-38-smb devstack@keystone.service[80134]: Jun 29 12:21:01.035545 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed59ee7b-7314-462f-a0a3-acb6e32f54b7 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:01.044936 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e492cb3e-e02b-4657-9929-0cf5862be1f5 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:01.049538 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec1728-7e57-48b6-9af8-0958cfaf59c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:01.050242 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec1728-7e57-48b6-9af8-0958cfaf59c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:01.050523 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec1728-7e57-48b6-9af8-0958cfaf59c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:01.050787 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec1728-7e57-48b6-9af8-0958cfaf59c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:01.051653 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeec1728-7e57-48b6-9af8-0958cfaf59c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:21:01.051828 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeec1728-7e57-48b6-9af8-0958cfaf59c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:01.053875 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeec1728-7e57-48b6-9af8-0958cfaf59c4 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:01.064158 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 773/1558] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:21:01 2022] POST /identity/v3/users => generated 287 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:01.066034 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1cb1a-81ee-4714-bba0-c861de52d3a0 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:01.066325 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1cb1a-81ee-4714-bba0-c861de52d3a0 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:01.066603 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1cb1a-81ee-4714-bba0-c861de52d3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:01.080262 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 786/1559] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:21:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:21:01.080262 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec1728-7e57-48b6-9af8-0958cfaf59c4 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:01.085188 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec1728-7e57-48b6-9af8-0958cfaf59c4 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:01.087585 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-eed1cb1a-81ee-4714-bba0-c861de52d3a0 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:01.088827 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-eed1cb1a-81ee-4714-bba0-c861de52d3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:01.090741 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb4ac25-1ac8-47f6-a529-4a6aace2e835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:01.091395 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4ac25-1ac8-47f6-a529-4a6aace2e835 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:01.091681 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4ac25-1ac8-47f6-a529-4a6aace2e835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:01.091955 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4ac25-1ac8-47f6-a529-4a6aace2e835 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:01.092662 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb4ac25-1ac8-47f6-a529-4a6aace2e835 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:01.094625 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb4ac25-1ac8-47f6-a529-4a6aace2e835 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:01.098242 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 774/1560] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:01.099018 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1cb1a-81ee-4714-bba0-c861de52d3a0 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:01.103980 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:01.111699 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1cb1a-81ee-4714-bba0-c861de52d3a0 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:01.117235 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41beb242-f874-4d76-b772-50fb3c619391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:01.118081 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41beb242-f874-4d76-b772-50fb3c619391 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:01.118376 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41beb242-f874-4d76-b772-50fb3c619391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:01.119053 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41beb242-f874-4d76-b772-50fb3c619391 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:01.119805 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41beb242-f874-4d76-b772-50fb3c619391 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:21:01.119988 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 787/1561] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:21:01 2022] POST /identity/v3/users => generated 293 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:01.120116 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41beb242-f874-4d76-b772-50fb3c619391 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:01.120915 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb4ac25-1ac8-47f6-a529-4a6aace2e835 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:01.121858 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41beb242-f874-4d76-b772-50fb3c619391 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:01.128018 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:01.133034 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb4ac25-1ac8-47f6-a529-4a6aace2e835 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:01.135980 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 775/1562] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:21:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:21:01.139155 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee208e30-7739-4891-8c98-02adc2cc8776 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:01.139446 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee208e30-7739-4891-8c98-02adc2cc8776 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:01.139729 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee208e30-7739-4891-8c98-02adc2cc8776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:01.139982 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e83e8-85f6-4841-b4a5-99794bc548c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:01.140789 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e83e8-85f6-4841-b4a5-99794bc548c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:01.141168 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e83e8-85f6-4841-b4a5-99794bc548c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:01.141720 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e83e8-85f6-4841-b4a5-99794bc548c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:01.142549 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e83e8-85f6-4841-b4a5-99794bc548c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:21:01.142954 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e83e8-85f6-4841-b4a5-99794bc548c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:01.144961 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e83e8-85f6-4841-b4a5-99794bc548c9 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:01.158695 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-ee208e30-7739-4891-8c98-02adc2cc8776 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:01.159442 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 788/1563] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:21:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:21:01.160289 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e83e8-85f6-4841-b4a5-99794bc548c9 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:01.163103 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ee208e30-7739-4891-8c98-02adc2cc8776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:01.170717 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e83e8-85f6-4841-b4a5-99794bc548c9 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:01.172114 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 776/1564] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:01.172963 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee208e30-7739-4891-8c98-02adc2cc8776 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:01.177420 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f20125e-71bd-48b6-bf78-4ba3a365d1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:01.178133 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20125e-71bd-48b6-bf78-4ba3a365d1d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:01.178421 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20125e-71bd-48b6-bf78-4ba3a365d1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:01.178699 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20125e-71bd-48b6-bf78-4ba3a365d1d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:01.179471 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f20125e-71bd-48b6-bf78-4ba3a365d1d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:01.181500 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f20125e-71bd-48b6-bf78-4ba3a365d1d2 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:01.183423 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee208e30-7739-4891-8c98-02adc2cc8776 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:01.188214 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1450826-f8b6-4697-b6fc-56d76a4b77d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:01.189004 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1450826-f8b6-4697-b6fc-56d76a4b77d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:01.189350 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1450826-f8b6-4697-b6fc-56d76a4b77d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:01.189631 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1450826-f8b6-4697-b6fc-56d76a4b77d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:01.190840 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1450826-f8b6-4697-b6fc-56d76a4b77d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:01.192516 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1450826-f8b6-4697-b6fc-56d76a4b77d4 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:01.203395 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 777/1565] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:01.204318 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1450826-f8b6-4697-b6fc-56d76a4b77d4 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:01.211950 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 789/1566] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:21:01 2022] POST /identity/v3/projects => generated 393 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:01.213215 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45b7f4-4233-47bd-a80f-578066ce6932 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:01.213438 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45b7f4-4233-47bd-a80f-578066ce6932 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:01.213818 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45b7f4-4233-47bd-a80f-578066ce6932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:01.215509 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1450826-f8b6-4697-b6fc-56d76a4b77d4 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:01.232090 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-db45b7f4-4233-47bd-a80f-578066ce6932 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:01.233240 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-db45b7f4-4233-47bd-a80f-578066ce6932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:01.273913 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf86684-2567-4812-83c9-9b00bc23ac82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:01.274757 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf86684-2567-4812-83c9-9b00bc23ac82 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:01.275177 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf86684-2567-4812-83c9-9b00bc23ac82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:01.275455 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf86684-2567-4812-83c9-9b00bc23ac82 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:01.276161 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf86684-2567-4812-83c9-9b00bc23ac82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:01.278111 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf86684-2567-4812-83c9-9b00bc23ac82 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:01.293814 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 790/1567] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:01.294772 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45b7f4-4233-47bd-a80f-578066ce6932 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:01.307961 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45b7f4-4233-47bd-a80f-578066ce6932 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:01.313826 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 778/1568] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:21:01 2022] POST /identity/v3/projects => generated 403 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:01.313826 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf86684-2567-4812-83c9-9b00bc23ac82 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:01.319064 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63fb80c-570a-47d3-9ee9-c462ac8fb56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:01.319764 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63fb80c-570a-47d3-9ee9-c462ac8fb56d admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:01.320049 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63fb80c-570a-47d3-9ee9-c462ac8fb56d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:01.320593 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63fb80c-570a-47d3-9ee9-c462ac8fb56d admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:01.321379 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63fb80c-570a-47d3-9ee9-c462ac8fb56d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:01.323196 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63fb80c-570a-47d3-9ee9-c462ac8fb56d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:01.334190 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 791/1569] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:01.335055 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63fb80c-570a-47d3-9ee9-c462ac8fb56d admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:01.347698 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63fb80c-570a-47d3-9ee9-c462ac8fb56d admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:01.390343 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf86684-2567-4812-83c9-9b00bc23ac82 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:01.395761 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda877cb-76fc-45cb-9dc1-e352698052d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:01.396580 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda877cb-76fc-45cb-9dc1-e352698052d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:01.396941 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda877cb-76fc-45cb-9dc1-e352698052d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:01.397222 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda877cb-76fc-45cb-9dc1-e352698052d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:01.397956 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda877cb-76fc-45cb-9dc1-e352698052d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:01.400273 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda877cb-76fc-45cb-9dc1-e352698052d6 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:01.408321 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd10a4-13d4-4713-891d-17e15dcbbcab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:01.408993 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd10a4-13d4-4713-891d-17e15dcbbcab admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:01.409277 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd10a4-13d4-4713-891d-17e15dcbbcab admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:01.409548 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd10a4-13d4-4713-891d-17e15dcbbcab admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:01.410278 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd10a4-13d4-4713-891d-17e15dcbbcab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:01.412189 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd10a4-13d4-4713-891d-17e15dcbbcab admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:01.430542 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 779/1570] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:21:01 2022] POST /identity/v3/projects => generated 379 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:01.430542 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda877cb-76fc-45cb-9dc1-e352698052d6 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:01.444206 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 792/1571] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:21:01 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:01.445108 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd10a4-13d4-4713-891d-17e15dcbbcab admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:01.484024 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:01.505681 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda877cb-76fc-45cb-9dc1-e352698052d6 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:01.574831 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646df82b-fdc0-4f96-8881-6d2c79a400a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:01.575515 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646df82b-fdc0-4f96-8881-6d2c79a400a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:01.575807 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646df82b-fdc0-4f96-8881-6d2c79a400a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:01.576076 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646df82b-fdc0-4f96-8881-6d2c79a400a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:01.576809 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646df82b-fdc0-4f96-8881-6d2c79a400a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:21:01.577118 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646df82b-fdc0-4f96-8881-6d2c79a400a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:01.578810 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646df82b-fdc0-4f96-8881-6d2c79a400a4 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:01.600061 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 780/1572] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:21:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:21:01.600061 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646df82b-fdc0-4f96-8881-6d2c79a400a4 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:01.606015 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646df82b-fdc0-4f96-8881-6d2c79a400a4 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:01.610960 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36852d-737e-4c90-925f-702f7e23f4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:01.611646 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36852d-737e-4c90-925f-702f7e23f4d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:01.611927 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36852d-737e-4c90-925f-702f7e23f4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:01.612199 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36852d-737e-4c90-925f-702f7e23f4d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:01.612900 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b36852d-737e-4c90-925f-702f7e23f4d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:01.614869 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b36852d-737e-4c90-925f-702f7e23f4d5 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:01.627572 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:01.638961 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 781/1573] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:21:01 2022] POST /identity/v3/users => generated 297 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:01.640080 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36852d-737e-4c90-925f-702f7e23f4d5 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:01.647393 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd10a4-13d4-4713-891d-17e15dcbbcab admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:01.650634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36852d-737e-4c90-925f-702f7e23f4d5 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:01.652765 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc099be-7ba2-43b5-a77a-96920bd3959c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:01.653453 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc099be-7ba2-43b5-a77a-96920bd3959c admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:01.653909 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc099be-7ba2-43b5-a77a-96920bd3959c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:01.654186 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc099be-7ba2-43b5-a77a-96920bd3959c admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:01.654923 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc099be-7ba2-43b5-a77a-96920bd3959c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:01.655369 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64adf4dd-6445-47e8-8ec4-f5b6d5fb4474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:01.656033 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64adf4dd-6445-47e8-8ec4-f5b6d5fb4474 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:01.656314 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64adf4dd-6445-47e8-8ec4-f5b6d5fb4474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:01.656561 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc099be-7ba2-43b5-a77a-96920bd3959c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:01.656680 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64adf4dd-6445-47e8-8ec4-f5b6d5fb4474 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:01.657455 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64adf4dd-6445-47e8-8ec4-f5b6d5fb4474 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:21:01.657801 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64adf4dd-6445-47e8-8ec4-f5b6d5fb4474 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:01.659400 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64adf4dd-6445-47e8-8ec4-f5b6d5fb4474 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:01.668003 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 793/1574] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:01.668985 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc099be-7ba2-43b5-a77a-96920bd3959c admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:01.674140 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 782/1575] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:21:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:21:01.675327 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64adf4dd-6445-47e8-8ec4-f5b6d5fb4474 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:01.689119 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc099be-7ba2-43b5-a77a-96920bd3959c admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:01.693132 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64adf4dd-6445-47e8-8ec4-f5b6d5fb4474 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:01.694799 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f1074-25b3-412b-aba1-2a8fa48be250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:01.695567 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f1074-25b3-412b-aba1-2a8fa48be250 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:01.695836 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f1074-25b3-412b-aba1-2a8fa48be250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:01.696103 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f1074-25b3-412b-aba1-2a8fa48be250 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:01.696799 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86f1074-25b3-412b-aba1-2a8fa48be250 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:01.698758 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86f1074-25b3-412b-aba1-2a8fa48be250 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:01.699253 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604570ea-24a1-4db1-8473-0ad6a1c319cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:01.700032 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604570ea-24a1-4db1-8473-0ad6a1c319cb admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:01.700388 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604570ea-24a1-4db1-8473-0ad6a1c319cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:01.700733 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604570ea-24a1-4db1-8473-0ad6a1c319cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:01.701552 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604570ea-24a1-4db1-8473-0ad6a1c319cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:01.703293 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604570ea-24a1-4db1-8473-0ad6a1c319cb admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:01.714752 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 783/1576] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:01.715679 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604570ea-24a1-4db1-8473-0ad6a1c319cb admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:01.719162 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 794/1577] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:21:01 2022] POST /identity/v3/users => generated 302 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:01.719839 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f1074-25b3-412b-aba1-2a8fa48be250 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:01.726407 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604570ea-24a1-4db1-8473-0ad6a1c319cb admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:01.729496 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f1074-25b3-412b-aba1-2a8fa48be250 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:01.731208 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a799a9-3eb8-4688-8c45-4fe44b411203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:01.731896 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a799a9-3eb8-4688-8c45-4fe44b411203 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:01.732173 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a799a9-3eb8-4688-8c45-4fe44b411203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:01.732462 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a799a9-3eb8-4688-8c45-4fe44b411203 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:01.733166 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a799a9-3eb8-4688-8c45-4fe44b411203 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:01.734117 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b7132d-000c-48b4-9d1f-a2193853bd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:01.734755 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7132d-000c-48b4-9d1f-a2193853bd55 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:01.735033 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7132d-000c-48b4-9d1f-a2193853bd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:01.735140 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a799a9-3eb8-4688-8c45-4fe44b411203 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:01.735299 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7132d-000c-48b4-9d1f-a2193853bd55 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:01.735981 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b7132d-000c-48b4-9d1f-a2193853bd55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:01.737907 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b7132d-000c-48b4-9d1f-a2193853bd55 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:01.762139 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 784/1578] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:21:01 2022] POST /identity/v3/users => generated 290 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:01.763234 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a799a9-3eb8-4688-8c45-4fe44b411203 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:01.768450 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 795/1579] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:21:01 2022] POST /identity/v3/users => generated 293 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:01.769591 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b7132d-000c-48b4-9d1f-a2193853bd55 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:01.776248 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a799a9-3eb8-4688-8c45-4fe44b411203 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:01.780611 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b7132d-000c-48b4-9d1f-a2193853bd55 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:01.781326 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a9067-bd89-48f0-a949-1d2a7be8a025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:01.782051 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a9067-bd89-48f0-a949-1d2a7be8a025 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:01.782382 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a9067-bd89-48f0-a949-1d2a7be8a025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:01.782609 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a9067-bd89-48f0-a949-1d2a7be8a025 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:01.783294 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a9067-bd89-48f0-a949-1d2a7be8a025 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:01.785217 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a9067-bd89-48f0-a949-1d2a7be8a025 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:01.785352 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a735b7f8-900d-48bd-a4ec-0a21b5b02862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:01.785923 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735b7f8-900d-48bd-a4ec-0a21b5b02862 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:01.786200 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735b7f8-900d-48bd-a4ec-0a21b5b02862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:01.786469 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735b7f8-900d-48bd-a4ec-0a21b5b02862 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:01.787191 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a735b7f8-900d-48bd-a4ec-0a21b5b02862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:01.788779 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a735b7f8-900d-48bd-a4ec-0a21b5b02862 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:01.800054 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 796/1580] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:01.800891 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a735b7f8-900d-48bd-a4ec-0a21b5b02862 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:01.812379 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a735b7f8-900d-48bd-a4ec-0a21b5b02862 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:01.816516 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 785/1581] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:21:01 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:01.817348 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a9067-bd89-48f0-a949-1d2a7be8a025 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:01.821015 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c827ca-a2b9-43ee-80b7-40236c08a974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:01.821959 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c827ca-a2b9-43ee-80b7-40236c08a974 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:01.822236 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c827ca-a2b9-43ee-80b7-40236c08a974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:01.822502 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c827ca-a2b9-43ee-80b7-40236c08a974 admin admin] PATH_INFO: `/v3/projects/b0fd1bb99bbe4fb0aa43706dcf3bd5b0/users/984cd85471084641aa9781c55b7cff1b/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:01.841060 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c827ca-a2b9-43ee-80b7-40236c08a974 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0fd1bb99bbe4fb0aa43706dcf3bd5b0, user_id=984cd85471084641aa9781c55b7cff1b, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:01.842156 dv-cinder-797608-38-smb devstack@keystone.service[80135]: WARNING py.warnings [None req-75c827ca-a2b9-43ee-80b7-40236c08a974 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 29 12:21:01.842156 dv-cinder-797608-38-smb devstack@keystone.service[80135]: warnings.warn(msg) Jun 29 12:21:01.842156 dv-cinder-797608-38-smb devstack@keystone.service[80135]: Jun 29 12:21:01.844108 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c827ca-a2b9-43ee-80b7-40236c08a974 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:01.859413 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 797/1582] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:01 2022] PUT /identity/v3/projects/b0fd1bb99bbe4fb0aa43706dcf3bd5b0/users/984cd85471084641aa9781c55b7cff1b/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:01.860581 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c827ca-a2b9-43ee-80b7-40236c08a974 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:01.894252 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a9067-bd89-48f0-a949-1d2a7be8a025 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:01.899598 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:01.934136 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c827ca-a2b9-43ee-80b7-40236c08a974 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:01.939434 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34caae9-7649-4e89-99d1-d292a437a2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:01.940711 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34caae9-7649-4e89-99d1-d292a437a2bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:01.940986 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34caae9-7649-4e89-99d1-d292a437a2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:01.941286 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34caae9-7649-4e89-99d1-d292a437a2bb admin admin] PATH_INFO: `/v3/projects/dd94b52299d4428998033fcc17fd7bc6/users/f2f7f01eb34a486aa78320673c7f1c0d/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:01.955133 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa185d0-acd6-45b4-a2f6-279e42a2532d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:01.955810 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa185d0-acd6-45b4-a2f6-279e42a2532d admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:01.956092 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa185d0-acd6-45b4-a2f6-279e42a2532d admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:01.956365 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa185d0-acd6-45b4-a2f6-279e42a2532d admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:01.957130 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa185d0-acd6-45b4-a2f6-279e42a2532d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:01.957833 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34caae9-7649-4e89-99d1-d292a437a2bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd94b52299d4428998033fcc17fd7bc6, user_id=f2f7f01eb34a486aa78320673c7f1c0d, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:01.959085 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa185d0-acd6-45b4-a2f6-279e42a2532d admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:01.960532 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34caae9-7649-4e89-99d1-d292a437a2bb admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:01.980810 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 798/1583] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:01 2022] PUT /identity/v3/projects/dd94b52299d4428998033fcc17fd7bc6/users/f2f7f01eb34a486aa78320673c7f1c0d/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:01.981658 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34caae9-7649-4e89-99d1-d292a437a2bb admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:01.990952 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 786/1584] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:21:01 2022] POST /identity/v3/projects => generated 405 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:01.990952 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa185d0-acd6-45b4-a2f6-279e42a2532d admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:02.041402 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:02.054071 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34caae9-7649-4e89-99d1-d292a437a2bb admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:02.057198 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa185d0-acd6-45b4-a2f6-279e42a2532d admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:02.059866 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f9927-ffb0-4b79-acee-6209d51d1903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:02.060551 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f9927-ffb0-4b79-acee-6209d51d1903 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:02.060829 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f9927-ffb0-4b79-acee-6209d51d1903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:02.061103 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f9927-ffb0-4b79-acee-6209d51d1903 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:02.061873 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0f9927-ffb0-4b79-acee-6209d51d1903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:02.061986 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c1b75b-0177-4d76-aee7-0e8ebe0728d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:02.062606 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c1b75b-0177-4d76-aee7-0e8ebe0728d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:02.062885 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c1b75b-0177-4d76-aee7-0e8ebe0728d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:02.063155 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c1b75b-0177-4d76-aee7-0e8ebe0728d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:02.063492 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0f9927-ffb0-4b79-acee-6209d51d1903 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:02.063890 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c1b75b-0177-4d76-aee7-0e8ebe0728d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:02.065885 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c1b75b-0177-4d76-aee7-0e8ebe0728d8 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:02.074536 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 799/1585] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:02.075407 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f9927-ffb0-4b79-acee-6209d51d1903 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:02.076411 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 787/1586] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:02.077256 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c1b75b-0177-4d76-aee7-0e8ebe0728d8 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:02.087775 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c1b75b-0177-4d76-aee7-0e8ebe0728d8 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:02.091643 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f9927-ffb0-4b79-acee-6209d51d1903 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:02.092432 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4f030-2306-46ce-a177-3ea784f258d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:02.093106 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4f030-2306-46ce-a177-3ea784f258d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:02.093430 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4f030-2306-46ce-a177-3ea784f258d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:02.093648 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4f030-2306-46ce-a177-3ea784f258d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:02.094534 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad4f030-2306-46ce-a177-3ea784f258d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:02.096139 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad4f030-2306-46ce-a177-3ea784f258d4 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:02.096251 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd19ef-c7c7-42d3-8086-a4ad5b3f5f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:02.096913 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd19ef-c7c7-42d3-8086-a4ad5b3f5f99 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:02.097472 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd19ef-c7c7-42d3-8086-a4ad5b3f5f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:02.097779 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd19ef-c7c7-42d3-8086-a4ad5b3f5f99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:02.098510 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdd19ef-c7c7-42d3-8086-a4ad5b3f5f99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:02.100101 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdd19ef-c7c7-42d3-8086-a4ad5b3f5f99 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:02.107544 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 788/1587] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:02.108164 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4f030-2306-46ce-a177-3ea784f258d4 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:02.114748 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 800/1588] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:02.115913 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bafe35-d7aa-4e88-b17b-c728c99ec42b None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:02.116260 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bafe35-d7aa-4e88-b17b-c728c99ec42b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:02.116597 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bafe35-d7aa-4e88-b17b-c728c99ec42b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:02.120983 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4f030-2306-46ce-a177-3ea784f258d4 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:02.125682 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033607f-7b88-4518-857a-21f3298932dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:02.126394 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033607f-7b88-4518-857a-21f3298932dd admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:02.126671 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033607f-7b88-4518-857a-21f3298932dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:02.126943 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033607f-7b88-4518-857a-21f3298932dd admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:02.127638 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e033607f-7b88-4518-857a-21f3298932dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:02.129563 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e033607f-7b88-4518-857a-21f3298932dd admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:02.147364 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-42bafe35-d7aa-4e88-b17b-c728c99ec42b None None] MFA Rules not processed for user `984cd85471084641aa9781c55b7cff1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:02.148996 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-42bafe35-d7aa-4e88-b17b-c728c99ec42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:02.155504 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 789/1589] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:21:02 2022] POST /identity/v3/users => generated 286 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:02.155504 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38784b63-7bd8-452f-863f-a8453fb32831 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:02.155504 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38784b63-7bd8-452f-863f-a8453fb32831 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:02.155504 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38784b63-7bd8-452f-863f-a8453fb32831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:02.171943 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-38784b63-7bd8-452f-863f-a8453fb32831 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:02.173180 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-38784b63-7bd8-452f-863f-a8453fb32831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:02.181338 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 790/1590] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:02.182246 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38784b63-7bd8-452f-863f-a8453fb32831 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:02.192294 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38784b63-7bd8-452f-863f-a8453fb32831 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:02.197535 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c935b-ff62-4774-bb2b-2e1095fffb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:02.198388 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c935b-ff62-4774-bb2b-2e1095fffb81 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:02.198671 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c935b-ff62-4774-bb2b-2e1095fffb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:02.198977 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c935b-ff62-4774-bb2b-2e1095fffb81 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:02.199640 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9c935b-ff62-4774-bb2b-2e1095fffb81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:02.201640 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9c935b-ff62-4774-bb2b-2e1095fffb81 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:02.224509 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 791/1591] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:21:02 2022] POST /identity/v3/users => generated 303 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:02.224987 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 801/1592] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:02.225509 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c935b-ff62-4774-bb2b-2e1095fffb81 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:02.226194 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bafe35-d7aa-4e88-b17b-c728c99ec42b None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:02.237768 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c935b-ff62-4774-bb2b-2e1095fffb81 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:02.237992 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bafe35-d7aa-4e88-b17b-c728c99ec42b None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:02.242667 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62accf67-64c3-4e14-9aa9-5c7b29f7e0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:02.243256 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62accf67-64c3-4e14-9aa9-5c7b29f7e0c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:02.243392 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3874e889-e372-44c9-8ff7-041ef33ef6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:02.243554 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62accf67-64c3-4e14-9aa9-5c7b29f7e0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:02.243828 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62accf67-64c3-4e14-9aa9-5c7b29f7e0c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:02.244047 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874e889-e372-44c9-8ff7-041ef33ef6c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:02.244327 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874e889-e372-44c9-8ff7-041ef33ef6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:02.244557 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62accf67-64c3-4e14-9aa9-5c7b29f7e0c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:02.244675 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874e889-e372-44c9-8ff7-041ef33ef6c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:02.245488 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3874e889-e372-44c9-8ff7-041ef33ef6c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:02.246227 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62accf67-64c3-4e14-9aa9-5c7b29f7e0c5 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:02.247130 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3874e889-e372-44c9-8ff7-041ef33ef6c6 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:02.257547 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 802/1593] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:02.259063 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62accf67-64c3-4e14-9aa9-5c7b29f7e0c5 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:02.259445 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 792/1594] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:02.260252 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3874e889-e372-44c9-8ff7-041ef33ef6c6 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:02.271118 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62accf67-64c3-4e14-9aa9-5c7b29f7e0c5 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:02.271589 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3874e889-e372-44c9-8ff7-041ef33ef6c6 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:02.276251 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e593da-8c6f-4513-ae74-9af4084e003d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:02.277213 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e593da-8c6f-4513-ae74-9af4084e003d admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:02.277336 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dfd4c9-ddd9-43d4-8c34-5cb939fe30ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:02.277487 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e593da-8c6f-4513-ae74-9af4084e003d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:02.277911 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e593da-8c6f-4513-ae74-9af4084e003d admin admin] PATH_INFO: `/v3/projects/7cbe808881a9478eb25bff42d03289c8/users/6ec17bc9af1e497590bf0ac31f29d463/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:02.278015 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dfd4c9-ddd9-43d4-8c34-5cb939fe30ce admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:02.278241 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dfd4c9-ddd9-43d4-8c34-5cb939fe30ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:02.278509 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dfd4c9-ddd9-43d4-8c34-5cb939fe30ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:02.279247 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dfd4c9-ddd9-43d4-8c34-5cb939fe30ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:02.280871 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dfd4c9-ddd9-43d4-8c34-5cb939fe30ce admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:02.296088 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 793/1595] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:02.296296 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e593da-8c6f-4513-ae74-9af4084e003d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cbe808881a9478eb25bff42d03289c8, user_id=6ec17bc9af1e497590bf0ac31f29d463, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:02.296413 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dfd4c9-ddd9-43d4-8c34-5cb939fe30ce admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:02.296764 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e593da-8c6f-4513-ae74-9af4084e003d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:02.304849 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dfd4c9-ddd9-43d4-8c34-5cb939fe30ce admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:02.312904 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 803/1596] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:02 2022] PUT /identity/v3/projects/7cbe808881a9478eb25bff42d03289c8/users/6ec17bc9af1e497590bf0ac31f29d463/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:02.313736 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e593da-8c6f-4513-ae74-9af4084e003d admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:02.315685 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-39e593da-8c6f-4513-ae74-9af4084e003d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:02.319209 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:02.371702 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94252f1c-c716-4144-9d44-687ff2189d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:02.372421 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94252f1c-c716-4144-9d44-687ff2189d7d admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:02.372873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94252f1c-c716-4144-9d44-687ff2189d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:02.373152 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94252f1c-c716-4144-9d44-687ff2189d7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:02.374113 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94252f1c-c716-4144-9d44-687ff2189d7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:02.375763 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94252f1c-c716-4144-9d44-687ff2189d7d admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:02.377184 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e593da-8c6f-4513-ae74-9af4084e003d admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:02.380941 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f4b49-b7b4-4036-9819-488f998dce28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:02.381747 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f4b49-b7b4-4036-9819-488f998dce28 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:02.382034 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f4b49-b7b4-4036-9819-488f998dce28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:02.382329 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f4b49-b7b4-4036-9819-488f998dce28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:02.386998 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 794/1597] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:02.391008 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94252f1c-c716-4144-9d44-687ff2189d7d admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:02.392951 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871f4b49-b7b4-4036-9819-488f998dce28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:02.394480 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871f4b49-b7b4-4036-9819-488f998dce28 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:02.401645 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94252f1c-c716-4144-9d44-687ff2189d7d admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:02.405389 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 804/1598] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:02.406365 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f4b49-b7b4-4036-9819-488f998dce28 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:02.406965 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc3841-7c74-4778-b1b8-efc1d7a371a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:02.407818 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc3841-7c74-4778-b1b8-efc1d7a371a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:02.408284 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc3841-7c74-4778-b1b8-efc1d7a371a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:02.408702 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc3841-7c74-4778-b1b8-efc1d7a371a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:02.409613 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc3841-7c74-4778-b1b8-efc1d7a371a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:02.411609 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc3841-7c74-4778-b1b8-efc1d7a371a6 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:02.417610 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f4b49-b7b4-4036-9819-488f998dce28 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:02.422779 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9971f113-1721-4a83-8e2c-8085b53ad289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:02.423447 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971f113-1721-4a83-8e2c-8085b53ad289 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:02.423724 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971f113-1721-4a83-8e2c-8085b53ad289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:02.423995 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971f113-1721-4a83-8e2c-8085b53ad289 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:02.424369 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 795/1599] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:02.424691 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9971f113-1721-4a83-8e2c-8085b53ad289 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:02.425635 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc3841-7c74-4778-b1b8-efc1d7a371a6 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:02.426660 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9971f113-1721-4a83-8e2c-8085b53ad289 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:02.438709 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc3841-7c74-4778-b1b8-efc1d7a371a6 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:02.444871 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f889e5-b9c2-4d1e-975b-d221a4b32172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:02.445934 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f889e5-b9c2-4d1e-975b-d221a4b32172 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:02.446258 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f889e5-b9c2-4d1e-975b-d221a4b32172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:02.446500 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f889e5-b9c2-4d1e-975b-d221a4b32172 admin admin] PATH_INFO: `/v3/projects/0abb97c22af04eb1b3f1d5ccc1f56edd/users/9448b965d23b45b6935a54e7acbaf2c6/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:02.458907 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 805/1600] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:21:02 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:02.463166 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9971f113-1721-4a83-8e2c-8085b53ad289 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:02.466718 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f889e5-b9c2-4d1e-975b-d221a4b32172 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0abb97c22af04eb1b3f1d5ccc1f56edd, user_id=9448b965d23b45b6935a54e7acbaf2c6, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:02.470104 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f889e5-b9c2-4d1e-975b-d221a4b32172 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:02.479908 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:02.492315 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 796/1601] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:02 2022] PUT /identity/v3/projects/0abb97c22af04eb1b3f1d5ccc1f56edd/users/9448b965d23b45b6935a54e7acbaf2c6/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:02.504416 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f889e5-b9c2-4d1e-975b-d221a4b32172 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:02.567649 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9971f113-1721-4a83-8e2c-8085b53ad289 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:02.582475 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f889e5-b9c2-4d1e-975b-d221a4b32172 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:02.588344 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ca4535-1e3b-4d2d-994f-ce058b5fc7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:02.589043 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca4535-1e3b-4d2d-994f-ce058b5fc7a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:02.589324 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca4535-1e3b-4d2d-994f-ce058b5fc7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:02.589598 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca4535-1e3b-4d2d-994f-ce058b5fc7a6 admin admin] PATH_INFO: `/v3/projects/96c6f7e7766345e58b04cb189eba3546/users/7474cc3e00ea4caf86833b02751cb932/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:02.609737 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ca4535-1e3b-4d2d-994f-ce058b5fc7a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96c6f7e7766345e58b04cb189eba3546, user_id=7474cc3e00ea4caf86833b02751cb932, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:02.612558 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ca4535-1e3b-4d2d-994f-ce058b5fc7a6 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:02.628698 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 797/1602] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:02 2022] PUT /identity/v3/projects/96c6f7e7766345e58b04cb189eba3546/users/7474cc3e00ea4caf86833b02751cb932/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:02.630277 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804566e-5a52-47a7-8f4f-2ae9e3ef709a None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:02.630565 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804566e-5a52-47a7-8f4f-2ae9e3ef709a None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:02.630847 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804566e-5a52-47a7-8f4f-2ae9e3ef709a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:02.656568 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb97b95-9567-42da-98ab-eb50b803af1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:02.657982 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb97b95-9567-42da-98ab-eb50b803af1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:02.658305 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb97b95-9567-42da-98ab-eb50b803af1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:02.658627 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb97b95-9567-42da-98ab-eb50b803af1e admin admin] PATH_INFO: `/v3/projects/f3656fbaf50a4b0db834734cd8350a74/users/b83b4edd5b5a43678e3085f403be1c27/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:02.663617 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-8804566e-5a52-47a7-8f4f-2ae9e3ef709a None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:02.665388 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-8804566e-5a52-47a7-8f4f-2ae9e3ef709a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:02.677387 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb97b95-9567-42da-98ab-eb50b803af1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3656fbaf50a4b0db834734cd8350a74, user_id=b83b4edd5b5a43678e3085f403be1c27, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:02.680283 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb97b95-9567-42da-98ab-eb50b803af1e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:02.699006 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 806/1603] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:02 2022] PUT /identity/v3/projects/f3656fbaf50a4b0db834734cd8350a74/users/b83b4edd5b5a43678e3085f403be1c27/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:02.703409 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb97b95-9567-42da-98ab-eb50b803af1e admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:02.736231 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:02.750710 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 798/1604] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:02.751537 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8804566e-5a52-47a7-8f4f-2ae9e3ef709a None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:02.762967 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8804566e-5a52-47a7-8f4f-2ae9e3ef709a None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:02.790466 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb97b95-9567-42da-98ab-eb50b803af1e admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:02.795917 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb03f6-a2df-4abd-b9d2-813228047782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:02.796756 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb03f6-a2df-4abd-b9d2-813228047782 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:02.797325 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb03f6-a2df-4abd-b9d2-813228047782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:02.797978 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb03f6-a2df-4abd-b9d2-813228047782 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:02.798988 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfb03f6-a2df-4abd-b9d2-813228047782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:02.800980 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfb03f6-a2df-4abd-b9d2-813228047782 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:02.813363 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 807/1605] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:02.814459 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb03f6-a2df-4abd-b9d2-813228047782 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:02.827449 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb03f6-a2df-4abd-b9d2-813228047782 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:02.832709 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27666bef-f146-48ee-a513-2343c3b119c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:02.833545 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27666bef-f146-48ee-a513-2343c3b119c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:02.833976 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27666bef-f146-48ee-a513-2343c3b119c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:02.834400 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27666bef-f146-48ee-a513-2343c3b119c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:02.835214 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27666bef-f146-48ee-a513-2343c3b119c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:02.837415 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27666bef-f146-48ee-a513-2343c3b119c1 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:02.872659 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 808/1606] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:21:02 2022] POST /identity/v3/users => generated 292 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:02.874357 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb01323-3704-4b69-a7ca-d3df158759ae None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:02.874718 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb01323-3704-4b69-a7ca-d3df158759ae None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:02.875064 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb01323-3704-4b69-a7ca-d3df158759ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:02.893413 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0218428-9d43-4678-8a6c-e06019c3a528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:02.894167 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0218428-9d43-4678-8a6c-e06019c3a528 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:02.894455 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0218428-9d43-4678-8a6c-e06019c3a528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:02.894771 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0218428-9d43-4678-8a6c-e06019c3a528 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:02.895477 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0218428-9d43-4678-8a6c-e06019c3a528 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:02.897115 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0218428-9d43-4678-8a6c-e06019c3a528 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:02.910674 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-dbb01323-3704-4b69-a7ca-d3df158759ae None None] MFA Rules not processed for user `9448b965d23b45b6935a54e7acbaf2c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:02.912235 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-dbb01323-3704-4b69-a7ca-d3df158759ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:02.921169 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 799/1607] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:02.923098 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db383c-dfc3-42ac-bb57-280dc2eb2bac None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:02.923384 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db383c-dfc3-42ac-bb57-280dc2eb2bac None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:02.923661 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db383c-dfc3-42ac-bb57-280dc2eb2bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:02.933106 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:02.966697 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-a9db383c-dfc3-42ac-bb57-280dc2eb2bac None None] MFA Rules not processed for user `7474cc3e00ea4caf86833b02751cb932`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:02.968639 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a9db383c-dfc3-42ac-bb57-280dc2eb2bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:03.060362 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 809/1608] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:02 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:03.060362 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dac8e4-362e-4bff-9de0-80a2f270e21e None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:03.060362 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dac8e4-362e-4bff-9de0-80a2f270e21e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:03.062620 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dac8e4-362e-4bff-9de0-80a2f270e21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:03.078957 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 800/1609] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:03.081265 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9db383c-dfc3-42ac-bb57-280dc2eb2bac None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:03.102947 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f1dac8e4-362e-4bff-9de0-80a2f270e21e None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:03.105629 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f1dac8e4-362e-4bff-9de0-80a2f270e21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:03.125871 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 810/1610] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:03.132049 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dac8e4-362e-4bff-9de0-80a2f270e21e None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:03.149874 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dac8e4-362e-4bff-9de0-80a2f270e21e None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:03.156785 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9db383c-dfc3-42ac-bb57-280dc2eb2bac None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:03.158986 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a0a27-24f0-4de0-916a-e7f96e29eeaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:03.160533 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a0a27-24f0-4de0-916a-e7f96e29eeaa admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:03.161135 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a0a27-24f0-4de0-916a-e7f96e29eeaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:03.161527 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a0a27-24f0-4de0-916a-e7f96e29eeaa admin admin] PATH_INFO: `/v3/projects/a9ce2678fd0d4657a4fa18a402959945/users/d98d4b95c74e412bacc2463c76a0bc05/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:03.164382 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be457642-b4fd-42d4-8910-83dc466e1998 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:03.166324 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be457642-b4fd-42d4-8910-83dc466e1998 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:03.166920 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be457642-b4fd-42d4-8910-83dc466e1998 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:03.167466 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be457642-b4fd-42d4-8910-83dc466e1998 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:03.178283 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be457642-b4fd-42d4-8910-83dc466e1998 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:03.179788 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be457642-b4fd-42d4-8910-83dc466e1998 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:03.189830 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2a0a27-24f0-4de0-916a-e7f96e29eeaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9ce2678fd0d4657a4fa18a402959945, user_id=d98d4b95c74e412bacc2463c76a0bc05, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:03.194027 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 801/1611] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:03.194968 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be457642-b4fd-42d4-8910-83dc466e1998 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:03.196171 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2a0a27-24f0-4de0-916a-e7f96e29eeaa admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:03.208212 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be457642-b4fd-42d4-8910-83dc466e1998 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:03.213771 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af1db46-a8dd-4860-9d14-de0b8c39e231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:03.214514 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af1db46-a8dd-4860-9d14-de0b8c39e231 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:03.214809 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af1db46-a8dd-4860-9d14-de0b8c39e231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:03.215210 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af1db46-a8dd-4860-9d14-de0b8c39e231 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:03.216363 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af1db46-a8dd-4860-9d14-de0b8c39e231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:03.218022 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af1db46-a8dd-4860-9d14-de0b8c39e231 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:03.225597 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 811/1612] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:03 2022] PUT /identity/v3/projects/a9ce2678fd0d4657a4fa18a402959945/users/d98d4b95c74e412bacc2463c76a0bc05/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:03.236082 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 802/1613] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:03.236082 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af1db46-a8dd-4860-9d14-de0b8c39e231 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:03.236394 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a0a27-24f0-4de0-916a-e7f96e29eeaa admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:03.252273 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af1db46-a8dd-4860-9d14-de0b8c39e231 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:03.275977 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:03.347938 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a412997-b8b5-4c1f-b89b-87a3d481d4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:03.350796 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a412997-b8b5-4c1f-b89b-87a3d481d4cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:03.352402 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a412997-b8b5-4c1f-b89b-87a3d481d4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:03.353027 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a412997-b8b5-4c1f-b89b-87a3d481d4cc admin admin] PATH_INFO: `/v3/projects/80d8f68d6a464db6b7aedb1714c32894/users/6d7899f68b474e24b0c49f6b800fa093/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:03.359634 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a0a27-24f0-4de0-916a-e7f96e29eeaa admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:03.366883 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc2ee1-5003-42e6-be8c-f2633c2aee1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:03.370796 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc2ee1-5003-42e6-be8c-f2633c2aee1b admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:03.370796 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc2ee1-5003-42e6-be8c-f2633c2aee1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:03.371105 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc2ee1-5003-42e6-be8c-f2633c2aee1b admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:03.372999 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cc2ee1-5003-42e6-be8c-f2633c2aee1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:03.376442 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cc2ee1-5003-42e6-be8c-f2633c2aee1b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:03.385042 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a412997-b8b5-4c1f-b89b-87a3d481d4cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=80d8f68d6a464db6b7aedb1714c32894, user_id=6d7899f68b474e24b0c49f6b800fa093, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:03.388684 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a412997-b8b5-4c1f-b89b-87a3d481d4cc admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:03.412863 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 812/1615] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:21:03 2022] POST /identity/v3/projects => generated 403 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:03.415637 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf99a8a-47f9-4e6f-9597-bced6fc6b35a None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:03.415977 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf99a8a-47f9-4e6f-9597-bced6fc6b35a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:03.416259 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf99a8a-47f9-4e6f-9597-bced6fc6b35a None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:03.417287 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 803/1615] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:03 2022] PUT /identity/v3/projects/80d8f68d6a464db6b7aedb1714c32894/users/6d7899f68b474e24b0c49f6b800fa093/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:03.418364 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a412997-b8b5-4c1f-b89b-87a3d481d4cc admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:03.418525 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 813/1616] 10.222.0.27 () {54 vars in 961 bytes} [Wed Jun 29 12:21:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:21:03.419394 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf99a8a-47f9-4e6f-9597-bced6fc6b35a None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:03.490168 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a412997-b8b5-4c1f-b89b-87a3d481d4cc admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:03.496591 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf99a8a-47f9-4e6f-9597-bced6fc6b35a None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:03.502181 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5d4ac1-a9a0-434e-a7ad-a3e06d4b8862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:03.503110 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d4ac1-a9a0-434e-a7ad-a3e06d4b8862 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:03.503384 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d4ac1-a9a0-434e-a7ad-a3e06d4b8862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:03.503827 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d4ac1-a9a0-434e-a7ad-a3e06d4b8862 admin admin] PATH_INFO: `/v3/projects/d4e5676971d941c0b915ed8c20b11741/users/11745917dd6244009d6c61f0e39ed703/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:03.514031 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:03.522447 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5d4ac1-a9a0-434e-a7ad-a3e06d4b8862 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4e5676971d941c0b915ed8c20b11741, user_id=11745917dd6244009d6c61f0e39ed703, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:03.526615 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5d4ac1-a9a0-434e-a7ad-a3e06d4b8862 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:03.548817 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 814/1617] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:03 2022] PUT /identity/v3/projects/d4e5676971d941c0b915ed8c20b11741/users/11745917dd6244009d6c61f0e39ed703/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:03.553779 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5eaaf-0ec4-440a-b4bb-b9a2587ebb66 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:03.554173 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5eaaf-0ec4-440a-b4bb-b9a2587ebb66 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:03.554653 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5eaaf-0ec4-440a-b4bb-b9a2587ebb66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:03.571960 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c941b7-7223-469a-b40c-895571c80f35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:03.573584 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c941b7-7223-469a-b40c-895571c80f35 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:03.573896 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c941b7-7223-469a-b40c-895571c80f35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:03.574165 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c941b7-7223-469a-b40c-895571c80f35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:03.591585 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c941b7-7223-469a-b40c-895571c80f35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:03.591863 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-aaa5eaaf-0ec4-440a-b4bb-b9a2587ebb66 None None] MFA Rules not processed for user `d98d4b95c74e412bacc2463c76a0bc05`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:03.593176 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-aaa5eaaf-0ec4-440a-b4bb-b9a2587ebb66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:03.596473 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c941b7-7223-469a-b40c-895571c80f35 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:03.615834 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 804/1618] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:03.618263 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf6f93-bc27-4b99-93bb-8e0fae1aa79f None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:03.618879 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf6f93-bc27-4b99-93bb-8e0fae1aa79f None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:03.619230 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf6f93-bc27-4b99-93bb-8e0fae1aa79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:03.642792 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-c8bf6f93-bc27-4b99-93bb-8e0fae1aa79f None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:03.644066 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-c8bf6f93-bc27-4b99-93bb-8e0fae1aa79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:03.742463 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:03.769382 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 815/1619] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:03.770608 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5eaaf-0ec4-440a-b4bb-b9a2587ebb66 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:03.782766 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 805/1620] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:03.784490 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5eaaf-0ec4-440a-b4bb-b9a2587ebb66 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:03.785572 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeaf096-e776-45b5-a45e-5e5016b64d73 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:03.786176 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeaf096-e776-45b5-a45e-5e5016b64d73 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:03.786636 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeaf096-e776-45b5-a45e-5e5016b64d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:03.793830 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab0ff52-9956-47e2-9de3-ee1ab60ac3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:03.794914 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0ff52-9956-47e2-9de3-ee1ab60ac3d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:03.795368 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0ff52-9956-47e2-9de3-ee1ab60ac3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:03.796280 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0ff52-9956-47e2-9de3-ee1ab60ac3d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:03.797308 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab0ff52-9956-47e2-9de3-ee1ab60ac3d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:03.799922 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab0ff52-9956-47e2-9de3-ee1ab60ac3d7 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:03.821937 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-dbeaf096-e776-45b5-a45e-5e5016b64d73 None None] MFA Rules not processed for user `7adaa2ef440941aa8214f2b2fd49b54e`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:03.824057 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-dbeaf096-e776-45b5-a45e-5e5016b64d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:03.832038 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 816/1621] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:21:03 2022] POST /identity/v3/users => generated 308 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:03.833014 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab0ff52-9956-47e2-9de3-ee1ab60ac3d7 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:03.863617 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab0ff52-9956-47e2-9de3-ee1ab60ac3d7 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:03.869394 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7837045-142a-4ded-bc7c-83604dafd9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:03.870228 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7837045-142a-4ded-bc7c-83604dafd9b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:03.870579 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7837045-142a-4ded-bc7c-83604dafd9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:03.870942 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7837045-142a-4ded-bc7c-83604dafd9b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:03.872002 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7837045-142a-4ded-bc7c-83604dafd9b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:03.873981 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7837045-142a-4ded-bc7c-83604dafd9b6 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:03.889519 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 817/1622] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:03.891284 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9381f-834d-49eb-9f1c-eb21bb9f2675 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:03.891800 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9381f-834d-49eb-9f1c-eb21bb9f2675 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:03.892146 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9381f-834d-49eb-9f1c-eb21bb9f2675 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:03.894911 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 818/1623] 10.222.0.27 () {54 vars in 961 bytes} [Wed Jun 29 12:21:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:21:03.895802 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf9381f-834d-49eb-9f1c-eb21bb9f2675 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:03.910055 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf9381f-834d-49eb-9f1c-eb21bb9f2675 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:03.916594 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dce955-876a-4f1a-aa94-ece89e7d0324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:03.917493 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dce955-876a-4f1a-aa94-ece89e7d0324 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:03.918001 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dce955-876a-4f1a-aa94-ece89e7d0324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:03.918420 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dce955-876a-4f1a-aa94-ece89e7d0324 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:03.919241 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dce955-876a-4f1a-aa94-ece89e7d0324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:03.921465 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dce955-876a-4f1a-aa94-ece89e7d0324 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:03.937465 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 819/1624] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:03.938492 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dce955-876a-4f1a-aa94-ece89e7d0324 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:03.950235 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 806/1625] 10.222.0.27 () {58 vars in 1058 bytes} [Wed Jun 29 12:21:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:03.952214 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd79e7-c8fa-4a3d-90dd-945fe25b1e13 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:03.952607 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd79e7-c8fa-4a3d-90dd-945fe25b1e13 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:03.953091 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd79e7-c8fa-4a3d-90dd-945fe25b1e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:03.954914 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dce955-876a-4f1a-aa94-ece89e7d0324 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:03.961243 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b1921-e1fb-4973-8c73-4067d7e3e25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:03.962321 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b1921-e1fb-4973-8c73-4067d7e3e25d admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:03.962633 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b1921-e1fb-4973-8c73-4067d7e3e25d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:03.962892 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b1921-e1fb-4973-8c73-4067d7e3e25d admin admin] PATH_INFO: `/v3/projects/d4e5676971d941c0b915ed8c20b11741/users/11745917dd6244009d6c61f0e39ed703/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:03.965063 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3b1921-e1fb-4973-8c73-4067d7e3e25d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4e5676971d941c0b915ed8c20b11741, user_id=11745917dd6244009d6c61f0e39ed703, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:03.968199 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3b1921-e1fb-4973-8c73-4067d7e3e25d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:03.984269 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-1dcd79e7-c8fa-4a3d-90dd-945fe25b1e13 None None] MFA Rules not processed for user `7adaa2ef440941aa8214f2b2fd49b54e`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:03.985507 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-1dcd79e7-c8fa-4a3d-90dd-945fe25b1e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:03.990389 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 820/1626] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:03 2022] PUT /identity/v3/projects/d4e5676971d941c0b915ed8c20b11741/users/11745917dd6244009d6c61f0e39ed703/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:03.991299 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b1921-e1fb-4973-8c73-4067d7e3e25d admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:04.077223 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b1921-e1fb-4973-8c73-4067d7e3e25d admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:04.082895 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc84b25-16e3-4bf1-8315-15acd575a3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:04.083959 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc84b25-16e3-4bf1-8315-15acd575a3d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:04.084241 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc84b25-16e3-4bf1-8315-15acd575a3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:04.084511 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc84b25-16e3-4bf1-8315-15acd575a3d2 admin admin] PATH_INFO: `/v3/projects/0b3b0ac9635a42f8b12071cdb0760195/users/78fb8d3cc4014b2d91bee5a61a67f5ea/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:04.103486 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc84b25-16e3-4bf1-8315-15acd575a3d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b3b0ac9635a42f8b12071cdb0760195, user_id=78fb8d3cc4014b2d91bee5a61a67f5ea, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:04.106623 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc84b25-16e3-4bf1-8315-15acd575a3d2 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:04.135266 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 821/1627] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:03 2022] PUT /identity/v3/projects/0b3b0ac9635a42f8b12071cdb0760195/users/78fb8d3cc4014b2d91bee5a61a67f5ea/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:04.135266 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc84b25-16e3-4bf1-8315-15acd575a3d2 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:04.148695 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:04.236717 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 807/1628] 10.222.0.27 () {58 vars in 1058 bytes} [Wed Jun 29 12:21:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:04.238550 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd79e7-c8fa-4a3d-90dd-945fe25b1e13 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:04.285220 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc84b25-16e3-4bf1-8315-15acd575a3d2 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:04.307565 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba807b-2d76-4ae2-b9af-3283d01ada87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7adaa2ef440941aa8214f2b2fd49b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:04.308868 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba807b-2d76-4ae2-b9af-3283d01ada87 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:04.309741 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba807b-2d76-4ae2-b9af-3283d01ada87 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:04.309952 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba807b-2d76-4ae2-b9af-3283d01ada87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:04.394088 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd79e7-c8fa-4a3d-90dd-945fe25b1e13 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:04.455101 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba807b-2d76-4ae2-b9af-3283d01ada87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:04.456795 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba807b-2d76-4ae2-b9af-3283d01ada87 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:04.475221 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 822/1629] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:04.480424 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:04.490470 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb23fd-54ac-4774-90c4-b4b925505de0 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:04.493748 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb23fd-54ac-4774-90c4-b4b925505de0 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:04.494208 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb23fd-54ac-4774-90c4-b4b925505de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:04.507738 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d7789-83e6-4508-8c33-c6237b06ee09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:04.509172 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d7789-83e6-4508-8c33-c6237b06ee09 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:04.510916 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d7789-83e6-4508-8c33-c6237b06ee09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:04.511547 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d7789-83e6-4508-8c33-c6237b06ee09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:04.594015 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-7dbb23fd-54ac-4774-90c4-b4b925505de0 None None] MFA Rules not processed for user `11745917dd6244009d6c61f0e39ed703`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:04.598366 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7dbb23fd-54ac-4774-90c4-b4b925505de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:04.701129 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643d7789-83e6-4508-8c33-c6237b06ee09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:04.704421 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643d7789-83e6-4508-8c33-c6237b06ee09 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:04.727743 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 808/1630] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:04.729250 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d7789-83e6-4508-8c33-c6237b06ee09 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:04.748874 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d7789-83e6-4508-8c33-c6237b06ee09 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:04.760125 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd0074-62ff-451f-989a-ce9cf092466e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:04.760125 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd0074-62ff-451f-989a-ce9cf092466e admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:04.760526 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd0074-62ff-451f-989a-ce9cf092466e admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:04.760927 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd0074-62ff-451f-989a-ce9cf092466e admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:04.762445 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fd0074-62ff-451f-989a-ce9cf092466e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:04.765902 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fd0074-62ff-451f-989a-ce9cf092466e admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:04.792896 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 809/1631] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:04.792896 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd0074-62ff-451f-989a-ce9cf092466e admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:04.818257 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd0074-62ff-451f-989a-ce9cf092466e admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:04.832822 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54605394-f79a-4274-abff-ddc871c824d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7adaa2ef440941aa8214f2b2fd49b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:04.834217 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54605394-f79a-4274-abff-ddc871c824d1 service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:04.834799 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54605394-f79a-4274-abff-ddc871c824d1 service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:04.835370 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54605394-f79a-4274-abff-ddc871c824d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:04.835907 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 823/1632] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:04 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:04.837465 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbb23fd-54ac-4774-90c4-b4b925505de0 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:04.892545 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbb23fd-54ac-4774-90c4-b4b925505de0 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:04.901941 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c234bdea-d23a-4e31-9afa-a64082b5401a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:04.903432 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234bdea-d23a-4e31-9afa-a64082b5401a admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:04.903897 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234bdea-d23a-4e31-9afa-a64082b5401a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:04.904372 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234bdea-d23a-4e31-9afa-a64082b5401a admin admin] PATH_INFO: `/v3/projects/0b3b0ac9635a42f8b12071cdb0760195/users/78fb8d3cc4014b2d91bee5a61a67f5ea/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:04.920128 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c234bdea-d23a-4e31-9afa-a64082b5401a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b3b0ac9635a42f8b12071cdb0760195, user_id=78fb8d3cc4014b2d91bee5a61a67f5ea, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:04.925041 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c234bdea-d23a-4e31-9afa-a64082b5401a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:04.949777 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 824/1633] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:04 2022] PUT /identity/v3/projects/0b3b0ac9635a42f8b12071cdb0760195/users/78fb8d3cc4014b2d91bee5a61a67f5ea/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:04.949777 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c234bdea-d23a-4e31-9afa-a64082b5401a admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:04.996015 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54605394-f79a-4274-abff-ddc871c824d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:04.999118 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54605394-f79a-4274-abff-ddc871c824d1 service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:05.009568 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:05.038403 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 810/1634] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:05.052094 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0bb30-ff88-4528-937a-dbe7077b2583 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:05.052094 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0bb30-ff88-4528-937a-dbe7077b2583 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:05.052094 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0bb30-ff88-4528-937a-dbe7077b2583 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:05.054187 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 811/1635] 10.222.0.27 () {54 vars in 912 bytes} [Wed Jun 29 12:21:05 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:21:05.058710 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e27ab-9f92-4714-8d64-e9798ad2b4dd None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:05.060728 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e27ab-9f92-4714-8d64-e9798ad2b4dd None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:05.061217 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e27ab-9f92-4714-8d64-e9798ad2b4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:05.166237 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-809e27ab-9f92-4714-8d64-e9798ad2b4dd None None] MFA Rules not processed for user `78fb8d3cc4014b2d91bee5a61a67f5ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:05.169875 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-809e27ab-9f92-4714-8d64-e9798ad2b4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:05.174556 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c234bdea-d23a-4e31-9afa-a64082b5401a admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:05.188973 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d88f1-9ba9-443d-b6f7-775690b5a627 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:05.191530 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d88f1-9ba9-443d-b6f7-775690b5a627 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:05.202571 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d88f1-9ba9-443d-b6f7-775690b5a627 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:05.203085 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d88f1-9ba9-443d-b6f7-775690b5a627 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:05.296811 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 812/1636] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:05 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:05.296811 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a3d8a-41f4-4ac4-bf4c-abcb5d4e0674 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:05.296811 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a3d8a-41f4-4ac4-bf4c-abcb5d4e0674 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:05.296811 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a3d8a-41f4-4ac4-bf4c-abcb5d4e0674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:05.305873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:05.322955 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-d32a3d8a-41f4-4ac4-bf4c-abcb5d4e0674 None None] MFA Rules not processed for user `7adaa2ef440941aa8214f2b2fd49b54e`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:05.324600 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-d32a3d8a-41f4-4ac4-bf4c-abcb5d4e0674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:05.426087 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 813/1637] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Jun 29 12:21:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:05.426715 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a3d8a-41f4-4ac4-bf4c-abcb5d4e0674 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:05.428272 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68d88f1-9ba9-443d-b6f7-775690b5a627 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:05.431761 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68d88f1-9ba9-443d-b6f7-775690b5a627 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:05.438071 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a3d8a-41f4-4ac4-bf4c-abcb5d4e0674 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:05.442395 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b7213-b5d6-4880-a1c5-af3cf09ec56e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:05.443198 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b7213-b5d6-4880-a1c5-af3cf09ec56e service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:05.443486 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b7213-b5d6-4880-a1c5-af3cf09ec56e service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:05.444010 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b7213-b5d6-4880-a1c5-af3cf09ec56e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:05.455825 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0b7213-b5d6-4880-a1c5-af3cf09ec56e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:05.457390 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0b7213-b5d6-4880-a1c5-af3cf09ec56e service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:05.469265 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 825/1638] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:04 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:05.469795 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 814/1639] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:05 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:05.515867 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e802b-7e27-472f-afc8-0236867a7d6b None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:05.516769 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e802b-7e27-472f-afc8-0236867a7d6b None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:05.517052 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e802b-7e27-472f-afc8-0236867a7d6b None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:05.519438 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 815/1640] 10.222.0.27 () {54 vars in 912 bytes} [Wed Jun 29 12:21:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:21:05.526047 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a692736-9109-420b-b32a-63cd8e6d57de None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:05.528088 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a692736-9109-420b-b32a-63cd8e6d57de None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:05.528658 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a692736-9109-420b-b32a-63cd8e6d57de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:05.557357 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e802b-7e27-472f-afc8-0236867a7d6b None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:05.569656 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-4a692736-9109-420b-b32a-63cd8e6d57de None None] MFA Rules not processed for user `7adaa2ef440941aa8214f2b2fd49b54e`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:05.571236 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4a692736-9109-420b-b32a-63cd8e6d57de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:05.585291 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e802b-7e27-472f-afc8-0236867a7d6b None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:05.602628 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 826/1641] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Jun 29 12:21:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:05.606526 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8392db3-a174-4048-825a-b6c84372183e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:05.607446 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8392db3-a174-4048-825a-b6c84372183e service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:05.607886 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8392db3-a174-4048-825a-b6c84372183e service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:05.608892 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8392db3-a174-4048-825a-b6c84372183e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:05.628067 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8392db3-a174-4048-825a-b6c84372183e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:05.630378 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8392db3-a174-4048-825a-b6c84372183e service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:05.742535 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 816/1642] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:05.809083 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a692736-9109-420b-b32a-63cd8e6d57de None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:05.826090 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a692736-9109-420b-b32a-63cd8e6d57de None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:05.844429 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430cbbf6-e3ba-4acc-bf29-574e1334b687 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:05.845123 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430cbbf6-e3ba-4acc-bf29-574e1334b687 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:05.845408 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430cbbf6-e3ba-4acc-bf29-574e1334b687 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:05.845686 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430cbbf6-e3ba-4acc-bf29-574e1334b687 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:05.868916 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430cbbf6-e3ba-4acc-bf29-574e1334b687 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:05.870424 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430cbbf6-e3ba-4acc-bf29-574e1334b687 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:05.882983 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 827/1643] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:06.861456 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8392db3-a174-4048-825a-b6c84372183e service cinder] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:06.893330 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8392db3-a174-4048-825a-b6c84372183e service cinder] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:06.910105 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a84fb3-bfd4-4d3f-8a7c-f5d0acb54076 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:06.910991 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a84fb3-bfd4-4d3f-8a7c-f5d0acb54076 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:06.911421 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a84fb3-bfd4-4d3f-8a7c-f5d0acb54076 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:06.911888 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a84fb3-bfd4-4d3f-8a7c-f5d0acb54076 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:07.096801 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a84fb3-bfd4-4d3f-8a7c-f5d0acb54076 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:07.100218 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a84fb3-bfd4-4d3f-8a7c-f5d0acb54076 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:07.167153 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 817/1644] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:07.401066 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430cbbf6-e3ba-4acc-bf29-574e1334b687 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:07.605860 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430cbbf6-e3ba-4acc-bf29-574e1334b687 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:07.625977 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d936fa-a487-4801-85b0-f97951b403d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:07.627122 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d936fa-a487-4801-85b0-f97951b403d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:07.627655 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d936fa-a487-4801-85b0-f97951b403d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:07.627978 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d936fa-a487-4801-85b0-f97951b403d5 admin admin] PATH_INFO: `/v3/users/9448b965d23b45b6935a54e7acbaf2c6` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:07.634632 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d936fa-a487-4801-85b0-f97951b403d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9448b965d23b45b6935a54e7acbaf2c6)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:07.635928 dv-cinder-797608-38-smb devstack@keystone.service[80135]: WARNING py.warnings [None req-f5d936fa-a487-4801-85b0-f97951b403d5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 29 12:21:07.635928 dv-cinder-797608-38-smb devstack@keystone.service[80135]: warnings.warn(msg) Jun 29 12:21:07.635928 dv-cinder-797608-38-smb devstack@keystone.service[80135]: Jun 29 12:21:07.637613 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d936fa-a487-4801-85b0-f97951b403d5 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:07.809899 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f5d936fa-a487-4801-85b0-f97951b403d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9448b965d23b45b6935a54e7acbaf2c6'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:07.810938 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f5d936fa-a487-4801-85b0-f97951b403d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9448b965d23b45b6935a54e7acbaf2c6'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:07.811714 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f5d936fa-a487-4801-85b0-f97951b403d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9448b965d23b45b6935a54e7acbaf2c6'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:07.814762 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:07.857186 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f5d936fa-a487-4801-85b0-f97951b403d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9448b965d23b45b6935a54e7acbaf2c6'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:07.872586 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f5d936fa-a487-4801-85b0-f97951b403d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9448b965d23b45b6935a54e7acbaf2c6'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:07.914488 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 828/1645] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:21:07 2022] DELETE /identity/v3/users/9448b965d23b45b6935a54e7acbaf2c6 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:07.918567 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4926c-0de5-4a75-9913-bcb3136772c7 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:07.919727 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4926c-0de5-4a75-9913-bcb3136772c7 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:07.920591 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4926c-0de5-4a75-9913-bcb3136772c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:07.979768 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-99a4926c-0de5-4a75-9913-bcb3136772c7 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:07.985419 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-99a4926c-0de5-4a75-9913-bcb3136772c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:08.171834 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 818/1646] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:08.219952 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d936fa-a487-4801-85b0-f97951b403d5 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:08.222505 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f5d936fa-a487-4801-85b0-f97951b403d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:08.356924 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d936fa-a487-4801-85b0-f97951b403d5 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:08.368382 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c2831-24ee-4351-ae99-83dea2d275d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:08.369172 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c2831-24ee-4351-ae99-83dea2d275d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:08.369555 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c2831-24ee-4351-ae99-83dea2d275d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:08.369972 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c2831-24ee-4351-ae99-83dea2d275d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:08.380508 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66c2831-24ee-4351-ae99-83dea2d275d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:08.382353 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66c2831-24ee-4351-ae99-83dea2d275d6 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:08.401837 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 829/1647] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:09.075128 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a4926c-0de5-4a75-9913-bcb3136772c7 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:09.076666 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-99a4926c-0de5-4a75-9913-bcb3136772c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:09.096493 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a4926c-0de5-4a75-9913-bcb3136772c7 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:09.111425 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30425535-5cf0-4b5e-94bc-dbfcf331e6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:09.112345 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30425535-5cf0-4b5e-94bc-dbfcf331e6fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:09.112633 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30425535-5cf0-4b5e-94bc-dbfcf331e6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:09.112908 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30425535-5cf0-4b5e-94bc-dbfcf331e6fb admin admin] PATH_INFO: `/v3/projects/0abb97c22af04eb1b3f1d5ccc1f56edd` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:09.121454 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30425535-5cf0-4b5e-94bc-dbfcf331e6fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0abb97c22af04eb1b3f1d5ccc1f56edd)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:09.122522 dv-cinder-797608-38-smb devstack@keystone.service[80134]: WARNING py.warnings [None req-30425535-5cf0-4b5e-94bc-dbfcf331e6fb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 29 12:21:09.122522 dv-cinder-797608-38-smb devstack@keystone.service[80134]: warnings.warn(msg) Jun 29 12:21:09.122522 dv-cinder-797608-38-smb devstack@keystone.service[80134]: Jun 29 12:21:09.123801 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30425535-5cf0-4b5e-94bc-dbfcf331e6fb admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:09.125888 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:09.368183 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-30425535-5cf0-4b5e-94bc-dbfcf331e6fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0abb97c22af04eb1b3f1d5ccc1f56edd', 'request_id': 'req-30425535-5cf0-4b5e-94bc-dbfcf331e6fb'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:09.389785 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-30425535-5cf0-4b5e-94bc-dbfcf331e6fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0abb97c22af04eb1b3f1d5ccc1f56edd', 'request_id': 'req-30425535-5cf0-4b5e-94bc-dbfcf331e6fb'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:09.408806 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-30425535-5cf0-4b5e-94bc-dbfcf331e6fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0abb97c22af04eb1b3f1d5ccc1f56edd', 'request_id': 'req-30425535-5cf0-4b5e-94bc-dbfcf331e6fb'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:09.459584 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-30425535-5cf0-4b5e-94bc-dbfcf331e6fb admin admin] The token cache is being invalidate because project 0abb97c22af04eb1b3f1d5ccc1f56edd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:21:09.459893 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-30425535-5cf0-4b5e-94bc-dbfcf331e6fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:09.464839 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-30425535-5cf0-4b5e-94bc-dbfcf331e6fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:09.476547 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c2831-24ee-4351-ae99-83dea2d275d6 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:09.478475 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 819/1648] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:21:09 2022] DELETE /identity/v3/projects/0abb97c22af04eb1b3f1d5ccc1f56edd => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:09.496727 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c2831-24ee-4351-ae99-83dea2d275d6 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:09.734441 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf0394-e6ad-4a73-93ed-0bbb95e6960d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:09.736557 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf0394-e6ad-4a73-93ed-0bbb95e6960d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:09.736725 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf0394-e6ad-4a73-93ed-0bbb95e6960d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:09.737004 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf0394-e6ad-4a73-93ed-0bbb95e6960d admin admin] PATH_INFO: `/v3/users/78fb8d3cc4014b2d91bee5a61a67f5ea` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:09.742307 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bf0394-e6ad-4a73-93ed-0bbb95e6960d admin admin] RBAC: Authorizing `identity:delete_user(user_id=78fb8d3cc4014b2d91bee5a61a67f5ea)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:09.754843 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30425535-5cf0-4b5e-94bc-dbfcf331e6fb admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:09.756994 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-30425535-5cf0-4b5e-94bc-dbfcf331e6fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:09.769858 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bf0394-e6ad-4a73-93ed-0bbb95e6960d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:09.798945 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30425535-5cf0-4b5e-94bc-dbfcf331e6fb admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:09.817512 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69edd3-7f4e-479b-8107-db1478c0f350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:09.824994 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69edd3-7f4e-479b-8107-db1478c0f350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:09.825360 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69edd3-7f4e-479b-8107-db1478c0f350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:09.825640 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69edd3-7f4e-479b-8107-db1478c0f350 admin admin] PATH_INFO: `/v3/users/d98d4b95c74e412bacc2463c76a0bc05` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:09.834901 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb69edd3-7f4e-479b-8107-db1478c0f350 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d98d4b95c74e412bacc2463c76a0bc05)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:09.837889 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb69edd3-7f4e-479b-8107-db1478c0f350 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:09.958508 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-95bf0394-e6ad-4a73-93ed-0bbb95e6960d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78fb8d3cc4014b2d91bee5a61a67f5ea'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:09.959519 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-95bf0394-e6ad-4a73-93ed-0bbb95e6960d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78fb8d3cc4014b2d91bee5a61a67f5ea'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:09.960152 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-95bf0394-e6ad-4a73-93ed-0bbb95e6960d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78fb8d3cc4014b2d91bee5a61a67f5ea'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:10.008011 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-95bf0394-e6ad-4a73-93ed-0bbb95e6960d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78fb8d3cc4014b2d91bee5a61a67f5ea'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:10.018520 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-eb69edd3-7f4e-479b-8107-db1478c0f350 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd98d4b95c74e412bacc2463c76a0bc05'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:10.019376 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:10.034525 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-95bf0394-e6ad-4a73-93ed-0bbb95e6960d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78fb8d3cc4014b2d91bee5a61a67f5ea'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:10.067820 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-eb69edd3-7f4e-479b-8107-db1478c0f350 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd98d4b95c74e412bacc2463c76a0bc05'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:10.079734 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 830/1649] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:21:09 2022] DELETE /identity/v3/users/78fb8d3cc4014b2d91bee5a61a67f5ea => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:10.084572 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9cd46-b5e2-47b1-8b04-9f5925a2839f None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:10.084572 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9cd46-b5e2-47b1-8b04-9f5925a2839f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:10.084572 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9cd46-b5e2-47b1-8b04-9f5925a2839f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:10.092400 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-eb69edd3-7f4e-479b-8107-db1478c0f350 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd98d4b95c74e412bacc2463c76a0bc05'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:10.093318 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-eb69edd3-7f4e-479b-8107-db1478c0f350 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd98d4b95c74e412bacc2463c76a0bc05'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:10.118308 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-eb69edd3-7f4e-479b-8107-db1478c0f350 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd98d4b95c74e412bacc2463c76a0bc05'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:10.132130 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 820/1650] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:21:09 2022] DELETE /identity/v3/users/d98d4b95c74e412bacc2463c76a0bc05 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:10.137817 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91aa19-6999-4eec-a002-b236c14ed472 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:10.138100 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91aa19-6999-4eec-a002-b236c14ed472 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:10.138968 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91aa19-6999-4eec-a002-b236c14ed472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:10.169151 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-23e9cd46-b5e2-47b1-8b04-9f5925a2839f None None] MFA Rules not processed for user `6d7899f68b474e24b0c49f6b800fa093`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:10.171555 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-23e9cd46-b5e2-47b1-8b04-9f5925a2839f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:10.181344 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-6d91aa19-6999-4eec-a002-b236c14ed472 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:10.183236 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-6d91aa19-6999-4eec-a002-b236c14ed472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:10.321217 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 821/1651] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:21:10.345723 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d91aa19-6999-4eec-a002-b236c14ed472 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:10.350858 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-6d91aa19-6999-4eec-a002-b236c14ed472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:10.366397 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:10.385261 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 831/1652] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:10 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:10.389861 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9cd46-b5e2-47b1-8b04-9f5925a2839f None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:10.399653 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-23e9cd46-b5e2-47b1-8b04-9f5925a2839f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:10.443131 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9cd46-b5e2-47b1-8b04-9f5925a2839f None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:10.455394 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc4759-2626-4a0b-9096-88eb3deafd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:10.456233 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc4759-2626-4a0b-9096-88eb3deafd5a admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:10.456517 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc4759-2626-4a0b-9096-88eb3deafd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:10.456792 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc4759-2626-4a0b-9096-88eb3deafd5a admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:10.457505 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbc4759-2626-4a0b-9096-88eb3deafd5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:10.459832 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbc4759-2626-4a0b-9096-88eb3deafd5a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:10.534618 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 832/1653] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:21:10 2022] POST /identity/v3/projects => generated 405 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:10.538654 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc4759-2626-4a0b-9096-88eb3deafd5a admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:10.570839 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d91aa19-6999-4eec-a002-b236c14ed472 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:10.702485 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f42c7-f6ab-4ead-b48c-93884c570020 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:10.703169 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f42c7-f6ab-4ead-b48c-93884c570020 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:10.703449 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f42c7-f6ab-4ead-b48c-93884c570020 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:10.703718 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f42c7-f6ab-4ead-b48c-93884c570020 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:10.711524 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc4759-2626-4a0b-9096-88eb3deafd5a admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:10.747988 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a610a270-d5da-4cb8-a25d-6e6e62e1c2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:10.748770 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a610a270-d5da-4cb8-a25d-6e6e62e1c2bb admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:10.751663 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a610a270-d5da-4cb8-a25d-6e6e62e1c2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:10.752748 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a610a270-d5da-4cb8-a25d-6e6e62e1c2bb admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:10.752748 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a610a270-d5da-4cb8-a25d-6e6e62e1c2bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:10.754789 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46f42c7-f6ab-4ead-b48c-93884c570020 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:10.756183 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46f42c7-f6ab-4ead-b48c-93884c570020 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:10.770024 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a610a270-d5da-4cb8-a25d-6e6e62e1c2bb admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:10.796882 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 822/1654] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:10.831051 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f42c7-f6ab-4ead-b48c-93884c570020 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:10.832052 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 833/1655] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:21:10 2022] POST /identity/v3/users => generated 309 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:10.865050 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f42c7-f6ab-4ead-b48c-93884c570020 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:10.886600 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3029b2a2-d4cc-45c5-8543-903a35b6e2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:10.887391 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029b2a2-d4cc-45c5-8543-903a35b6e2a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:10.887686 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029b2a2-d4cc-45c5-8543-903a35b6e2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:10.887967 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029b2a2-d4cc-45c5-8543-903a35b6e2a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:10.888728 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3029b2a2-d4cc-45c5-8543-903a35b6e2a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:10.890432 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3029b2a2-d4cc-45c5-8543-903a35b6e2a9 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:10.923092 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 823/1656] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:10.927390 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a610a270-d5da-4cb8-a25d-6e6e62e1c2bb admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:10.954093 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a610a270-d5da-4cb8-a25d-6e6e62e1c2bb admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:10.969490 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ae1c0-b9fb-4e94-812e-1a2b4d76bc3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:10.970714 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ae1c0-b9fb-4e94-812e-1a2b4d76bc3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:10.972028 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ae1c0-b9fb-4e94-812e-1a2b4d76bc3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:10.972738 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ae1c0-b9fb-4e94-812e-1a2b4d76bc3f admin admin] PATH_INFO: `/v3/projects/76e03ab7f5f048f2a2f73485ba105969/users/d8f8e21682264f0198431b5360678171/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:11.006050 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6ae1c0-b9fb-4e94-812e-1a2b4d76bc3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=76e03ab7f5f048f2a2f73485ba105969, user_id=d8f8e21682264f0198431b5360678171, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:11.010138 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6ae1c0-b9fb-4e94-812e-1a2b4d76bc3f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:11.061053 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 834/1657] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:10 2022] PUT /identity/v3/projects/76e03ab7f5f048f2a2f73485ba105969/users/d8f8e21682264f0198431b5360678171/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:11.067746 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3029b2a2-d4cc-45c5-8543-903a35b6e2a9 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:11.089825 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3029b2a2-d4cc-45c5-8543-903a35b6e2a9 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:11.269007 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e65663-74f0-4f16-9797-8fe3a0cade76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:11.270393 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e65663-74f0-4f16-9797-8fe3a0cade76 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:11.270786 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e65663-74f0-4f16-9797-8fe3a0cade76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:11.271063 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e65663-74f0-4f16-9797-8fe3a0cade76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:11.275701 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e65663-74f0-4f16-9797-8fe3a0cade76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:11.290962 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e65663-74f0-4f16-9797-8fe3a0cade76 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:11.321550 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 824/1658] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:11.326595 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ae1c0-b9fb-4e94-812e-1a2b4d76bc3f admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:11.343946 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ae1c0-b9fb-4e94-812e-1a2b4d76bc3f admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:11.358800 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a8ece-1424-4db9-a3f9-ad83b827ce3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:11.359350 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a8ece-1424-4db9-a3f9-ad83b827ce3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:11.359630 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a8ece-1424-4db9-a3f9-ad83b827ce3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:11.362176 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a8ece-1424-4db9-a3f9-ad83b827ce3a admin admin] PATH_INFO: `/v3/projects/76e03ab7f5f048f2a2f73485ba105969/users/d8f8e21682264f0198431b5360678171/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:11.367758 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9a8ece-1424-4db9-a3f9-ad83b827ce3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=76e03ab7f5f048f2a2f73485ba105969, user_id=d8f8e21682264f0198431b5360678171, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:11.374360 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9a8ece-1424-4db9-a3f9-ad83b827ce3a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:11.407745 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 835/1659] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:11 2022] PUT /identity/v3/projects/76e03ab7f5f048f2a2f73485ba105969/users/d8f8e21682264f0198431b5360678171/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:12.073928 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e65663-74f0-4f16-9797-8fe3a0cade76 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:12.082971 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-46e65663-74f0-4f16-9797-8fe3a0cade76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:12.108734 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e65663-74f0-4f16-9797-8fe3a0cade76 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:12.140257 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a8ece-1424-4db9-a3f9-ad83b827ce3a admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:12.142132 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0a9a8ece-1424-4db9-a3f9-ad83b827ce3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:12.154147 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:12.271806 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:12.317136 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0437062-5930-4432-b2b6-69ce48d1f7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:12.318068 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0437062-5930-4432-b2b6-69ce48d1f7fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:12.318355 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0437062-5930-4432-b2b6-69ce48d1f7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:12.318636 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0437062-5930-4432-b2b6-69ce48d1f7fd admin admin] PATH_INFO: `/v3/projects/a9ce2678fd0d4657a4fa18a402959945` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:12.320404 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0437062-5930-4432-b2b6-69ce48d1f7fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9ce2678fd0d4657a4fa18a402959945)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:12.324174 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a8ece-1424-4db9-a3f9-ad83b827ce3a admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:12.325918 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0437062-5930-4432-b2b6-69ce48d1f7fd admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:12.337781 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c2962-2ad5-49fc-9c5c-457eee3ccef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:12.338697 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c2962-2ad5-49fc-9c5c-457eee3ccef7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:12.338980 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c2962-2ad5-49fc-9c5c-457eee3ccef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:12.339257 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c2962-2ad5-49fc-9c5c-457eee3ccef7 admin admin] PATH_INFO: `/v3/projects/0b3b0ac9635a42f8b12071cdb0760195` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:12.340572 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810c2962-2ad5-49fc-9c5c-457eee3ccef7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b3b0ac9635a42f8b12071cdb0760195)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:12.342611 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810c2962-2ad5-49fc-9c5c-457eee3ccef7 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:12.432416 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-e0437062-5930-4432-b2b6-69ce48d1f7fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9ce2678fd0d4657a4fa18a402959945', 'request_id': 'req-e0437062-5930-4432-b2b6-69ce48d1f7fd'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:12.455907 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-e0437062-5930-4432-b2b6-69ce48d1f7fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9ce2678fd0d4657a4fa18a402959945', 'request_id': 'req-e0437062-5930-4432-b2b6-69ce48d1f7fd'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:12.459577 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-810c2962-2ad5-49fc-9c5c-457eee3ccef7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b3b0ac9635a42f8b12071cdb0760195', 'request_id': 'req-810c2962-2ad5-49fc-9c5c-457eee3ccef7'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:12.479888 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-810c2962-2ad5-49fc-9c5c-457eee3ccef7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b3b0ac9635a42f8b12071cdb0760195', 'request_id': 'req-810c2962-2ad5-49fc-9c5c-457eee3ccef7'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:12.480224 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-e0437062-5930-4432-b2b6-69ce48d1f7fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9ce2678fd0d4657a4fa18a402959945', 'request_id': 'req-e0437062-5930-4432-b2b6-69ce48d1f7fd'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:12.501567 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-810c2962-2ad5-49fc-9c5c-457eee3ccef7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b3b0ac9635a42f8b12071cdb0760195', 'request_id': 'req-810c2962-2ad5-49fc-9c5c-457eee3ccef7'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:12.512927 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-e0437062-5930-4432-b2b6-69ce48d1f7fd admin admin] The token cache is being invalidate because project a9ce2678fd0d4657a4fa18a402959945 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:21:12.513230 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-e0437062-5930-4432-b2b6-69ce48d1f7fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:12.516749 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-e0437062-5930-4432-b2b6-69ce48d1f7fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:12.520444 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 825/1660] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:21:12 2022] DELETE /identity/v3/projects/a9ce2678fd0d4657a4fa18a402959945 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:12.525504 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-810c2962-2ad5-49fc-9c5c-457eee3ccef7 admin admin] The token cache is being invalidate because project 0b3b0ac9635a42f8b12071cdb0760195 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:21:12.525647 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee9f21-1ce4-4e19-8c89-443146f169e3 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:12.526323 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-810c2962-2ad5-49fc-9c5c-457eee3ccef7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:12.532454 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee9f21-1ce4-4e19-8c89-443146f169e3 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:12.533713 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-810c2962-2ad5-49fc-9c5c-457eee3ccef7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:12.533817 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee9f21-1ce4-4e19-8c89-443146f169e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:12.546120 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 836/1661] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:21:12 2022] DELETE /identity/v3/projects/0b3b0ac9635a42f8b12071cdb0760195 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:12.547831 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58cd34-d2be-4a7c-920f-95bedd104633 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:12.548158 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58cd34-d2be-4a7c-920f-95bedd104633 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:12.548500 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58cd34-d2be-4a7c-920f-95bedd104633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:12.585923 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-2f58cd34-d2be-4a7c-920f-95bedd104633 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:12.587446 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2f58cd34-d2be-4a7c-920f-95bedd104633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:12.594937 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-6cee9f21-1ce4-4e19-8c89-443146f169e3 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:12.596225 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-6cee9f21-1ce4-4e19-8c89-443146f169e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:12.769728 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 837/1662] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:12.773979 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed0083-3850-4ba9-b4eb-09b727fa63c3 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:12.774428 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed0083-3850-4ba9-b4eb-09b727fa63c3 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:12.774859 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed0083-3850-4ba9-b4eb-09b727fa63c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:12.825077 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 826/1663] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:12.832639 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca9ccd-c7e3-45e5-ba53-a6e352150097 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:12.832926 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca9ccd-c7e3-45e5-ba53-a6e352150097 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:12.833198 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca9ccd-c7e3-45e5-ba53-a6e352150097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:12.861784 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-97ed0083-3850-4ba9-b4eb-09b727fa63c3 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:12.864974 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-97ed0083-3850-4ba9-b4eb-09b727fa63c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:12.907236 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-d0ca9ccd-c7e3-45e5-ba53-a6e352150097 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:12.908653 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-d0ca9ccd-c7e3-45e5-ba53-a6e352150097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:12.915107 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 838/1664] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:12.918145 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed0083-3850-4ba9-b4eb-09b727fa63c3 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:12.932087 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 827/1665] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:12.934067 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ca9ccd-c7e3-45e5-ba53-a6e352150097 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:12.942981 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed0083-3850-4ba9-b4eb-09b727fa63c3 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:12.962498 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ca9ccd-c7e3-45e5-ba53-a6e352150097 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:12.962986 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba8fa9-0c0d-4832-9e91-932d24b99326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:12.963977 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba8fa9-0c0d-4832-9e91-932d24b99326 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:12.964474 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba8fa9-0c0d-4832-9e91-932d24b99326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:12.966069 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba8fa9-0c0d-4832-9e91-932d24b99326 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:12.976374 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeba8fa9-0c0d-4832-9e91-932d24b99326 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:21:12.978421 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f2e706-d82e-435e-973f-7b58b13f4471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:12.978927 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeba8fa9-0c0d-4832-9e91-932d24b99326 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:12.979525 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2e706-d82e-435e-973f-7b58b13f4471 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:12.979816 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2e706-d82e-435e-973f-7b58b13f4471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:12.980116 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2e706-d82e-435e-973f-7b58b13f4471 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:12.980852 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f2e706-d82e-435e-973f-7b58b13f4471 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:21:12.981344 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f2e706-d82e-435e-973f-7b58b13f4471 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:12.981773 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeba8fa9-0c0d-4832-9e91-932d24b99326 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:12.982991 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f2e706-d82e-435e-973f-7b58b13f4471 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:13.013238 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 839/1666] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:21:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:21:13.019653 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba8fa9-0c0d-4832-9e91-932d24b99326 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:13.027179 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-aeba8fa9-0c0d-4832-9e91-932d24b99326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:13.033965 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 828/1667] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:21:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:21:13.033965 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f2e706-d82e-435e-973f-7b58b13f4471 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:13.072174 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba8fa9-0c0d-4832-9e91-932d24b99326 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:13.073982 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f2e706-d82e-435e-973f-7b58b13f4471 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:13.089979 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7dc0d6-d653-4603-8ee3-ca1cd680bc58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:13.090902 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7dc0d6-d653-4603-8ee3-ca1cd680bc58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:13.091185 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7dc0d6-d653-4603-8ee3-ca1cd680bc58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:13.091530 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7dc0d6-d653-4603-8ee3-ca1cd680bc58 admin admin] PATH_INFO: `/v3/users/7474cc3e00ea4caf86833b02751cb932` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:13.093237 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66372f95-1d88-4e56-b926-4ab25abefcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:13.093949 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7dc0d6-d653-4603-8ee3-ca1cd680bc58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7474cc3e00ea4caf86833b02751cb932)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:13.094061 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66372f95-1d88-4e56-b926-4ab25abefcdb admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:13.094282 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66372f95-1d88-4e56-b926-4ab25abefcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:13.094555 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66372f95-1d88-4e56-b926-4ab25abefcdb admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:13.095947 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7dc0d6-d653-4603-8ee3-ca1cd680bc58 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:13.098987 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66372f95-1d88-4e56-b926-4ab25abefcdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:13.100946 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66372f95-1d88-4e56-b926-4ab25abefcdb admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:13.143138 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:13.204808 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 829/1668] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:21:13 2022] POST /identity/v3/projects => generated 387 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:13.205960 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66372f95-1d88-4e56-b926-4ab25abefcdb admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:13.233430 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ce7dc0d6-d653-4603-8ee3-ca1cd680bc58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7474cc3e00ea4caf86833b02751cb932'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:13.234790 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ce7dc0d6-d653-4603-8ee3-ca1cd680bc58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7474cc3e00ea4caf86833b02751cb932'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:13.236011 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ce7dc0d6-d653-4603-8ee3-ca1cd680bc58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7474cc3e00ea4caf86833b02751cb932'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:13.274863 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ce7dc0d6-d653-4603-8ee3-ca1cd680bc58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7474cc3e00ea4caf86833b02751cb932'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:13.295310 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ce7dc0d6-d653-4603-8ee3-ca1cd680bc58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7474cc3e00ea4caf86833b02751cb932'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:13.309678 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:13.336642 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 840/1669] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:21:13 2022] DELETE /identity/v3/users/7474cc3e00ea4caf86833b02751cb932 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:13.339265 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7dc0d6-d653-4603-8ee3-ca1cd680bc58 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:13.342531 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ce7dc0d6-d653-4603-8ee3-ca1cd680bc58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:13.361842 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66372f95-1d88-4e56-b926-4ab25abefcdb admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:13.510128 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7dc0d6-d653-4603-8ee3-ca1cd680bc58 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:13.513042 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbdcde9-b9ed-49d3-94a8-a052db3c75c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:13.514396 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdcde9-b9ed-49d3-94a8-a052db3c75c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:13.515140 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdcde9-b9ed-49d3-94a8-a052db3c75c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:13.516081 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdcde9-b9ed-49d3-94a8-a052db3c75c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:13.517444 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbdcde9-b9ed-49d3-94a8-a052db3c75c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:13.522817 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbdcde9-b9ed-49d3-94a8-a052db3c75c7 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:13.523909 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8866a020-4116-4788-8c0e-230aa81fa943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:13.524859 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866a020-4116-4788-8c0e-230aa81fa943 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:13.526090 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866a020-4116-4788-8c0e-230aa81fa943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:13.526950 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866a020-4116-4788-8c0e-230aa81fa943 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:13.528403 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8866a020-4116-4788-8c0e-230aa81fa943 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:13.533591 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8866a020-4116-4788-8c0e-230aa81fa943 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:13.605779 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 841/1670] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:21:13 2022] POST /identity/v3/users => generated 294 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:13.609294 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1a893-11bd-4065-af69-3763b38319a7 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:13.611318 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 830/1671] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:21:13 2022] POST /identity/v3/projects => generated 357 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:13.612401 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1a893-11bd-4065-af69-3763b38319a7 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:13.614633 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1a893-11bd-4065-af69-3763b38319a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:13.616502 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbdcde9-b9ed-49d3-94a8-a052db3c75c7 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:13.681736 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-61d1a893-11bd-4065-af69-3763b38319a7 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:13.693487 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-61d1a893-11bd-4065-af69-3763b38319a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:13.822184 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbdcde9-b9ed-49d3-94a8-a052db3c75c7 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:13.834890 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91567191-8aa1-43de-9e0e-6b1f75ad7fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:13.837328 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91567191-8aa1-43de-9e0e-6b1f75ad7fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:13.839405 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91567191-8aa1-43de-9e0e-6b1f75ad7fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:13.840602 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91567191-8aa1-43de-9e0e-6b1f75ad7fa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:13.840602 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91567191-8aa1-43de-9e0e-6b1f75ad7fa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:13.843484 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91567191-8aa1-43de-9e0e-6b1f75ad7fa6 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:13.886983 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 831/1672] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:13.886983 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91567191-8aa1-43de-9e0e-6b1f75ad7fa6 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:13.891885 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 842/1673] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:13.891885 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d1a893-11bd-4065-af69-3763b38319a7 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:13.895309 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-91567191-8aa1-43de-9e0e-6b1f75ad7fa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:13.934336 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d1a893-11bd-4065-af69-3763b38319a7 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:13.944328 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91567191-8aa1-43de-9e0e-6b1f75ad7fa6 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:13.953516 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0041de9d-ce99-4fed-bcc8-fe5a6a910824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:13.955134 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041de9d-ce99-4fed-bcc8-fe5a6a910824 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:13.955563 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041de9d-ce99-4fed-bcc8-fe5a6a910824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:13.956493 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041de9d-ce99-4fed-bcc8-fe5a6a910824 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:13.957738 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0041de9d-ce99-4fed-bcc8-fe5a6a910824 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:13.960223 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0041de9d-ce99-4fed-bcc8-fe5a6a910824 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:13.962176 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42578a-38f0-45cb-8f1a-066bd5488b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:13.963000 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42578a-38f0-45cb-8f1a-066bd5488b6f admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:13.965788 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42578a-38f0-45cb-8f1a-066bd5488b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:13.965788 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42578a-38f0-45cb-8f1a-066bd5488b6f admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:13.966262 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c42578a-38f0-45cb-8f1a-066bd5488b6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:13.969343 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c42578a-38f0-45cb-8f1a-066bd5488b6f admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:13.990211 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 843/1674] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:13.991297 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0041de9d-ce99-4fed-bcc8-fe5a6a910824 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:13.996132 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0041de9d-ce99-4fed-bcc8-fe5a6a910824 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:14.035097 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 832/1675] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:21:13 2022] POST /identity/v3/users => generated 279 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:14.036282 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42578a-38f0-45cb-8f1a-066bd5488b6f admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:14.044707 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:14.088021 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42578a-38f0-45cb-8f1a-066bd5488b6f admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:14.114846 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b741c-9343-410c-a1d9-11b57f4217df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:14.116270 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b741c-9343-410c-a1d9-11b57f4217df admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:14.116785 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b741c-9343-410c-a1d9-11b57f4217df admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:14.117980 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b741c-9343-410c-a1d9-11b57f4217df admin admin] PATH_INFO: `/v3/projects/4656d9fa52bb49088601f6b899856382/users/78269dd46ceb4e529cad8da5c73f48d6/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:14.189438 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b741c-9343-410c-a1d9-11b57f4217df admin admin] RBAC: Authorizing `identity:create_grant(project_id=4656d9fa52bb49088601f6b899856382, user_id=78269dd46ceb4e529cad8da5c73f48d6, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:14.203487 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b741c-9343-410c-a1d9-11b57f4217df admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:14.252833 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 833/1676] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:14 2022] PUT /identity/v3/projects/4656d9fa52bb49088601f6b899856382/users/78269dd46ceb4e529cad8da5c73f48d6/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:14.261441 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b741c-9343-410c-a1d9-11b57f4217df admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:14.270810 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0041de9d-ce99-4fed-bcc8-fe5a6a910824 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:14.321381 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:14.446398 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a971b8-30d4-4c63-ab31-9759c30d2d0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:14.452255 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a971b8-30d4-4c63-ab31-9759c30d2d0c service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:14.452811 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a971b8-30d4-4c63-ab31-9759c30d2d0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:14.453249 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a971b8-30d4-4c63-ab31-9759c30d2d0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:14.498234 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b741c-9343-410c-a1d9-11b57f4217df admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:14.508685 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a971b8-30d4-4c63-ab31-9759c30d2d0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:14.513380 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a971b8-30d4-4c63-ab31-9759c30d2d0c service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:14.515447 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c06995-be2c-4c32-8b01-5ab4d910b1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:14.519143 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c06995-be2c-4c32-8b01-5ab4d910b1d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:14.519597 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c06995-be2c-4c32-8b01-5ab4d910b1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:14.520047 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c06995-be2c-4c32-8b01-5ab4d910b1d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:14.521148 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c06995-be2c-4c32-8b01-5ab4d910b1d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:14.523136 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c06995-be2c-4c32-8b01-5ab4d910b1d4 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:14.543745 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 844/1677] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:14.547589 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e715cf-b321-44c8-b8b8-18e59b725ffe None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:14.549899 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e715cf-b321-44c8-b8b8-18e59b725ffe None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:14.550204 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e715cf-b321-44c8-b8b8-18e59b725ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:14.558051 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 834/1678] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:14.559170 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c06995-be2c-4c32-8b01-5ab4d910b1d4 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:14.584386 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c06995-be2c-4c32-8b01-5ab4d910b1d4 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:14.599806 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914676b6-0eba-4a23-87f5-77fd8502aa6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:14.600507 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914676b6-0eba-4a23-87f5-77fd8502aa6c admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:14.600787 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914676b6-0eba-4a23-87f5-77fd8502aa6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:14.601136 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914676b6-0eba-4a23-87f5-77fd8502aa6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:14.602749 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914676b6-0eba-4a23-87f5-77fd8502aa6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:14.604415 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914676b6-0eba-4a23-87f5-77fd8502aa6c admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:14.651116 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 835/1679] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:14.652607 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914676b6-0eba-4a23-87f5-77fd8502aa6c admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:14.661869 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-49e715cf-b321-44c8-b8b8-18e59b725ffe None None] MFA Rules not processed for user `78269dd46ceb4e529cad8da5c73f48d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:14.663193 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-49e715cf-b321-44c8-b8b8-18e59b725ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:14.683837 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914676b6-0eba-4a23-87f5-77fd8502aa6c admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:14.713383 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b272bceb-c3d4-4700-b823-a43b227b5ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:14.714364 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272bceb-c3d4-4700-b823-a43b227b5ceb admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:14.717360 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272bceb-c3d4-4700-b823-a43b227b5ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:14.719283 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272bceb-c3d4-4700-b823-a43b227b5ceb admin admin] PATH_INFO: `/v3/projects/4369fdbb397a423ab65ddeb0fbc1322a/users/14212ec6d4ce4c03ba5f2e3031158739/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:14.780939 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b272bceb-c3d4-4700-b823-a43b227b5ceb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4369fdbb397a423ab65ddeb0fbc1322a, user_id=14212ec6d4ce4c03ba5f2e3031158739, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:14.787028 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b272bceb-c3d4-4700-b823-a43b227b5ceb admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:14.853233 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 836/1680] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:14 2022] PUT /identity/v3/projects/4369fdbb397a423ab65ddeb0fbc1322a/users/14212ec6d4ce4c03ba5f2e3031158739/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:14.853233 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ae4f7-e5a8-4864-a049-36ec22a81dbf None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:14.853233 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ae4f7-e5a8-4864-a049-36ec22a81dbf None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:14.853233 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ae4f7-e5a8-4864-a049-36ec22a81dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:14.943685 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 845/1681] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:14.945172 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933e495-ece9-4f5d-83bd-2300dafd8abf None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:14.946134 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933e495-ece9-4f5d-83bd-2300dafd8abf None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:14.946134 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933e495-ece9-4f5d-83bd-2300dafd8abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:14.972577 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-145ae4f7-e5a8-4864-a049-36ec22a81dbf None None] MFA Rules not processed for user `d8f8e21682264f0198431b5360678171`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:15.002768 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-145ae4f7-e5a8-4864-a049-36ec22a81dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:15.041612 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-1933e495-ece9-4f5d-83bd-2300dafd8abf None None] MFA Rules not processed for user `14212ec6d4ce4c03ba5f2e3031158739`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:15.042887 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1933e495-ece9-4f5d-83bd-2300dafd8abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:15.218930 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:15.282187 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 837/1682] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:14 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 435 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:15.282187 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ae4f7-e5a8-4864-a049-36ec22a81dbf None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:15.292055 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 846/1683] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:14 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:15.296746 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1933e495-ece9-4f5d-83bd-2300dafd8abf None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:15.470297 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1933e495-ece9-4f5d-83bd-2300dafd8abf None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:15.483525 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ae4f7-e5a8-4864-a049-36ec22a81dbf None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:15.490474 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78580492-2a2d-42f0-92e3-3a627a434f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:15.491202 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78580492-2a2d-42f0-92e3-3a627a434f56 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:15.491482 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78580492-2a2d-42f0-92e3-3a627a434f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:15.491821 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78580492-2a2d-42f0-92e3-3a627a434f56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:15.492563 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78580492-2a2d-42f0-92e3-3a627a434f56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:15.495046 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78580492-2a2d-42f0-92e3-3a627a434f56 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:15.505985 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21615b-c52f-4fb1-b15f-5ab9d855255b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:15.508218 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21615b-c52f-4fb1-b15f-5ab9d855255b admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:15.509534 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21615b-c52f-4fb1-b15f-5ab9d855255b admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:15.510516 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21615b-c52f-4fb1-b15f-5ab9d855255b admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:15.511301 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f21615b-c52f-4fb1-b15f-5ab9d855255b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:15.513587 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f21615b-c52f-4fb1-b15f-5ab9d855255b admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:15.552118 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:15.581099 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 838/1684] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:21:15 2022] POST /identity/v3/projects => generated 387 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:15.586201 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21615b-c52f-4fb1-b15f-5ab9d855255b admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:15.605167 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 847/1685] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:21:15 2022] POST /identity/v3/projects => generated 355 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:21:15.609564 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78580492-2a2d-42f0-92e3-3a627a434f56 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:15.754618 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78580492-2a2d-42f0-92e3-3a627a434f56 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:15.765724 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f9036-d7c7-4fe2-b881-b74a07204b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:15.766760 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f9036-d7c7-4fe2-b881-b74a07204b8c admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:15.768283 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f9036-d7c7-4fe2-b881-b74a07204b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:15.768683 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f9036-d7c7-4fe2-b881-b74a07204b8c admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:15.769714 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45f9036-d7c7-4fe2-b881-b74a07204b8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:15.773055 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45f9036-d7c7-4fe2-b881-b74a07204b8c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:15.803098 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 848/1686] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:21:15 2022] POST /identity/v3/users => generated 284 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:15.808344 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f9036-d7c7-4fe2-b881-b74a07204b8c admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:15.817354 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21615b-c52f-4fb1-b15f-5ab9d855255b admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:15.830940 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ee895-5c9c-487e-adbe-a380044a99b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:15.831658 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ee895-5c9c-487e-adbe-a380044a99b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:15.831952 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ee895-5c9c-487e-adbe-a380044a99b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:15.832226 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ee895-5c9c-487e-adbe-a380044a99b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:15.833109 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ee895-5c9c-487e-adbe-a380044a99b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:15.835247 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ee895-5c9c-487e-adbe-a380044a99b7 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:15.835713 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f9036-d7c7-4fe2-b881-b74a07204b8c admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:15.856226 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a3b91d-ecdc-4740-a0fe-c377f7f89f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:15.857019 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3b91d-ecdc-4740-a0fe-c377f7f89f20 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:15.858000 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3b91d-ecdc-4740-a0fe-c377f7f89f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:15.859134 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3b91d-ecdc-4740-a0fe-c377f7f89f20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:15.862594 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a3b91d-ecdc-4740-a0fe-c377f7f89f20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:15.869016 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a3b91d-ecdc-4740-a0fe-c377f7f89f20 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:15.878872 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 839/1687] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:21:15 2022] POST /identity/v3/users => generated 294 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:21:15.885068 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ee895-5c9c-487e-adbe-a380044a99b7 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:15.904724 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 849/1688] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:15.906008 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a3b91d-ecdc-4740-a0fe-c377f7f89f20 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:15.907845 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ee895-5c9c-487e-adbe-a380044a99b7 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:15.925604 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b48e93d-0604-4798-8617-f8e5227bf1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:15.926349 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48e93d-0604-4798-8617-f8e5227bf1d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:15.926632 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48e93d-0604-4798-8617-f8e5227bf1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:15.926910 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48e93d-0604-4798-8617-f8e5227bf1d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:15.927685 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b48e93d-0604-4798-8617-f8e5227bf1d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:15.929424 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b48e93d-0604-4798-8617-f8e5227bf1d2 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:15.934804 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a3b91d-ecdc-4740-a0fe-c377f7f89f20 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:15.948157 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fca2a0-b2ae-4b07-ad6e-8e929fc86824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:15.950058 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fca2a0-b2ae-4b07-ad6e-8e929fc86824 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:15.950669 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fca2a0-b2ae-4b07-ad6e-8e929fc86824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:15.951510 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fca2a0-b2ae-4b07-ad6e-8e929fc86824 admin admin] PATH_INFO: `/v3/projects/b177dde55836458c8edc9b4b1d1407e4/users/6045a607f36a42d382e8451ec2dcb610/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:15.951638 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 840/1689] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:15.956674 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b48e93d-0604-4798-8617-f8e5227bf1d2 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:15.979226 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fca2a0-b2ae-4b07-ad6e-8e929fc86824 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b177dde55836458c8edc9b4b1d1407e4, user_id=6045a607f36a42d382e8451ec2dcb610, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:15.983649 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fca2a0-b2ae-4b07-ad6e-8e929fc86824 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:15.992185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b48e93d-0604-4798-8617-f8e5227bf1d2 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:16.003903 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 850/1690] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:15 2022] PUT /identity/v3/projects/b177dde55836458c8edc9b4b1d1407e4/users/6045a607f36a42d382e8451ec2dcb610/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:16.008429 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca03a5d1-5887-46a3-9f9d-78c7050e5b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:16.008772 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fca2a0-b2ae-4b07-ad6e-8e929fc86824 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:16.009146 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca03a5d1-5887-46a3-9f9d-78c7050e5b1a admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:16.009434 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca03a5d1-5887-46a3-9f9d-78c7050e5b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:16.009726 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca03a5d1-5887-46a3-9f9d-78c7050e5b1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:16.013512 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca03a5d1-5887-46a3-9f9d-78c7050e5b1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:16.018723 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca03a5d1-5887-46a3-9f9d-78c7050e5b1a admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:16.058210 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 841/1691] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:16.059210 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca03a5d1-5887-46a3-9f9d-78c7050e5b1a admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:16.087180 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:16.090687 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca03a5d1-5887-46a3-9f9d-78c7050e5b1a admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:16.165728 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fca2a0-b2ae-4b07-ad6e-8e929fc86824 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:16.188626 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156d9975-12b0-4116-ad2f-6253f30515a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:16.188626 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d9975-12b0-4116-ad2f-6253f30515a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:16.188626 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d9975-12b0-4116-ad2f-6253f30515a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:16.188626 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d9975-12b0-4116-ad2f-6253f30515a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:16.188961 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156d9975-12b0-4116-ad2f-6253f30515a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:16.188961 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156d9975-12b0-4116-ad2f-6253f30515a3 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:16.207642 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2ce4b-9715-4358-95eb-242cdbddc18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:16.208572 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2ce4b-9715-4358-95eb-242cdbddc18f admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:16.208864 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2ce4b-9715-4358-95eb-242cdbddc18f admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:16.209148 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2ce4b-9715-4358-95eb-242cdbddc18f admin admin] PATH_INFO: `/v3/projects/f63533ffac1948af9cb32c7c4d78247a/users/593ea59a03f24d91a881a28ac071d6d1/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:16.216158 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 851/1692] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:21:16.216158 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2f7c3-2e1b-4cb5-8f6a-ab71a01c081d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:16.216158 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2f7c3-2e1b-4cb5-8f6a-ab71a01c081d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:16.216158 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2f7c3-2e1b-4cb5-8f6a-ab71a01c081d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:16.248233 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c2ce4b-9715-4358-95eb-242cdbddc18f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f63533ffac1948af9cb32c7c4d78247a, user_id=593ea59a03f24d91a881a28ac071d6d1, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:16.251041 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c2ce4b-9715-4358-95eb-242cdbddc18f admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:16.286062 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 842/1693] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:16 2022] PUT /identity/v3/projects/f63533ffac1948af9cb32c7c4d78247a/users/593ea59a03f24d91a881a28ac071d6d1/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:16.286311 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-8dd2f7c3-2e1b-4cb5-8f6a-ab71a01c081d None None] MFA Rules not processed for user `f2f7f01eb34a486aa78320673c7f1c0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:16.287075 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2ce4b-9715-4358-95eb-242cdbddc18f admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:16.287775 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8dd2f7c3-2e1b-4cb5-8f6a-ab71a01c081d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:16.387951 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:16.428462 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2ce4b-9715-4358-95eb-242cdbddc18f admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:16.434067 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422147ea-28be-42d9-bb4d-0b52ace162ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:16.434818 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422147ea-28be-42d9-bb4d-0b52ace162ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:16.435150 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422147ea-28be-42d9-bb4d-0b52ace162ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:16.435379 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422147ea-28be-42d9-bb4d-0b52ace162ce admin admin] PATH_INFO: `/v3/projects/b177dde55836458c8edc9b4b1d1407e4/users/6045a607f36a42d382e8451ec2dcb610/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:16.447158 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422147ea-28be-42d9-bb4d-0b52ace162ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=b177dde55836458c8edc9b4b1d1407e4, user_id=6045a607f36a42d382e8451ec2dcb610, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:16.450078 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422147ea-28be-42d9-bb4d-0b52ace162ce admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:16.456671 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 852/1694] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:16.458403 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab31f00-1605-4ff8-9592-3eabbbc27abb None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:16.458696 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab31f00-1605-4ff8-9592-3eabbbc27abb None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:16.458976 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab31f00-1605-4ff8-9592-3eabbbc27abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:16.471164 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 843/1695] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:16 2022] PUT /identity/v3/projects/b177dde55836458c8edc9b4b1d1407e4/users/6045a607f36a42d382e8451ec2dcb610/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:16.472523 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422147ea-28be-42d9-bb4d-0b52ace162ce admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:16.482963 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-422147ea-28be-42d9-bb4d-0b52ace162ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:16.539736 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-bab31f00-1605-4ff8-9592-3eabbbc27abb None None] MFA Rules not processed for user `593ea59a03f24d91a881a28ac071d6d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:16.540993 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-bab31f00-1605-4ff8-9592-3eabbbc27abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:16.717495 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422147ea-28be-42d9-bb4d-0b52ace162ce admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:16.734581 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c184a749-b7d6-4d00-988f-8d7f39333dd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7adaa2ef440941aa8214f2b2fd49b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:16.735284 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184a749-b7d6-4d00-988f-8d7f39333dd4 service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:16.735572 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184a749-b7d6-4d00-988f-8d7f39333dd4 service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:16.735852 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184a749-b7d6-4d00-988f-8d7f39333dd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:16.754714 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 853/1696] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:16.759530 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ece0a2-55ea-45d8-948b-22b3b6606c53 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:16.759986 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ece0a2-55ea-45d8-948b-22b3b6606c53 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:16.762064 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ece0a2-55ea-45d8-948b-22b3b6606c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:16.815635 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c7ece0a2-55ea-45d8-948b-22b3b6606c53 None None] MFA Rules not processed for user `6045a607f36a42d382e8451ec2dcb610`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:16.818656 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c7ece0a2-55ea-45d8-948b-22b3b6606c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:16.867146 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c184a749-b7d6-4d00-988f-8d7f39333dd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:16.868627 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c184a749-b7d6-4d00-988f-8d7f39333dd4 service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:16.900783 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 844/1697] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:16.902546 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c184a749-b7d6-4d00-988f-8d7f39333dd4 service nova] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:16.902910 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:17.097986 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 854/1698] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:16 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:17.111032 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ece0a2-55ea-45d8-948b-22b3b6606c53 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:17.113395 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c7ece0a2-55ea-45d8-948b-22b3b6606c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:17.291414 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ece0a2-55ea-45d8-948b-22b3b6606c53 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:17.296788 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9a557-abdd-4846-a491-d09acb710723 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:17.297614 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9a557-abdd-4846-a491-d09acb710723 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:17.298694 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9a557-abdd-4846-a491-d09acb710723 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:17.299101 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9a557-abdd-4846-a491-d09acb710723 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:17.313310 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c9a557-abdd-4846-a491-d09acb710723 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:17.327489 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c9a557-abdd-4846-a491-d09acb710723 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:17.353264 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 855/1699] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:17 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:21:17.355936 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e1a6d-196d-4d25-a72b-b7feabb54dda None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:17.356258 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e1a6d-196d-4d25-a72b-b7feabb54dda None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:17.356703 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e1a6d-196d-4d25-a72b-b7feabb54dda None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:17.358892 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 856/1700] 10.222.0.27 () {54 vars in 921 bytes} [Wed Jun 29 12:21:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:21:17.472622 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c184a749-b7d6-4d00-988f-8d7f39333dd4 service nova] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:17.480016 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d2105-34a3-4c50-b497-773c85847b45 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:17.480610 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d2105-34a3-4c50-b497-773c85847b45 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:17.480610 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d2105-34a3-4c50-b497-773c85847b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:17.504189 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab03b4f-3130-4b5a-851b-42d268f252ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:17.509453 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab03b4f-3130-4b5a-851b-42d268f252ef admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:17.512988 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab03b4f-3130-4b5a-851b-42d268f252ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:17.513169 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab03b4f-3130-4b5a-851b-42d268f252ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:17.513951 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab03b4f-3130-4b5a-851b-42d268f252ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:17.515985 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab03b4f-3130-4b5a-851b-42d268f252ef admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:17.535618 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-067d2105-34a3-4c50-b497-773c85847b45 None None] MFA Rules not processed for user `286a99b42d9246db909040bf8ab18ea1`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:17.536975 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-067d2105-34a3-4c50-b497-773c85847b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:17.569430 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:17.583892 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 845/1701] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:21:16 2022] POST /identity/v3/projects => generated 385 bytes in 682 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:17.584928 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab03b4f-3130-4b5a-851b-42d268f252ef admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:17.702649 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 857/1702] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Jun 29 12:21:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:21:17.703628 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d2105-34a3-4c50-b497-773c85847b45 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:17.723919 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab03b4f-3130-4b5a-851b-42d268f252ef admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:17.729811 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d2105-34a3-4c50-b497-773c85847b45 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:17.737787 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e5060-4d9f-4b7b-972d-abe5a3c5d146 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:17.738489 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e5060-4d9f-4b7b-972d-abe5a3c5d146 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:17.740790 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e5060-4d9f-4b7b-972d-abe5a3c5d146 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:17.741078 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e5060-4d9f-4b7b-972d-abe5a3c5d146 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:17.868934 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e5060-4d9f-4b7b-972d-abe5a3c5d146 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:17.875684 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e5060-4d9f-4b7b-972d-abe5a3c5d146 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:17.911486 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 846/1703] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:17 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:17.912939 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a4c79-dc98-4e09-a812-a32bc94bbc4c None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:17.913226 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a4c79-dc98-4e09-a812-a32bc94bbc4c None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:17.913655 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a4c79-dc98-4e09-a812-a32bc94bbc4c None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:17.915653 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 847/1704] 10.222.0.27 () {54 vars in 960 bytes} [Wed Jun 29 12:21:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:21:17.924573 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4c1d4-ace0-45c3-a07b-46ba152e9052 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:17.924868 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4c1d4-ace0-45c3-a07b-46ba152e9052 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:17.925284 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4c1d4-ace0-45c3-a07b-46ba152e9052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:17.930542 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed1f59-653c-4a2d-aabe-12293cb4bcee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:17.943302 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed1f59-653c-4a2d-aabe-12293cb4bcee admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:17.943302 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed1f59-653c-4a2d-aabe-12293cb4bcee admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:17.943444 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed1f59-653c-4a2d-aabe-12293cb4bcee admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:17.944095 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eed1f59-653c-4a2d-aabe-12293cb4bcee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:17.962273 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eed1f59-653c-4a2d-aabe-12293cb4bcee admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:18.004406 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:18.004746 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-cac4c1d4-ace0-45c3-a07b-46ba152e9052 None None] MFA Rules not processed for user `286a99b42d9246db909040bf8ab18ea1`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:18.006220 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-cac4c1d4-ace0-45c3-a07b-46ba152e9052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:18.033562 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 858/1705] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:21:17 2022] POST /identity/v3/users => generated 299 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:18.037292 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed1f59-653c-4a2d-aabe-12293cb4bcee admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:18.072493 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed1f59-653c-4a2d-aabe-12293cb4bcee admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:18.083615 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2c5fe-100c-4fe0-8d31-e2e013b10d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:18.085144 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2c5fe-100c-4fe0-8d31-e2e013b10d99 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:18.085950 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2c5fe-100c-4fe0-8d31-e2e013b10d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:18.086534 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2c5fe-100c-4fe0-8d31-e2e013b10d99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:18.096447 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee2c5fe-100c-4fe0-8d31-e2e013b10d99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:18.098464 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee2c5fe-100c-4fe0-8d31-e2e013b10d99 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:18.128199 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 859/1706] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:18 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:18.131262 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2c5fe-100c-4fe0-8d31-e2e013b10d99 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:18.173540 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2c5fe-100c-4fe0-8d31-e2e013b10d99 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:18.191953 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ebd8d1-c600-484d-86e2-694f6239e06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:18.195015 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ebd8d1-c600-484d-86e2-694f6239e06c admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:18.197086 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ebd8d1-c600-484d-86e2-694f6239e06c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:18.197406 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ebd8d1-c600-484d-86e2-694f6239e06c admin admin] PATH_INFO: `/v3/projects/d1e3a0d12f8b4db98ff20ac28fb99b9f/users/d43ebc3bc407455080a7cc80d3cd1dcb/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:18.223857 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ebd8d1-c600-484d-86e2-694f6239e06c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1e3a0d12f8b4db98ff20ac28fb99b9f, user_id=d43ebc3bc407455080a7cc80d3cd1dcb, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:18.227732 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ebd8d1-c600-484d-86e2-694f6239e06c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:18.242345 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 848/1707] 10.222.0.27 () {58 vars in 1057 bytes} [Wed Jun 29 12:21:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:18.253193 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 860/1708] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:18 2022] PUT /identity/v3/projects/d1e3a0d12f8b4db98ff20ac28fb99b9f/users/d43ebc3bc407455080a7cc80d3cd1dcb/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:18.257248 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac4c1d4-ace0-45c3-a07b-46ba152e9052 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:18.257491 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ebd8d1-c600-484d-86e2-694f6239e06c admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:18.278381 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac4c1d4-ace0-45c3-a07b-46ba152e9052 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:18.342913 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:18.367725 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f85a6-2ef7-4c19-927b-cd81ce16bc29 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '286a99b42d9246db909040bf8ab18ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:18.368638 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f85a6-2ef7-4c19-927b-cd81ce16bc29 service placement] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:18.368994 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f85a6-2ef7-4c19-927b-cd81ce16bc29 service placement] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:18.369339 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f85a6-2ef7-4c19-927b-cd81ce16bc29 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:18.385030 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f85a6-2ef7-4c19-927b-cd81ce16bc29 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:18.389728 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f85a6-2ef7-4c19-927b-cd81ce16bc29 service placement] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:18.427152 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 849/1709] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:21:18.428418 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f85a6-2ef7-4c19-927b-cd81ce16bc29 service placement] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:18.430485 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-476f85a6-2ef7-4c19-927b-cd81ce16bc29 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:18.443678 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ebd8d1-c600-484d-86e2-694f6239e06c admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:18.451920 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f85a6-2ef7-4c19-927b-cd81ce16bc29 service placement] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:18.459778 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26131dc-d0e3-4852-8f2c-b3d8b57ea621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:18.460869 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26131dc-d0e3-4852-8f2c-b3d8b57ea621 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:18.461129 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26131dc-d0e3-4852-8f2c-b3d8b57ea621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:18.461646 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26131dc-d0e3-4852-8f2c-b3d8b57ea621 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:18.462513 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26131dc-d0e3-4852-8f2c-b3d8b57ea621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:18.466881 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26131dc-d0e3-4852-8f2c-b3d8b57ea621 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:18.472909 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f5aa0-eb01-41e3-8359-6ef66390c654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:18.474295 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f5aa0-eb01-41e3-8359-6ef66390c654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:18.474782 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f5aa0-eb01-41e3-8359-6ef66390c654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:18.475374 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f5aa0-eb01-41e3-8359-6ef66390c654 admin admin] PATH_INFO: `/v3/projects/96c6f7e7766345e58b04cb189eba3546` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:18.476980 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f5aa0-eb01-41e3-8359-6ef66390c654 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96c6f7e7766345e58b04cb189eba3546)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:18.480700 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f5aa0-eb01-41e3-8359-6ef66390c654 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:18.503495 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 861/1710] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:18 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:18.504727 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26131dc-d0e3-4852-8f2c-b3d8b57ea621 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:18.526766 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26131dc-d0e3-4852-8f2c-b3d8b57ea621 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:18.543931 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ffa39f-f425-4cf4-9b64-ac974033fbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:18.544934 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffa39f-f425-4cf4-9b64-ac974033fbed admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:18.545130 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffa39f-f425-4cf4-9b64-ac974033fbed admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:18.545405 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffa39f-f425-4cf4-9b64-ac974033fbed admin admin] PATH_INFO: `/v3/projects/d1e3a0d12f8b4db98ff20ac28fb99b9f/users/d43ebc3bc407455080a7cc80d3cd1dcb/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:18.551419 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ffa39f-f425-4cf4-9b64-ac974033fbed admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1e3a0d12f8b4db98ff20ac28fb99b9f, user_id=d43ebc3bc407455080a7cc80d3cd1dcb, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:18.557923 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ffa39f-f425-4cf4-9b64-ac974033fbed admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:18.578276 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f36f5aa0-eb01-41e3-8359-6ef66390c654 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96c6f7e7766345e58b04cb189eba3546', 'request_id': 'req-f36f5aa0-eb01-41e3-8359-6ef66390c654'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:18.589675 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f36f5aa0-eb01-41e3-8359-6ef66390c654 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96c6f7e7766345e58b04cb189eba3546', 'request_id': 'req-f36f5aa0-eb01-41e3-8359-6ef66390c654'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:18.601734 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 862/1711] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:18 2022] PUT /identity/v3/projects/d1e3a0d12f8b4db98ff20ac28fb99b9f/users/d43ebc3bc407455080a7cc80d3cd1dcb/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:18.606955 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444da88-a81c-41a4-b67c-eeb6eb45a35c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:18.607243 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444da88-a81c-41a4-b67c-eeb6eb45a35c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:18.610403 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444da88-a81c-41a4-b67c-eeb6eb45a35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:18.621512 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f36f5aa0-eb01-41e3-8359-6ef66390c654 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96c6f7e7766345e58b04cb189eba3546', 'request_id': 'req-f36f5aa0-eb01-41e3-8359-6ef66390c654'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:18.647358 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f36f5aa0-eb01-41e3-8359-6ef66390c654 admin admin] The token cache is being invalidate because project 96c6f7e7766345e58b04cb189eba3546 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:21:18.648760 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f36f5aa0-eb01-41e3-8359-6ef66390c654 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:18.651655 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f36f5aa0-eb01-41e3-8359-6ef66390c654 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:18.657438 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 850/1712] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:21:18 2022] DELETE /identity/v3/projects/96c6f7e7766345e58b04cb189eba3546 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:18.662972 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ea9b6-5452-4443-8835-28bd5549e0b3 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:18.663980 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ea9b6-5452-4443-8835-28bd5549e0b3 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:18.664983 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ea9b6-5452-4443-8835-28bd5549e0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:18.688042 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f444da88-a81c-41a4-b67c-eeb6eb45a35c None None] MFA Rules not processed for user `d43ebc3bc407455080a7cc80d3cd1dcb`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:18.693927 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f444da88-a81c-41a4-b67c-eeb6eb45a35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:18.716934 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-5c4ea9b6-5452-4443-8835-28bd5549e0b3 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:18.718859 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-5c4ea9b6-5452-4443-8835-28bd5549e0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:18.857747 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 851/1713] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:18.865024 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd6810-ef40-40a6-a8d0-ba012fc9ca69 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:18.866148 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd6810-ef40-40a6-a8d0-ba012fc9ca69 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:18.866718 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd6810-ef40-40a6-a8d0-ba012fc9ca69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:18.920264 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-81bd6810-ef40-40a6-a8d0-ba012fc9ca69 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:18.924131 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-81bd6810-ef40-40a6-a8d0-ba012fc9ca69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:18.949686 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 852/1714] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:18.958091 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 863/1715] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:18 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:18.960850 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f444da88-a81c-41a4-b67c-eeb6eb45a35c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:18.962521 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f444da88-a81c-41a4-b67c-eeb6eb45a35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:18.962711 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd6810-ef40-40a6-a8d0-ba012fc9ca69 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:18.985605 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd6810-ef40-40a6-a8d0-ba012fc9ca69 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:18.998507 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61444f0e-9fef-44dc-a972-d7d4fa3fe479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:19.001723 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61444f0e-9fef-44dc-a972-d7d4fa3fe479 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:19.002195 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61444f0e-9fef-44dc-a972-d7d4fa3fe479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:19.002899 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61444f0e-9fef-44dc-a972-d7d4fa3fe479 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:19.003663 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61444f0e-9fef-44dc-a972-d7d4fa3fe479 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:21:19.003994 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61444f0e-9fef-44dc-a972-d7d4fa3fe479 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:19.009658 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61444f0e-9fef-44dc-a972-d7d4fa3fe479 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:19.043972 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:19.075973 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 853/1716] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:21:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:21:19.080325 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61444f0e-9fef-44dc-a972-d7d4fa3fe479 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:19.119352 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61444f0e-9fef-44dc-a972-d7d4fa3fe479 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:19.134629 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf14045-05ef-4616-8d11-0030474c5869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:19.137742 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf14045-05ef-4616-8d11-0030474c5869 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:19.140392 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf14045-05ef-4616-8d11-0030474c5869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:19.142120 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf14045-05ef-4616-8d11-0030474c5869 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:19.143264 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf14045-05ef-4616-8d11-0030474c5869 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:19.149735 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f444da88-a81c-41a4-b67c-eeb6eb45a35c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:19.153818 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf14045-05ef-4616-8d11-0030474c5869 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:19.165945 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eff327-c80f-4fcd-a772-e6bbce0e5437 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:19.166748 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eff327-c80f-4fcd-a772-e6bbce0e5437 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:19.167033 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eff327-c80f-4fcd-a772-e6bbce0e5437 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:19.167310 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eff327-c80f-4fcd-a772-e6bbce0e5437 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:19.191724 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eff327-c80f-4fcd-a772-e6bbce0e5437 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:19.193634 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eff327-c80f-4fcd-a772-e6bbce0e5437 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:19.227193 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 864/1717] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:18 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:19.266559 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 854/1718] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:21:19 2022] POST /identity/v3/projects => generated 367 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:19.267678 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eff327-c80f-4fcd-a772-e6bbce0e5437 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:19.292908 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eff327-c80f-4fcd-a772-e6bbce0e5437 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:19.399262 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b41cb4-2aea-4d8e-a1f7-e2b0a720df85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:19.399987 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b41cb4-2aea-4d8e-a1f7-e2b0a720df85 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:19.400700 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b41cb4-2aea-4d8e-a1f7-e2b0a720df85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:19.400985 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b41cb4-2aea-4d8e-a1f7-e2b0a720df85 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:19.401740 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b41cb4-2aea-4d8e-a1f7-e2b0a720df85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:19.406421 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b41cb4-2aea-4d8e-a1f7-e2b0a720df85 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:19.482520 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 865/1719] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:21:19 2022] POST /identity/v3/users => generated 284 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:19.487178 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf14045-05ef-4616-8d11-0030474c5869 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:19.505918 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf14045-05ef-4616-8d11-0030474c5869 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:19.535949 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b02408-396a-4ec8-b329-f1e893bf70fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:19.537775 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b02408-396a-4ec8-b329-f1e893bf70fc admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:19.538253 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b02408-396a-4ec8-b329-f1e893bf70fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:19.539328 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b02408-396a-4ec8-b329-f1e893bf70fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:19.542397 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b02408-396a-4ec8-b329-f1e893bf70fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:19.547002 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b02408-396a-4ec8-b329-f1e893bf70fc admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:19.611689 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 855/1720] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:19 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:19.624499 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b41cb4-2aea-4d8e-a1f7-e2b0a720df85 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:19.661516 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b41cb4-2aea-4d8e-a1f7-e2b0a720df85 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:19.683893 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674323cf-72a5-407e-a796-4ecc69763fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:19.685572 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674323cf-72a5-407e-a796-4ecc69763fec admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:19.689280 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674323cf-72a5-407e-a796-4ecc69763fec admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:19.692960 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674323cf-72a5-407e-a796-4ecc69763fec admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:19.703946 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674323cf-72a5-407e-a796-4ecc69763fec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:19.710824 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674323cf-72a5-407e-a796-4ecc69763fec admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:19.765273 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 866/1721] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:19 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:19.768653 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b02408-396a-4ec8-b329-f1e893bf70fc admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:19.800586 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b02408-396a-4ec8-b329-f1e893bf70fc admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:19.835067 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e2c2d2-735d-4c03-ad24-4d627bce39f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:19.839857 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2c2d2-735d-4c03-ad24-4d627bce39f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:19.841161 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2c2d2-735d-4c03-ad24-4d627bce39f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:19.842369 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2c2d2-735d-4c03-ad24-4d627bce39f6 admin admin] PATH_INFO: `/v3/projects/6647eb58e76649e1a1eec717f182bb3f/users/cd519db85ed2457eba042cf2357d18d1/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:19.879659 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:19.908882 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e2c2d2-735d-4c03-ad24-4d627bce39f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6647eb58e76649e1a1eec717f182bb3f, user_id=cd519db85ed2457eba042cf2357d18d1, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:19.915292 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e2c2d2-735d-4c03-ad24-4d627bce39f6 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:19.954437 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 856/1722] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:19 2022] PUT /identity/v3/projects/6647eb58e76649e1a1eec717f182bb3f/users/cd519db85ed2457eba042cf2357d18d1/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:19.956953 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd2435-9c5c-41b4-89ad-f3eb8a65b368 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:19.957279 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd2435-9c5c-41b4-89ad-f3eb8a65b368 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:19.957675 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd2435-9c5c-41b4-89ad-f3eb8a65b368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:20.036228 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-17bd2435-9c5c-41b4-89ad-f3eb8a65b368 None None] MFA Rules not processed for user `cd519db85ed2457eba042cf2357d18d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:20.037516 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-17bd2435-9c5c-41b4-89ad-f3eb8a65b368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:20.248798 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 867/1723] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:19 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:20.361177 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e2c2d2-735d-4c03-ad24-4d627bce39f6 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:20.520360 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e2c2d2-735d-4c03-ad24-4d627bce39f6 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:20.529632 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1722160-a0e4-4ec1-9be0-edd7960caeb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:20.530349 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1722160-a0e4-4ec1-9be0-edd7960caeb9 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:20.530613 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1722160-a0e4-4ec1-9be0-edd7960caeb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:20.530883 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1722160-a0e4-4ec1-9be0-edd7960caeb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:20.552051 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1722160-a0e4-4ec1-9be0-edd7960caeb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:20.553560 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1722160-a0e4-4ec1-9be0-edd7960caeb9 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:20.579679 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 857/1724] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:20 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:20.890406 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bd2435-9c5c-41b4-89ad-f3eb8a65b368 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:20.894352 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-17bd2435-9c5c-41b4-89ad-f3eb8a65b368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:20.922064 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bd2435-9c5c-41b4-89ad-f3eb8a65b368 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:20.940136 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a89284-7c4c-4958-a7a1-dd516fe0a247 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:20.940822 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a89284-7c4c-4958-a7a1-dd516fe0a247 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:20.941279 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a89284-7c4c-4958-a7a1-dd516fe0a247 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:20.949824 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a89284-7c4c-4958-a7a1-dd516fe0a247 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:20.955219 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-10a89284-7c4c-4958-a7a1-dd516fe0a247 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:21.099455 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:21.191151 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a89284-7c4c-4958-a7a1-dd516fe0a247 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:21.196038 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a89284-7c4c-4958-a7a1-dd516fe0a247 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:21.220735 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5a87f-198b-470e-a427-5bf6bc1bc872 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:21.221654 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5a87f-198b-470e-a427-5bf6bc1bc872 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:21.222108 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5a87f-198b-470e-a427-5bf6bc1bc872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:21.246340 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 868/1725] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:21:21.266387 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-ced5a87f-198b-470e-a427-5bf6bc1bc872 None None] MFA Rules not processed for user `b83b4edd5b5a43678e3085f403be1c27`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:21.267994 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ced5a87f-198b-470e-a427-5bf6bc1bc872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:21.475330 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 858/1726] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:21:21.477322 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446f474-9cae-47a9-b0ad-5ef54ff11f7f None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:21.477556 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446f474-9cae-47a9-b0ad-5ef54ff11f7f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:21.477979 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446f474-9cae-47a9-b0ad-5ef54ff11f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:21.506127 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f446f474-9cae-47a9-b0ad-5ef54ff11f7f None None] MFA Rules not processed for user `b83b4edd5b5a43678e3085f403be1c27`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:21.507418 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f446f474-9cae-47a9-b0ad-5ef54ff11f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:21.541224 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 869/1727] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:21.559316 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced5a87f-198b-470e-a427-5bf6bc1bc872 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:21.560776 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ced5a87f-198b-470e-a427-5bf6bc1bc872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:21.789255 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced5a87f-198b-470e-a427-5bf6bc1bc872 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:21.808131 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9667ed-4832-4074-9249-8afa927983fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7adaa2ef440941aa8214f2b2fd49b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:21.808856 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9667ed-4832-4074-9249-8afa927983fe service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:21.809281 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9667ed-4832-4074-9249-8afa927983fe service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:21.809717 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9667ed-4832-4074-9249-8afa927983fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:21.830230 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9667ed-4832-4074-9249-8afa927983fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:21.835739 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9667ed-4832-4074-9249-8afa927983fe service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:21.886180 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 859/1728] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:21 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:21:22.012800 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df859888-421f-46e9-9cb1-ebdacab60930 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:22.014533 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df859888-421f-46e9-9cb1-ebdacab60930 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:22.015046 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df859888-421f-46e9-9cb1-ebdacab60930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:22.056117 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f8651-0bab-44b6-bea4-40ace4bbb311 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:22.056624 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f8651-0bab-44b6-bea4-40ace4bbb311 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:22.057042 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f8651-0bab-44b6-bea4-40ace4bbb311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:22.068179 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:22.078119 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-df859888-421f-46e9-9cb1-ebdacab60930 None None] MFA Rules not processed for user `f2f7f01eb34a486aa78320673c7f1c0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:22.082911 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-df859888-421f-46e9-9cb1-ebdacab60930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:22.096660 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-596f8651-0bab-44b6-bea4-40ace4bbb311 None None] MFA Rules not processed for user `6ec17bc9af1e497590bf0ac31f29d463`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:22.098331 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-596f8651-0bab-44b6-bea4-40ace4bbb311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:22.364433 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 870/1729] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:22.484582 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df859888-421f-46e9-9cb1-ebdacab60930 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:22.487218 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-df859888-421f-46e9-9cb1-ebdacab60930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:22.506250 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 860/1730] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 452 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:21:22.525249 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaae534-776c-4e2e-9b61-05b3a7ffed01 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:22.526246 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaae534-776c-4e2e-9b61-05b3a7ffed01 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:22.527325 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaae534-776c-4e2e-9b61-05b3a7ffed01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:22.631743 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-ceaae534-776c-4e2e-9b61-05b3a7ffed01 None None] MFA Rules not processed for user `6ec17bc9af1e497590bf0ac31f29d463`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:22.639789 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ceaae534-776c-4e2e-9b61-05b3a7ffed01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:22.669987 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 861/1731] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:22.860084 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df859888-421f-46e9-9cb1-ebdacab60930 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:22.883117 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc73ca48-7124-490e-9d2a-7e69ef4bf07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:22.884039 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73ca48-7124-490e-9d2a-7e69ef4bf07a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:22.894258 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73ca48-7124-490e-9d2a-7e69ef4bf07a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:22.894258 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73ca48-7124-490e-9d2a-7e69ef4bf07a admin admin] PATH_INFO: `/v3/users/6d7899f68b474e24b0c49f6b800fa093` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:22.894258 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc73ca48-7124-490e-9d2a-7e69ef4bf07a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d7899f68b474e24b0c49f6b800fa093)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:22.905735 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc73ca48-7124-490e-9d2a-7e69ef4bf07a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:23.128574 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fc73ca48-7124-490e-9d2a-7e69ef4bf07a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d7899f68b474e24b0c49f6b800fa093'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:23.130208 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fc73ca48-7124-490e-9d2a-7e69ef4bf07a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d7899f68b474e24b0c49f6b800fa093'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:23.131506 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fc73ca48-7124-490e-9d2a-7e69ef4bf07a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d7899f68b474e24b0c49f6b800fa093'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:23.169105 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fc73ca48-7124-490e-9d2a-7e69ef4bf07a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d7899f68b474e24b0c49f6b800fa093'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:23.188732 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fc73ca48-7124-490e-9d2a-7e69ef4bf07a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d7899f68b474e24b0c49f6b800fa093'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:23.199845 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:23.228315 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 871/1732] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:21:22 2022] DELETE /identity/v3/users/6d7899f68b474e24b0c49f6b800fa093 => generated 0 bytes in 744 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:21:23.555175 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f1820-69d6-496d-a115-1b00f78966a6 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:23.555662 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f1820-69d6-496d-a115-1b00f78966a6 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:23.555662 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f1820-69d6-496d-a115-1b00f78966a6 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:23.557106 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 862/1733] 10.222.0.27 () {54 vars in 912 bytes} [Wed Jun 29 12:21:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:21:23.566251 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a30408-00db-4527-94b5-9b01d7c41b58 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:23.566673 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a30408-00db-4527-94b5-9b01d7c41b58 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:23.567049 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a30408-00db-4527-94b5-9b01d7c41b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:23.651634 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c5a30408-00db-4527-94b5-9b01d7c41b58 None None] MFA Rules not processed for user `e94618bb382d46f7aaa2ef8f5d690bf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:23.653631 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c5a30408-00db-4527-94b5-9b01d7c41b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:23.896598 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 872/1734] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Jun 29 12:21:23 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:21:23.926023 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8400840c-5415-4c38-b026-a1f7013c6fbd None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:23.926331 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8400840c-5415-4c38-b026-a1f7013c6fbd None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:23.926681 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8400840c-5415-4c38-b026-a1f7013c6fbd None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:23.928056 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 863/1735] 10.222.0.27 () {54 vars in 912 bytes} [Wed Jun 29 12:21:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:21:23.942788 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36424229-d77c-479c-9301-dc2e74f274b9 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:23.948074 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36424229-d77c-479c-9301-dc2e74f274b9 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:23.956487 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36424229-d77c-479c-9301-dc2e74f274b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:23.991009 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-36424229-d77c-479c-9301-dc2e74f274b9 None None] MFA Rules not processed for user `e94618bb382d46f7aaa2ef8f5d690bf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:23.995009 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-36424229-d77c-479c-9301-dc2e74f274b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:24.005842 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 873/1736] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Jun 29 12:21:23 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:24.022311 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8400840c-5415-4c38-b026-a1f7013c6fbd None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:24.064049 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-8400840c-5415-4c38-b026-a1f7013c6fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:24.080460 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36424229-d77c-479c-9301-dc2e74f274b9 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:24.082435 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-36424229-d77c-479c-9301-dc2e74f274b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:24.106653 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36424229-d77c-479c-9301-dc2e74f274b9 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:24.124271 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b946f460-fa38-4109-80db-1c5d7bdf1de9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:24.125395 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946f460-fa38-4109-80db-1c5d7bdf1de9 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:24.126004 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946f460-fa38-4109-80db-1c5d7bdf1de9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:24.135036 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946f460-fa38-4109-80db-1c5d7bdf1de9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:24.147211 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8400840c-5415-4c38-b026-a1f7013c6fbd None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:24.166026 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac39964-1396-482d-a7d6-7e2a884e39a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:24.172770 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac39964-1396-482d-a7d6-7e2a884e39a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:24.175366 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac39964-1396-482d-a7d6-7e2a884e39a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:24.179040 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac39964-1396-482d-a7d6-7e2a884e39a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:24.179456 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b946f460-fa38-4109-80db-1c5d7bdf1de9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:24.181578 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b946f460-fa38-4109-80db-1c5d7bdf1de9 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:24.205933 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 874/1737] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:21:24.206876 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b946f460-fa38-4109-80db-1c5d7bdf1de9 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:24.209906 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b946f460-fa38-4109-80db-1c5d7bdf1de9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:24.225431 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac39964-1396-482d-a7d6-7e2a884e39a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:24.228560 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac39964-1396-482d-a7d6-7e2a884e39a5 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:24.275727 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 864/1738] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:24.514963 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b946f460-fa38-4109-80db-1c5d7bdf1de9 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:24.537179 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca8ed0-86c5-4724-8145-5c99b1921c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:24.538864 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca8ed0-86c5-4724-8145-5c99b1921c44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:24.539581 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca8ed0-86c5-4724-8145-5c99b1921c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:24.541166 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca8ed0-86c5-4724-8145-5c99b1921c44 admin admin] PATH_INFO: `/v3/projects/80d8f68d6a464db6b7aedb1714c32894` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:24.544028 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ca8ed0-86c5-4724-8145-5c99b1921c44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80d8f68d6a464db6b7aedb1714c32894)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:24.547035 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ca8ed0-86c5-4724-8145-5c99b1921c44 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:24.707247 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-90ca8ed0-86c5-4724-8145-5c99b1921c44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80d8f68d6a464db6b7aedb1714c32894', 'request_id': 'req-90ca8ed0-86c5-4724-8145-5c99b1921c44'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:24.748605 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-90ca8ed0-86c5-4724-8145-5c99b1921c44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80d8f68d6a464db6b7aedb1714c32894', 'request_id': 'req-90ca8ed0-86c5-4724-8145-5c99b1921c44'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:24.774647 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-90ca8ed0-86c5-4724-8145-5c99b1921c44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80d8f68d6a464db6b7aedb1714c32894', 'request_id': 'req-90ca8ed0-86c5-4724-8145-5c99b1921c44'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:24.812779 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-90ca8ed0-86c5-4724-8145-5c99b1921c44 admin admin] The token cache is being invalidate because project 80d8f68d6a464db6b7aedb1714c32894 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:21:24.813110 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-90ca8ed0-86c5-4724-8145-5c99b1921c44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:24.817853 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-90ca8ed0-86c5-4724-8145-5c99b1921c44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:24.823825 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 875/1739] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:21:24 2022] DELETE /identity/v3/projects/80d8f68d6a464db6b7aedb1714c32894 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:24.828853 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac39964-1396-482d-a7d6-7e2a884e39a5 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:24.869848 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac39964-1396-482d-a7d6-7e2a884e39a5 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:25.262814 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94186583-7dad-457e-826d-e11bb208b59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:25.264326 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94186583-7dad-457e-826d-e11bb208b59d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:25.264823 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94186583-7dad-457e-826d-e11bb208b59d admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:25.266574 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94186583-7dad-457e-826d-e11bb208b59d admin admin] PATH_INFO: `/v3/users/d8f8e21682264f0198431b5360678171` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:25.268776 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94186583-7dad-457e-826d-e11bb208b59d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8f8e21682264f0198431b5360678171)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:25.273349 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94186583-7dad-457e-826d-e11bb208b59d admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:25.439197 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-94186583-7dad-457e-826d-e11bb208b59d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8f8e21682264f0198431b5360678171'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:25.500249 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-94186583-7dad-457e-826d-e11bb208b59d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8f8e21682264f0198431b5360678171'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:25.553814 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca8ed0-86c5-4724-8145-5c99b1921c44 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:25.560663 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-90ca8ed0-86c5-4724-8145-5c99b1921c44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:25.575837 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-94186583-7dad-457e-826d-e11bb208b59d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8f8e21682264f0198431b5360678171'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:25.584486 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-94186583-7dad-457e-826d-e11bb208b59d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8f8e21682264f0198431b5360678171'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:25.595226 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:25.624870 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:25.643887 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-94186583-7dad-457e-826d-e11bb208b59d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8f8e21682264f0198431b5360678171'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:25.676233 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 865/1740] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:21:24 2022] DELETE /identity/v3/users/d8f8e21682264f0198431b5360678171 => generated 0 bytes in 848 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:21:25.860073 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94186583-7dad-457e-826d-e11bb208b59d admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:25.863145 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-94186583-7dad-457e-826d-e11bb208b59d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:26.083848 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca8ed0-86c5-4724-8145-5c99b1921c44 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:26.230566 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94186583-7dad-457e-826d-e11bb208b59d admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:26.261059 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804079d3-51ec-42af-a3a7-edeb7f2b5d64 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '286a99b42d9246db909040bf8ab18ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:26.261719 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804079d3-51ec-42af-a3a7-edeb7f2b5d64 service placement] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:26.262034 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804079d3-51ec-42af-a3a7-edeb7f2b5d64 service placement] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:26.262312 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804079d3-51ec-42af-a3a7-edeb7f2b5d64 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:26.271663 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-804079d3-51ec-42af-a3a7-edeb7f2b5d64 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:26.337572 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804079d3-51ec-42af-a3a7-edeb7f2b5d64 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:26.343374 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804079d3-51ec-42af-a3a7-edeb7f2b5d64 service placement] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:26.402994 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 866/1741] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:21:26.403994 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804079d3-51ec-42af-a3a7-edeb7f2b5d64 service placement] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:26.411782 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-804079d3-51ec-42af-a3a7-edeb7f2b5d64 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:26.423983 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f20a8-a6d9-471f-b0f6-a795c5468ba2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7adaa2ef440941aa8214f2b2fd49b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:26.424679 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f20a8-a6d9-471f-b0f6-a795c5468ba2 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:26.424988 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f20a8-a6d9-471f-b0f6-a795c5468ba2 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:26.425272 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f20a8-a6d9-471f-b0f6-a795c5468ba2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:26.440779 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-501f20a8-a6d9-471f-b0f6-a795c5468ba2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:26.476464 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804079d3-51ec-42af-a3a7-edeb7f2b5d64 service placement] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:26.508415 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ac381-be9c-40d4-87e8-6f3c1fb15130 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '286a99b42d9246db909040bf8ab18ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:26.513732 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ac381-be9c-40d4-87e8-6f3c1fb15130 service placement] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:26.514108 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ac381-be9c-40d4-87e8-6f3c1fb15130 service placement] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:26.514393 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ac381-be9c-40d4-87e8-6f3c1fb15130 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:26.579060 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9ac381-be9c-40d4-87e8-6f3c1fb15130 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:26.587411 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9ac381-be9c-40d4-87e8-6f3c1fb15130 service placement] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:26.626130 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 867/1742] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:26.627148 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ac381-be9c-40d4-87e8-6f3c1fb15130 service placement] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:26.644518 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-eb9ac381-be9c-40d4-87e8-6f3c1fb15130 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:26.864399 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f20a8-a6d9-471f-b0f6-a795c5468ba2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:26.870135 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f20a8-a6d9-471f-b0f6-a795c5468ba2 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:26.911897 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 876/1743] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 1362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:27.138219 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ac381-be9c-40d4-87e8-6f3c1fb15130 service placement] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:27.186994 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edde340-34fe-407e-a0d1-d99f543ff69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:27.190319 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edde340-34fe-407e-a0d1-d99f543ff69d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:27.191097 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edde340-34fe-407e-a0d1-d99f543ff69d admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:27.197604 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edde340-34fe-407e-a0d1-d99f543ff69d admin admin] PATH_INFO: `/v3/projects/76e03ab7f5f048f2a2f73485ba105969` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:27.208155 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edde340-34fe-407e-a0d1-d99f543ff69d admin admin] RBAC: Authorizing `identity:delete_project(project_id=76e03ab7f5f048f2a2f73485ba105969)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:27.216141 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edde340-34fe-407e-a0d1-d99f543ff69d admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:27.412667 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-8edde340-34fe-407e-a0d1-d99f543ff69d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76e03ab7f5f048f2a2f73485ba105969', 'request_id': 'req-8edde340-34fe-407e-a0d1-d99f543ff69d'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:27.432120 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-8edde340-34fe-407e-a0d1-d99f543ff69d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76e03ab7f5f048f2a2f73485ba105969', 'request_id': 'req-8edde340-34fe-407e-a0d1-d99f543ff69d'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:27.443387 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-8edde340-34fe-407e-a0d1-d99f543ff69d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76e03ab7f5f048f2a2f73485ba105969', 'request_id': 'req-8edde340-34fe-407e-a0d1-d99f543ff69d'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:27.479794 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:27.495352 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-8edde340-34fe-407e-a0d1-d99f543ff69d admin admin] The token cache is being invalidate because project 76e03ab7f5f048f2a2f73485ba105969 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:21:27.496332 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-8edde340-34fe-407e-a0d1-d99f543ff69d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:27.501302 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-8edde340-34fe-407e-a0d1-d99f543ff69d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:27.523111 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 868/1744] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:21:26 2022] DELETE /identity/v3/projects/76e03ab7f5f048f2a2f73485ba105969 => generated 0 bytes in 891 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:27.528485 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163b28e-1ee0-4776-abc2-c03064ac9b99 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:27.528915 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163b28e-1ee0-4776-abc2-c03064ac9b99 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:27.529012 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163b28e-1ee0-4776-abc2-c03064ac9b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:27.607532 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-3163b28e-1ee0-4776-abc2-c03064ac9b99 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:27.613731 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3163b28e-1ee0-4776-abc2-c03064ac9b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:27.814380 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:27.943267 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 877/1745] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:27.955877 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a31d7-4cb0-4b51-865c-1b6499fa789d None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:27.956165 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a31d7-4cb0-4b51-865c-1b6499fa789d None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:27.956577 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a31d7-4cb0-4b51-865c-1b6499fa789d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:28.040665 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-3b1a31d7-4cb0-4b51-865c-1b6499fa789d None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:28.049290 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-3b1a31d7-4cb0-4b51-865c-1b6499fa789d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:28.126613 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 869/1746] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:28.144973 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3163b28e-1ee0-4776-abc2-c03064ac9b99 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:28.177379 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3163b28e-1ee0-4776-abc2-c03064ac9b99 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:28.205948 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f25f98-8cdc-438f-bb55-5708a6292334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:28.207552 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f25f98-8cdc-438f-bb55-5708a6292334 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:28.208241 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f25f98-8cdc-438f-bb55-5708a6292334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:28.208995 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f25f98-8cdc-438f-bb55-5708a6292334 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:28.211876 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f25f98-8cdc-438f-bb55-5708a6292334 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:21:28.216696 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f25f98-8cdc-438f-bb55-5708a6292334 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:28.221054 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f25f98-8cdc-438f-bb55-5708a6292334 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:28.283760 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 878/1747] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:21:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:21:28.290317 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a31d7-4cb0-4b51-865c-1b6499fa789d None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:28.313391 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a31d7-4cb0-4b51-865c-1b6499fa789d None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:28.323132 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42544fb-9754-4b95-8540-ec5446d7b4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:28.324604 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42544fb-9754-4b95-8540-ec5446d7b4e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:28.325303 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42544fb-9754-4b95-8540-ec5446d7b4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:28.328282 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42544fb-9754-4b95-8540-ec5446d7b4e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:28.329832 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42544fb-9754-4b95-8540-ec5446d7b4e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:28.334062 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42544fb-9754-4b95-8540-ec5446d7b4e3 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:28.403375 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 870/1748] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:21:28 2022] POST /identity/v3/projects => generated 363 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:28.411063 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f25f98-8cdc-438f-bb55-5708a6292334 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:28.462526 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f25f98-8cdc-438f-bb55-5708a6292334 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:28.734385 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42544fb-9754-4b95-8540-ec5446d7b4e3 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:28.736968 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-d42544fb-9754-4b95-8540-ec5446d7b4e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:28.801612 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625566cd-58f9-4c50-8cbf-91e518fd923c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:28.805206 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625566cd-58f9-4c50-8cbf-91e518fd923c admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:28.805755 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625566cd-58f9-4c50-8cbf-91e518fd923c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:28.806827 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625566cd-58f9-4c50-8cbf-91e518fd923c admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:28.808938 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625566cd-58f9-4c50-8cbf-91e518fd923c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:28.814433 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625566cd-58f9-4c50-8cbf-91e518fd923c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:28.853605 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 879/1749] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:21:28 2022] POST /identity/v3/users => generated 282 bytes in 444 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:28.865585 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625566cd-58f9-4c50-8cbf-91e518fd923c admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:28.879762 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625566cd-58f9-4c50-8cbf-91e518fd923c admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:28.886645 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeca987-6dd7-478f-a17c-160691285d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:28.888279 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeca987-6dd7-478f-a17c-160691285d0c admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:28.888571 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeca987-6dd7-478f-a17c-160691285d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:28.888846 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeca987-6dd7-478f-a17c-160691285d0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:28.889804 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeca987-6dd7-478f-a17c-160691285d0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:28.892697 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeca987-6dd7-478f-a17c-160691285d0c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:28.913068 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 880/1750] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:28.914927 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeca987-6dd7-478f-a17c-160691285d0c admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:28.928524 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42544fb-9754-4b95-8540-ec5446d7b4e3 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:28.935455 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d716911-25dc-42d0-995b-d6b43f4a17d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:28.936145 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d716911-25dc-42d0-995b-d6b43f4a17d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:28.936427 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d716911-25dc-42d0-995b-d6b43f4a17d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:28.936801 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d716911-25dc-42d0-995b-d6b43f4a17d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:28.939427 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeca987-6dd7-478f-a17c-160691285d0c admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:28.942418 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-3d716911-25dc-42d0-995b-d6b43f4a17d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:28.952721 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505987dc-23e3-4faf-b795-bfcb28f5f5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:28.953603 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505987dc-23e3-4faf-b795-bfcb28f5f5cb admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:28.953897 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505987dc-23e3-4faf-b795-bfcb28f5f5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:28.956257 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505987dc-23e3-4faf-b795-bfcb28f5f5cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:28.957073 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505987dc-23e3-4faf-b795-bfcb28f5f5cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:28.962446 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505987dc-23e3-4faf-b795-bfcb28f5f5cb admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:29.009609 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 881/1751] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:29.021061 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505987dc-23e3-4faf-b795-bfcb28f5f5cb admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:29.050354 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505987dc-23e3-4faf-b795-bfcb28f5f5cb admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:29.062372 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102de010-691a-4190-b145-8a41f9d7f3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:29.063294 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102de010-691a-4190-b145-8a41f9d7f3f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:29.064930 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102de010-691a-4190-b145-8a41f9d7f3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:29.065274 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102de010-691a-4190-b145-8a41f9d7f3f5 admin admin] PATH_INFO: `/v3/projects/6281a7d46c924062a31824e08c04489b/users/50848cd4adc646e1b12d6908570a597b/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:29.140770 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d716911-25dc-42d0-995b-d6b43f4a17d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:29.143894 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d716911-25dc-42d0-995b-d6b43f4a17d3 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:29.168018 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102de010-691a-4190-b145-8a41f9d7f3f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6281a7d46c924062a31824e08c04489b, user_id=50848cd4adc646e1b12d6908570a597b, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:29.169982 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 871/1752] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:29.178192 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102de010-691a-4190-b145-8a41f9d7f3f5 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:29.234767 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 882/1753] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:29 2022] PUT /identity/v3/projects/6281a7d46c924062a31824e08c04489b/users/50848cd4adc646e1b12d6908570a597b/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:29.264436 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed2de0-ab7b-4585-b736-52510964e3f5 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:29.265076 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed2de0-ab7b-4585-b736-52510964e3f5 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:29.265755 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed2de0-ab7b-4585-b736-52510964e3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:29.410034 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-69ed2de0-ab7b-4585-b736-52510964e3f5 None None] MFA Rules not processed for user `50848cd4adc646e1b12d6908570a597b`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:29.417316 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-69ed2de0-ab7b-4585-b736-52510964e3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:29.662033 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955a437-6e34-41c0-95de-add9393663d7 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:29.662391 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955a437-6e34-41c0-95de-add9393663d7 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:29.662664 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955a437-6e34-41c0-95de-add9393663d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:29.735117 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-8955a437-6e34-41c0-95de-add9393663d7 None None] MFA Rules not processed for user `6ec17bc9af1e497590bf0ac31f29d463`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:29.746554 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8955a437-6e34-41c0-95de-add9393663d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:29.881383 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 872/1754] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:29 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 624 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:29.882395 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed2de0-ab7b-4585-b736-52510964e3f5 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:29.961333 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:29.977861 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 883/1755] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:30.145896 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed2de0-ab7b-4585-b736-52510964e3f5 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:30.174003 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99fe98c-6e36-48db-985f-2d2a00fcc62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:30.174747 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99fe98c-6e36-48db-985f-2d2a00fcc62b admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:30.175031 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99fe98c-6e36-48db-985f-2d2a00fcc62b admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:30.175306 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99fe98c-6e36-48db-985f-2d2a00fcc62b admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:30.176060 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99fe98c-6e36-48db-985f-2d2a00fcc62b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:30.184700 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99fe98c-6e36-48db-985f-2d2a00fcc62b admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:30.301265 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 873/1756] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:21:29 2022] POST /identity/v3/projects => generated 363 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:30.306415 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8955a437-6e34-41c0-95de-add9393663d7 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:30.337135 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8955a437-6e34-41c0-95de-add9393663d7 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:30.416768 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:30.562150 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45945043-e0c3-425f-8d00-67916f6c42f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:30.563689 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45945043-e0c3-425f-8d00-67916f6c42f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:30.564385 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45945043-e0c3-425f-8d00-67916f6c42f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:30.566129 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45945043-e0c3-425f-8d00-67916f6c42f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:30.567491 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45945043-e0c3-425f-8d00-67916f6c42f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:30.575518 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45945043-e0c3-425f-8d00-67916f6c42f7 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:30.613187 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 884/1757] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:21:30 2022] POST /identity/v3/users => generated 288 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:30.621124 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99fe98c-6e36-48db-985f-2d2a00fcc62b admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:30.632638 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99fe98c-6e36-48db-985f-2d2a00fcc62b admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:30.649076 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00182800-20e9-4547-a8b8-f16b8d3a8e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:30.649794 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00182800-20e9-4547-a8b8-f16b8d3a8e3e admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:30.650079 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00182800-20e9-4547-a8b8-f16b8d3a8e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:30.650350 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00182800-20e9-4547-a8b8-f16b8d3a8e3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:30.651157 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00182800-20e9-4547-a8b8-f16b8d3a8e3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:30.652814 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00182800-20e9-4547-a8b8-f16b8d3a8e3e admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:30.679416 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 874/1758] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:30.701382 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45945043-e0c3-425f-8d00-67916f6c42f7 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:30.815715 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45945043-e0c3-425f-8d00-67916f6c42f7 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:30.864349 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992243cd-6e65-4c07-8786-a94d53a67b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:30.870079 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992243cd-6e65-4c07-8786-a94d53a67b7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:30.873151 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992243cd-6e65-4c07-8786-a94d53a67b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:30.874188 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992243cd-6e65-4c07-8786-a94d53a67b7e admin admin] PATH_INFO: `/v3/projects/d281d93edb134e82a8a1e0d49e41a869/users/8f28ad640fe4498aafec7e8eff4c1798/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:30.926021 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992243cd-6e65-4c07-8786-a94d53a67b7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d281d93edb134e82a8a1e0d49e41a869, user_id=8f28ad640fe4498aafec7e8eff4c1798, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:30.938576 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992243cd-6e65-4c07-8786-a94d53a67b7e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:30.978794 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 885/1759] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:30 2022] PUT /identity/v3/projects/d281d93edb134e82a8a1e0d49e41a869/users/8f28ad640fe4498aafec7e8eff4c1798/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:30.985162 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00182800-20e9-4547-a8b8-f16b8d3a8e3e admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:31.010489 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00182800-20e9-4547-a8b8-f16b8d3a8e3e admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:31.176409 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9cef45-8987-4266-a66d-3e0978450d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:31.177319 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9cef45-8987-4266-a66d-3e0978450d10 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:31.177777 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9cef45-8987-4266-a66d-3e0978450d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:31.178190 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9cef45-8987-4266-a66d-3e0978450d10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:31.179130 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9cef45-8987-4266-a66d-3e0978450d10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:31.180992 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9cef45-8987-4266-a66d-3e0978450d10 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:31.207332 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 875/1760] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:21:31.215723 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992243cd-6e65-4c07-8786-a94d53a67b7e admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:31.243062 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992243cd-6e65-4c07-8786-a94d53a67b7e admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:31.276528 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8063a490-2411-4b56-af6c-a1024ed8951f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:31.286045 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063a490-2411-4b56-af6c-a1024ed8951f admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:31.289520 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063a490-2411-4b56-af6c-a1024ed8951f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:31.290069 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063a490-2411-4b56-af6c-a1024ed8951f admin admin] PATH_INFO: `/v3/projects/d281d93edb134e82a8a1e0d49e41a869/users/8f28ad640fe4498aafec7e8eff4c1798/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:31.302916 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8063a490-2411-4b56-af6c-a1024ed8951f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d281d93edb134e82a8a1e0d49e41a869, user_id=8f28ad640fe4498aafec7e8eff4c1798, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:31.313420 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8063a490-2411-4b56-af6c-a1024ed8951f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:31.371524 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 886/1761] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:31 2022] PUT /identity/v3/projects/d281d93edb134e82a8a1e0d49e41a869/users/8f28ad640fe4498aafec7e8eff4c1798/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:31.391476 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87230d-2fc5-4ce1-98b6-73a63faafb7e None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:31.391476 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87230d-2fc5-4ce1-98b6-73a63faafb7e None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:31.391476 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87230d-2fc5-4ce1-98b6-73a63faafb7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:31.507646 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-8e87230d-2fc5-4ce1-98b6-73a63faafb7e None None] MFA Rules not processed for user `8f28ad640fe4498aafec7e8eff4c1798`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:31.509070 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-8e87230d-2fc5-4ce1-98b6-73a63faafb7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:31.738062 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 876/1762] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:31 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:21:31.927724 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8063a490-2411-4b56-af6c-a1024ed8951f admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:31.929919 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8063a490-2411-4b56-af6c-a1024ed8951f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:32.090761 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8063a490-2411-4b56-af6c-a1024ed8951f admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:32.102939 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcbfdf9-64e9-497e-bb1f-bbb16c520491 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:32.104986 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcbfdf9-64e9-497e-bb1f-bbb16c520491 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:32.105350 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcbfdf9-64e9-497e-bb1f-bbb16c520491 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:32.121524 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcbfdf9-64e9-497e-bb1f-bbb16c520491 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:32.154580 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcbfdf9-64e9-497e-bb1f-bbb16c520491 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:32.156052 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcbfdf9-64e9-497e-bb1f-bbb16c520491 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:32.196518 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 887/1763] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:31 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:32.797176 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0528d9-319e-4cab-9a5a-c3c3bda59f9a None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:32.798743 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0528d9-319e-4cab-9a5a-c3c3bda59f9a None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:32.799476 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0528d9-319e-4cab-9a5a-c3c3bda59f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:32.892722 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-ba0528d9-319e-4cab-9a5a-c3c3bda59f9a None None] MFA Rules not processed for user `cad33601754a462c828566fb54c6e100`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:32.896732 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ba0528d9-319e-4cab-9a5a-c3c3bda59f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:32.929370 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:32.972784 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcbfdf9-64e9-497e-bb1f-bbb16c520491 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:33.010598 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcbfdf9-64e9-497e-bb1f-bbb16c520491 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:33.036829 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b4b59-b45a-459a-977f-2d97da695e88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:33.039413 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b4b59-b45a-459a-977f-2d97da695e88 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:33.040464 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b4b59-b45a-459a-977f-2d97da695e88 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:33.047870 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b4b59-b45a-459a-977f-2d97da695e88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:33.258108 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 877/1764] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Jun 29 12:21:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 463 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:21:33.428417 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0b4b59-b45a-459a-977f-2d97da695e88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:33.448521 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0b4b59-b45a-459a-977f-2d97da695e88 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:33.512368 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 888/1765] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:32 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:33.621061 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0528d9-319e-4cab-9a5a-c3c3bda59f9a None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:33.625919 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ba0528d9-319e-4cab-9a5a-c3c3bda59f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:33.984123 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0528d9-319e-4cab-9a5a-c3c3bda59f9a None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:34.000661 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22daf15f-ad77-4995-9899-8c46700f49bf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc92f8232bda407c84365eb10ede737f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:34.003162 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22daf15f-ad77-4995-9899-8c46700f49bf service swift] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:34.005815 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22daf15f-ad77-4995-9899-8c46700f49bf service swift] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:34.006109 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22daf15f-ad77-4995-9899-8c46700f49bf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:34.047652 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22daf15f-ad77-4995-9899-8c46700f49bf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:34.064707 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22daf15f-ad77-4995-9899-8c46700f49bf service swift] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:34.138298 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 878/1766] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Jun 29 12:21:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 12:21:35.832894 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b4b59-b45a-459a-977f-2d97da695e88 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:35.836201 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8e0b4b59-b45a-459a-977f-2d97da695e88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:35.873521 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:36.158501 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b4b59-b45a-459a-977f-2d97da695e88 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:36.192205 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745afd57-74e1-47ac-b213-7f676f784ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:36.206192 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745afd57-74e1-47ac-b213-7f676f784ad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:36.206743 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745afd57-74e1-47ac-b213-7f676f784ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:36.207212 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745afd57-74e1-47ac-b213-7f676f784ad7 admin admin] PATH_INFO: `/v3/users/78269dd46ceb4e529cad8da5c73f48d6` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:36.228359 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745afd57-74e1-47ac-b213-7f676f784ad7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78269dd46ceb4e529cad8da5c73f48d6)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:36.232262 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745afd57-74e1-47ac-b213-7f676f784ad7 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:36.305554 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02a965-2547-4206-b9e7-64a28da19618 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:36.307008 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02a965-2547-4206-b9e7-64a28da19618 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:36.307929 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02a965-2547-4206-b9e7-64a28da19618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:36.391319 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-3c02a965-2547-4206-b9e7-64a28da19618 None None] MFA Rules not processed for user `e94618bb382d46f7aaa2ef8f5d690bf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:36.397195 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-3c02a965-2547-4206-b9e7-64a28da19618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:36.672836 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-745afd57-74e1-47ac-b213-7f676f784ad7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78269dd46ceb4e529cad8da5c73f48d6'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:36.677034 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-745afd57-74e1-47ac-b213-7f676f784ad7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78269dd46ceb4e529cad8da5c73f48d6'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:36.678633 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-745afd57-74e1-47ac-b213-7f676f784ad7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78269dd46ceb4e529cad8da5c73f48d6'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:36.734282 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 879/1767] 10.222.0.58 () {58 vars in 1015 bytes} [Wed Jun 29 12:21:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 431 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:36.770636 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c02a965-2547-4206-b9e7-64a28da19618 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:36.772894 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-3c02a965-2547-4206-b9e7-64a28da19618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:36.796255 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-745afd57-74e1-47ac-b213-7f676f784ad7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78269dd46ceb4e529cad8da5c73f48d6'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:36.820996 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c02a965-2547-4206-b9e7-64a28da19618 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:36.823374 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-745afd57-74e1-47ac-b213-7f676f784ad7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78269dd46ceb4e529cad8da5c73f48d6'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:36.834895 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f6402f-7475-4c23-8d6b-89f5e80a5dda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:36.836894 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6402f-7475-4c23-8d6b-89f5e80a5dda service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:36.840519 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6402f-7475-4c23-8d6b-89f5e80a5dda service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:36.840889 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6402f-7475-4c23-8d6b-89f5e80a5dda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:36.850446 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-34f6402f-7475-4c23-8d6b-89f5e80a5dda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:36.873116 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 889/1768] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:21:35 2022] DELETE /identity/v3/users/78269dd46ceb4e529cad8da5c73f48d6 => generated 0 bytes in 1037 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:21:36.884021 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859ffbb-6422-4e93-b27c-23c57a2d44d7 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:36.887191 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859ffbb-6422-4e93-b27c-23c57a2d44d7 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:36.889604 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859ffbb-6422-4e93-b27c-23c57a2d44d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:36.903997 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f6402f-7475-4c23-8d6b-89f5e80a5dda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:36.905628 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f6402f-7475-4c23-8d6b-89f5e80a5dda service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:36.947696 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 880/1769] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:21:37.044422 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e859ffbb-6422-4e93-b27c-23c57a2d44d7 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:37.066501 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e859ffbb-6422-4e93-b27c-23c57a2d44d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:37.342985 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 890/1770] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 469 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:37.392664 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f6402f-7475-4c23-8d6b-89f5e80a5dda service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:37.395163 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-34f6402f-7475-4c23-8d6b-89f5e80a5dda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:37.421484 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f6402f-7475-4c23-8d6b-89f5e80a5dda service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:37.574258 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:37.595590 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fbc73c-5da3-482e-8c13-4aa44a3efe02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:37.597981 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbc73c-5da3-482e-8c13-4aa44a3efe02 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:37.598721 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbc73c-5da3-482e-8c13-4aa44a3efe02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:37.599283 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbc73c-5da3-482e-8c13-4aa44a3efe02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:37.633782 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fbc73c-5da3-482e-8c13-4aa44a3efe02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:37.645163 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fbc73c-5da3-482e-8c13-4aa44a3efe02 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:37.674751 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 881/1771] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:40.886669 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e859ffbb-6422-4e93-b27c-23c57a2d44d7 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:40.890144 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e859ffbb-6422-4e93-b27c-23c57a2d44d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:40.920467 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e859ffbb-6422-4e93-b27c-23c57a2d44d7 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:40.942474 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3d834e-499a-4f11-8edb-c7bb6db2d37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:40.958045 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d834e-499a-4f11-8edb-c7bb6db2d37f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:40.958483 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d834e-499a-4f11-8edb-c7bb6db2d37f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:40.958979 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d834e-499a-4f11-8edb-c7bb6db2d37f admin admin] PATH_INFO: `/v3/users/50848cd4adc646e1b12d6908570a597b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:40.963340 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00acaa-b8be-4302-af28-5882c4c59430 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:40.964270 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00acaa-b8be-4302-af28-5882c4c59430 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:40.964759 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00acaa-b8be-4302-af28-5882c4c59430 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:40.966448 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 882/1772] 10.222.0.27 () {54 vars in 921 bytes} [Wed Jun 29 12:21:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 12:21:40.967312 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3d834e-499a-4f11-8edb-c7bb6db2d37f admin admin] RBAC: Authorizing `identity:delete_user(user_id=50848cd4adc646e1b12d6908570a597b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:40.971241 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3d834e-499a-4f11-8edb-c7bb6db2d37f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:40.979437 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00acaa-b8be-4302-af28-5882c4c59430 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:40.981587 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-3e00acaa-b8be-4302-af28-5882c4c59430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:41.023935 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00acaa-b8be-4302-af28-5882c4c59430 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:41.040423 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b785aa45-cf6f-46fc-9ff9-ecff42aed0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:41.041430 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785aa45-cf6f-46fc-9ff9-ecff42aed0bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:41.041806 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785aa45-cf6f-46fc-9ff9-ecff42aed0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:41.042141 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785aa45-cf6f-46fc-9ff9-ecff42aed0bd admin admin] PATH_INFO: `/v3/users/14212ec6d4ce4c03ba5f2e3031158739` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:41.043542 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b785aa45-cf6f-46fc-9ff9-ecff42aed0bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=14212ec6d4ce4c03ba5f2e3031158739)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:41.045781 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b785aa45-cf6f-46fc-9ff9-ecff42aed0bd admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:41.107269 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:41.175047 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2c3d834e-499a-4f11-8edb-c7bb6db2d37f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50848cd4adc646e1b12d6908570a597b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:41.177165 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2c3d834e-499a-4f11-8edb-c7bb6db2d37f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50848cd4adc646e1b12d6908570a597b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:41.178066 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b785aa45-cf6f-46fc-9ff9-ecff42aed0bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14212ec6d4ce4c03ba5f2e3031158739'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:41.181673 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2c3d834e-499a-4f11-8edb-c7bb6db2d37f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50848cd4adc646e1b12d6908570a597b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:41.220426 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b785aa45-cf6f-46fc-9ff9-ecff42aed0bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14212ec6d4ce4c03ba5f2e3031158739'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:41.223198 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2c3d834e-499a-4f11-8edb-c7bb6db2d37f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50848cd4adc646e1b12d6908570a597b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:41.256023 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2c3d834e-499a-4f11-8edb-c7bb6db2d37f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50848cd4adc646e1b12d6908570a597b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:41.266387 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b785aa45-cf6f-46fc-9ff9-ecff42aed0bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14212ec6d4ce4c03ba5f2e3031158739'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:41.269478 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b785aa45-cf6f-46fc-9ff9-ecff42aed0bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14212ec6d4ce4c03ba5f2e3031158739'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:41.297494 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b785aa45-cf6f-46fc-9ff9-ecff42aed0bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14212ec6d4ce4c03ba5f2e3031158739'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:41.316627 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 891/1773] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:21:40 2022] DELETE /identity/v3/users/50848cd4adc646e1b12d6908570a597b => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:41.324038 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 883/1774] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:21:40 2022] DELETE /identity/v3/users/14212ec6d4ce4c03ba5f2e3031158739 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:41.326761 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2d9cc-a25b-4f24-9dda-8ec139e86c87 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:41.328554 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535193ad-da2c-448c-aca2-c4deb19d6c72 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:41.329233 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2d9cc-a25b-4f24-9dda-8ec139e86c87 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:41.329980 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2d9cc-a25b-4f24-9dda-8ec139e86c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:41.330888 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535193ad-da2c-448c-aca2-c4deb19d6c72 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:41.331003 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535193ad-da2c-448c-aca2-c4deb19d6c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:41.392866 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-535193ad-da2c-448c-aca2-c4deb19d6c72 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:41.395533 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-535193ad-da2c-448c-aca2-c4deb19d6c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:41.397350 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-4de2d9cc-a25b-4f24-9dda-8ec139e86c87 None None] MFA Rules not processed for user `7adaa2ef440941aa8214f2b2fd49b54e`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:41.403377 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4de2d9cc-a25b-4f24-9dda-8ec139e86c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:41.589957 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 884/1775] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:41.598574 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49745e9b-6822-4e98-80b1-bfb5ccc74d60 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:41.600164 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49745e9b-6822-4e98-80b1-bfb5ccc74d60 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:41.605002 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49745e9b-6822-4e98-80b1-bfb5ccc74d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:41.606743 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 892/1776] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Jun 29 12:21:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:41.711389 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-49745e9b-6822-4e98-80b1-bfb5ccc74d60 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:41.716540 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-49745e9b-6822-4e98-80b1-bfb5ccc74d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:41.781194 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 885/1777] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:41.796634 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2d9cc-a25b-4f24-9dda-8ec139e86c87 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:41.800864 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4de2d9cc-a25b-4f24-9dda-8ec139e86c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:41.824285 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49745e9b-6822-4e98-80b1-bfb5ccc74d60 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:41.827416 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-49745e9b-6822-4e98-80b1-bfb5ccc74d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:41.852679 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49745e9b-6822-4e98-80b1-bfb5ccc74d60 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:41.906935 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa52b7a4-aa39-4781-98bd-9c0a65b5f2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:41.912058 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52b7a4-aa39-4781-98bd-9c0a65b5f2cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:41.913011 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52b7a4-aa39-4781-98bd-9c0a65b5f2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:41.921081 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52b7a4-aa39-4781-98bd-9c0a65b5f2cc admin admin] PATH_INFO: `/v3/users/cd519db85ed2457eba042cf2357d18d1` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:41.943635 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa52b7a4-aa39-4781-98bd-9c0a65b5f2cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd519db85ed2457eba042cf2357d18d1)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:41.947708 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa52b7a4-aa39-4781-98bd-9c0a65b5f2cc admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:42.085093 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:42.093630 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-fa52b7a4-aa39-4781-98bd-9c0a65b5f2cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd519db85ed2457eba042cf2357d18d1'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:42.145369 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-fa52b7a4-aa39-4781-98bd-9c0a65b5f2cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd519db85ed2457eba042cf2357d18d1'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:42.176287 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-fa52b7a4-aa39-4781-98bd-9c0a65b5f2cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd519db85ed2457eba042cf2357d18d1'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:42.178549 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-fa52b7a4-aa39-4781-98bd-9c0a65b5f2cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd519db85ed2457eba042cf2357d18d1'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:42.183901 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2d9cc-a25b-4f24-9dda-8ec139e86c87 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:42.206558 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9364cd-fe10-4704-89db-3ba9a2001cf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:42.207251 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9364cd-fe10-4704-89db-3ba9a2001cf0 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:42.207526 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9364cd-fe10-4704-89db-3ba9a2001cf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:42.207806 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9364cd-fe10-4704-89db-3ba9a2001cf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:42.209000 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-fa52b7a4-aa39-4781-98bd-9c0a65b5f2cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd519db85ed2457eba042cf2357d18d1'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:42.231127 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 886/1778] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:21:41 2022] DELETE /identity/v3/users/cd519db85ed2457eba042cf2357d18d1 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:42.232948 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa52b7a4-aa39-4781-98bd-9c0a65b5f2cc admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:42.234988 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-fa52b7a4-aa39-4781-98bd-9c0a65b5f2cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:42.249562 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9364cd-fe10-4704-89db-3ba9a2001cf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:42.263004 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9364cd-fe10-4704-89db-3ba9a2001cf0 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:42.294734 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 893/1779] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:42.297894 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3cfda-317c-47a3-be7a-c6ae32e403f1 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:42.298236 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3cfda-317c-47a3-be7a-c6ae32e403f1 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:42.298498 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3cfda-317c-47a3-be7a-c6ae32e403f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:42.353830 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-adc3cfda-317c-47a3-be7a-c6ae32e403f1 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:42.358262 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-adc3cfda-317c-47a3-be7a-c6ae32e403f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:42.451617 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:42.597383 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 894/1780] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:42.599367 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc3cfda-317c-47a3-be7a-c6ae32e403f1 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:42.601191 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-adc3cfda-317c-47a3-be7a-c6ae32e403f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:42.657534 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa52b7a4-aa39-4781-98bd-9c0a65b5f2cc admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:42.698248 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130de562-e149-4a17-91ea-440846cf1768 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7adaa2ef440941aa8214f2b2fd49b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:42.699839 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130de562-e149-4a17-91ea-440846cf1768 service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:42.700554 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130de562-e149-4a17-91ea-440846cf1768 service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:42.701682 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130de562-e149-4a17-91ea-440846cf1768 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:42.723067 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-130de562-e149-4a17-91ea-440846cf1768 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:42.786051 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc3cfda-317c-47a3-be7a-c6ae32e403f1 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:42.790991 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130de562-e149-4a17-91ea-440846cf1768 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:42.793115 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc3d0a9-b2fb-45be-975f-5e84cd5fb456 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:42.793866 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3d0a9-b2fb-45be-975f-5e84cd5fb456 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:42.794138 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3d0a9-b2fb-45be-975f-5e84cd5fb456 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:42.794564 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3d0a9-b2fb-45be-975f-5e84cd5fb456 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:42.798648 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3fc3d0a9-b2fb-45be-975f-5e84cd5fb456 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:42.802935 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130de562-e149-4a17-91ea-440846cf1768 service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:42.833687 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc3d0a9-b2fb-45be-975f-5e84cd5fb456 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:42.836724 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc3d0a9-b2fb-45be-975f-5e84cd5fb456 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:42.874827 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 887/1781] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 643 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:42.882141 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130de562-e149-4a17-91ea-440846cf1768 service nova] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:42.890704 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 895/1782] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:42.892095 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-130de562-e149-4a17-91ea-440846cf1768 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:42.915086 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc3d0a9-b2fb-45be-975f-5e84cd5fb456 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:42.981794 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc3d0a9-b2fb-45be-975f-5e84cd5fb456 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:42.992445 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130de562-e149-4a17-91ea-440846cf1768 service nova] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:43.009852 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d08de7-b44f-410c-8fb5-4a35ad349390 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:43.013175 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d08de7-b44f-410c-8fb5-4a35ad349390 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:43.013765 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d08de7-b44f-410c-8fb5-4a35ad349390 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:43.014235 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d08de7-b44f-410c-8fb5-4a35ad349390 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:43.038621 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e2247-3f4b-490f-9dbe-fe5fcf3b0dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:43.046394 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e2247-3f4b-490f-9dbe-fe5fcf3b0dba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:43.046691 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e2247-3f4b-490f-9dbe-fe5fcf3b0dba admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:43.047083 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e2247-3f4b-490f-9dbe-fe5fcf3b0dba admin admin] PATH_INFO: `/v3/projects/4656d9fa52bb49088601f6b899856382` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:43.049955 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e2247-3f4b-490f-9dbe-fe5fcf3b0dba admin admin] RBAC: Authorizing `identity:delete_project(project_id=4656d9fa52bb49088601f6b899856382)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:43.060426 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e2247-3f4b-490f-9dbe-fe5fcf3b0dba admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:43.066101 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d08de7-b44f-410c-8fb5-4a35ad349390 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:43.067782 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d08de7-b44f-410c-8fb5-4a35ad349390 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:43.121103 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 896/1783] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:43.194803 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-039e2247-3f4b-490f-9dbe-fe5fcf3b0dba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4656d9fa52bb49088601f6b899856382', 'request_id': 'req-039e2247-3f4b-490f-9dbe-fe5fcf3b0dba'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:43.219379 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-039e2247-3f4b-490f-9dbe-fe5fcf3b0dba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4656d9fa52bb49088601f6b899856382', 'request_id': 'req-039e2247-3f4b-490f-9dbe-fe5fcf3b0dba'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:43.235148 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-039e2247-3f4b-490f-9dbe-fe5fcf3b0dba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4656d9fa52bb49088601f6b899856382', 'request_id': 'req-039e2247-3f4b-490f-9dbe-fe5fcf3b0dba'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:43.258887 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-039e2247-3f4b-490f-9dbe-fe5fcf3b0dba admin admin] The token cache is being invalidate because project 4656d9fa52bb49088601f6b899856382 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:21:43.259226 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-039e2247-3f4b-490f-9dbe-fe5fcf3b0dba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:43.259960 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-039e2247-3f4b-490f-9dbe-fe5fcf3b0dba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:43.291357 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 888/1784] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:21:42 2022] DELETE /identity/v3/projects/4656d9fa52bb49088601f6b899856382 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:43.298063 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d08de7-b44f-410c-8fb5-4a35ad349390 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:43.322661 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d08de7-b44f-410c-8fb5-4a35ad349390 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:43.528833 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d61954d-47e5-4932-b40d-3cefd1dba39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:43.530570 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61954d-47e5-4932-b40d-3cefd1dba39b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:43.531142 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61954d-47e5-4932-b40d-3cefd1dba39b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:43.533242 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61954d-47e5-4932-b40d-3cefd1dba39b admin admin] PATH_INFO: `/v3/users/593ea59a03f24d91a881a28ac071d6d1` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:43.536511 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d61954d-47e5-4932-b40d-3cefd1dba39b admin admin] RBAC: Authorizing `identity:delete_user(user_id=593ea59a03f24d91a881a28ac071d6d1)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:43.543661 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d61954d-47e5-4932-b40d-3cefd1dba39b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:43.682120 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3427f3-6058-4f84-b894-4fbf8dcea0a9 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:43.683626 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3427f3-6058-4f84-b894-4fbf8dcea0a9 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:43.684584 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3427f3-6058-4f84-b894-4fbf8dcea0a9 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:43.696002 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 889/1785] 10.222.0.27 () {54 vars in 921 bytes} [Wed Jun 29 12:21:43 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:21:43.792121 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1d61954d-47e5-4932-b40d-3cefd1dba39b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '593ea59a03f24d91a881a28ac071d6d1'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:43.798907 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1d61954d-47e5-4932-b40d-3cefd1dba39b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '593ea59a03f24d91a881a28ac071d6d1'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:43.800354 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1d61954d-47e5-4932-b40d-3cefd1dba39b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '593ea59a03f24d91a881a28ac071d6d1'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:43.875864 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1d61954d-47e5-4932-b40d-3cefd1dba39b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '593ea59a03f24d91a881a28ac071d6d1'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:43.887493 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:43.904395 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1d61954d-47e5-4932-b40d-3cefd1dba39b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '593ea59a03f24d91a881a28ac071d6d1'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:43.931274 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced6851-b70b-429e-b54d-8faaeeeab3ce None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:43.932749 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced6851-b70b-429e-b54d-8faaeeeab3ce None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:43.933548 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced6851-b70b-429e-b54d-8faaeeeab3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:43.968747 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 897/1786] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:21:43 2022] DELETE /identity/v3/users/593ea59a03f24d91a881a28ac071d6d1 => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:44.032607 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-6ced6851-b70b-429e-b54d-8faaeeeab3ce None None] MFA Rules not processed for user `7adaa2ef440941aa8214f2b2fd49b54e`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:44.049331 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-6ced6851-b70b-429e-b54d-8faaeeeab3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:44.192443 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:44.345682 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 890/1787] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Jun 29 12:21:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:44.911761 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d61954d-47e5-4932-b40d-3cefd1dba39b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:44.918336 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1d61954d-47e5-4932-b40d-3cefd1dba39b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:45.055866 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d61954d-47e5-4932-b40d-3cefd1dba39b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:45.073174 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df75c1ec-3457-4fa1-bef8-fee36df68691 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7adaa2ef440941aa8214f2b2fd49b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:45.074317 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df75c1ec-3457-4fa1-bef8-fee36df68691 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:45.074769 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df75c1ec-3457-4fa1-bef8-fee36df68691 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:45.075210 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df75c1ec-3457-4fa1-bef8-fee36df68691 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:45.113503 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df75c1ec-3457-4fa1-bef8-fee36df68691 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:45.115380 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df75c1ec-3457-4fa1-bef8-fee36df68691 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:45.152637 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 898/1788] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:21:45.715923 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced6851-b70b-429e-b54d-8faaeeeab3ce None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:45.728697 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-6ced6851-b70b-429e-b54d-8faaeeeab3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:46.122139 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced6851-b70b-429e-b54d-8faaeeeab3ce None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:46.132976 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0bb25-74bc-4b1b-8373-131cf36bd40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:46.134343 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0bb25-74bc-4b1b-8373-131cf36bd40f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:46.134751 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0bb25-74bc-4b1b-8373-131cf36bd40f admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:46.135169 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0bb25-74bc-4b1b-8373-131cf36bd40f admin admin] PATH_INFO: `/v3/projects/6281a7d46c924062a31824e08c04489b` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:46.143207 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf0bb25-74bc-4b1b-8373-131cf36bd40f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6281a7d46c924062a31824e08c04489b)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:46.146645 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf0bb25-74bc-4b1b-8373-131cf36bd40f admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:46.304177 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-adf0bb25-74bc-4b1b-8373-131cf36bd40f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6281a7d46c924062a31824e08c04489b', 'request_id': 'req-adf0bb25-74bc-4b1b-8373-131cf36bd40f'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:46.320014 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-adf0bb25-74bc-4b1b-8373-131cf36bd40f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6281a7d46c924062a31824e08c04489b', 'request_id': 'req-adf0bb25-74bc-4b1b-8373-131cf36bd40f'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:46.336758 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-adf0bb25-74bc-4b1b-8373-131cf36bd40f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6281a7d46c924062a31824e08c04489b', 'request_id': 'req-adf0bb25-74bc-4b1b-8373-131cf36bd40f'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:46.372164 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-adf0bb25-74bc-4b1b-8373-131cf36bd40f admin admin] The token cache is being invalidate because project 6281a7d46c924062a31824e08c04489b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:21:46.373193 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-adf0bb25-74bc-4b1b-8373-131cf36bd40f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:46.374929 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-adf0bb25-74bc-4b1b-8373-131cf36bd40f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:46.379101 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 891/1789] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:21:45 2022] DELETE /identity/v3/projects/6281a7d46c924062a31824e08c04489b => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:46.385095 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df75c1ec-3457-4fa1-bef8-fee36df68691 service nova] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:46.413080 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df75c1ec-3457-4fa1-bef8-fee36df68691 service nova] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:46.563350 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90598b2a-bb6f-4ca4-a512-f1392fc1dc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:46.565370 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90598b2a-bb6f-4ca4-a512-f1392fc1dc27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:46.565902 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90598b2a-bb6f-4ca4-a512-f1392fc1dc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:46.566335 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90598b2a-bb6f-4ca4-a512-f1392fc1dc27 admin admin] PATH_INFO: `/v3/users/8f28ad640fe4498aafec7e8eff4c1798` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:46.567979 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90598b2a-bb6f-4ca4-a512-f1392fc1dc27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f28ad640fe4498aafec7e8eff4c1798)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:46.572306 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90598b2a-bb6f-4ca4-a512-f1392fc1dc27 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:46.593582 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0bb25-74bc-4b1b-8373-131cf36bd40f admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:46.595205 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-adf0bb25-74bc-4b1b-8373-131cf36bd40f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:46.620171 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0bb25-74bc-4b1b-8373-131cf36bd40f admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:46.633607 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c17835-2466-409a-b052-da2993348945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:46.634556 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c17835-2466-409a-b052-da2993348945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:46.634851 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c17835-2466-409a-b052-da2993348945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:46.635125 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c17835-2466-409a-b052-da2993348945 admin admin] PATH_INFO: `/v3/projects/f63533ffac1948af9cb32c7c4d78247a` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:46.639819 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c17835-2466-409a-b052-da2993348945 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f63533ffac1948af9cb32c7c4d78247a)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:46.644875 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c17835-2466-409a-b052-da2993348945 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:46.672136 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-90598b2a-bb6f-4ca4-a512-f1392fc1dc27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f28ad640fe4498aafec7e8eff4c1798'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:46.673870 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-90598b2a-bb6f-4ca4-a512-f1392fc1dc27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f28ad640fe4498aafec7e8eff4c1798'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:46.676218 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-90598b2a-bb6f-4ca4-a512-f1392fc1dc27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f28ad640fe4498aafec7e8eff4c1798'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:46.712030 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-90598b2a-bb6f-4ca4-a512-f1392fc1dc27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f28ad640fe4498aafec7e8eff4c1798'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:46.729105 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-90598b2a-bb6f-4ca4-a512-f1392fc1dc27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f28ad640fe4498aafec7e8eff4c1798'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:46.751587 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:46.754008 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-12c17835-2466-409a-b052-da2993348945 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f63533ffac1948af9cb32c7c4d78247a', 'request_id': 'req-12c17835-2466-409a-b052-da2993348945'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:46.773060 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-12c17835-2466-409a-b052-da2993348945 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f63533ffac1948af9cb32c7c4d78247a', 'request_id': 'req-12c17835-2466-409a-b052-da2993348945'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:46.774726 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 899/1790] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:21:46 2022] DELETE /identity/v3/users/8f28ad640fe4498aafec7e8eff4c1798 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:46.783654 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-12c17835-2466-409a-b052-da2993348945 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f63533ffac1948af9cb32c7c4d78247a', 'request_id': 'req-12c17835-2466-409a-b052-da2993348945'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:46.879783 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-12c17835-2466-409a-b052-da2993348945 admin admin] The token cache is being invalidate because project f63533ffac1948af9cb32c7c4d78247a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:21:46.880411 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-12c17835-2466-409a-b052-da2993348945 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:46.881407 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-12c17835-2466-409a-b052-da2993348945 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:46.895174 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90598b2a-bb6f-4ca4-a512-f1392fc1dc27 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:46.900062 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-90598b2a-bb6f-4ca4-a512-f1392fc1dc27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:46.905366 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 892/1791] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:21:46 2022] DELETE /identity/v3/projects/f63533ffac1948af9cb32c7c4d78247a => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:21:47.201390 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:47.266269 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c17835-2466-409a-b052-da2993348945 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:47.282017 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-12c17835-2466-409a-b052-da2993348945 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:47.302794 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90598b2a-bb6f-4ca4-a512-f1392fc1dc27 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:47.320487 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec3b8b3-f217-4c86-bc50-c4949f678cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:47.329091 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3b8b3-f217-4c86-bc50-c4949f678cf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:47.329757 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3b8b3-f217-4c86-bc50-c4949f678cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:47.330376 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3b8b3-f217-4c86-bc50-c4949f678cf3 admin admin] PATH_INFO: `/v3/users/d43ebc3bc407455080a7cc80d3cd1dcb` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:47.335370 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec3b8b3-f217-4c86-bc50-c4949f678cf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d43ebc3bc407455080a7cc80d3cd1dcb)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:47.349485 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec3b8b3-f217-4c86-bc50-c4949f678cf3 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:47.544028 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1ec3b8b3-f217-4c86-bc50-c4949f678cf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd43ebc3bc407455080a7cc80d3cd1dcb'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:47.546554 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1ec3b8b3-f217-4c86-bc50-c4949f678cf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd43ebc3bc407455080a7cc80d3cd1dcb'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:47.548230 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1ec3b8b3-f217-4c86-bc50-c4949f678cf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd43ebc3bc407455080a7cc80d3cd1dcb'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:47.580073 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c17835-2466-409a-b052-da2993348945 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:47.593457 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1ec3b8b3-f217-4c86-bc50-c4949f678cf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd43ebc3bc407455080a7cc80d3cd1dcb'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:47.602827 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb35e7ee-adcd-4d0f-a1c3-e2d912328eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:47.604682 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35e7ee-adcd-4d0f-a1c3-e2d912328eb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:47.605899 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35e7ee-adcd-4d0f-a1c3-e2d912328eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:47.606850 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35e7ee-adcd-4d0f-a1c3-e2d912328eb9 admin admin] PATH_INFO: `/v3/projects/4369fdbb397a423ab65ddeb0fbc1322a` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:47.610938 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1ec3b8b3-f217-4c86-bc50-c4949f678cf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd43ebc3bc407455080a7cc80d3cd1dcb'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:47.612915 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb35e7ee-adcd-4d0f-a1c3-e2d912328eb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4369fdbb397a423ab65ddeb0fbc1322a)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:47.628757 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb35e7ee-adcd-4d0f-a1c3-e2d912328eb9 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:47.640045 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 900/1792] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:21:46 2022] DELETE /identity/v3/users/d43ebc3bc407455080a7cc80d3cd1dcb => generated 0 bytes in 747 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:47.863725 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-cb35e7ee-adcd-4d0f-a1c3-e2d912328eb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4369fdbb397a423ab65ddeb0fbc1322a', 'request_id': 'req-cb35e7ee-adcd-4d0f-a1c3-e2d912328eb9'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:47.923486 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-cb35e7ee-adcd-4d0f-a1c3-e2d912328eb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4369fdbb397a423ab65ddeb0fbc1322a', 'request_id': 'req-cb35e7ee-adcd-4d0f-a1c3-e2d912328eb9'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:47.962022 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-cb35e7ee-adcd-4d0f-a1c3-e2d912328eb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4369fdbb397a423ab65ddeb0fbc1322a', 'request_id': 'req-cb35e7ee-adcd-4d0f-a1c3-e2d912328eb9'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:48.020342 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-cb35e7ee-adcd-4d0f-a1c3-e2d912328eb9 admin admin] The token cache is being invalidate because project 4369fdbb397a423ab65ddeb0fbc1322a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:21:48.023997 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-cb35e7ee-adcd-4d0f-a1c3-e2d912328eb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:48.030314 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-cb35e7ee-adcd-4d0f-a1c3-e2d912328eb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:48.034101 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 893/1793] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:21:47 2022] DELETE /identity/v3/projects/4369fdbb397a423ab65ddeb0fbc1322a => generated 0 bytes in 769 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:48.040758 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec3b8b3-f217-4c86-bc50-c4949f678cf3 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:48.043657 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1ec3b8b3-f217-4c86-bc50-c4949f678cf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:48.232148 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec3b8b3-f217-4c86-bc50-c4949f678cf3 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:48.447253 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aac581-867f-425f-afad-54a271ebb46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:48.458216 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aac581-867f-425f-afad-54a271ebb46f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:48.458216 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aac581-867f-425f-afad-54a271ebb46f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:48.458216 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aac581-867f-425f-afad-54a271ebb46f admin admin] PATH_INFO: `/v3/users/6045a607f36a42d382e8451ec2dcb610` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:48.465506 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aac581-867f-425f-afad-54a271ebb46f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6045a607f36a42d382e8451ec2dcb610)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:48.481088 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb35e7ee-adcd-4d0f-a1c3-e2d912328eb9 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:48.485347 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-cb35e7ee-adcd-4d0f-a1c3-e2d912328eb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:48.492887 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aac581-867f-425f-afad-54a271ebb46f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:48.533027 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb35e7ee-adcd-4d0f-a1c3-e2d912328eb9 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:48.556361 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569586b-8326-4d54-9d30-999aca7f1cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:48.560175 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569586b-8326-4d54-9d30-999aca7f1cc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:48.560429 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569586b-8326-4d54-9d30-999aca7f1cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:48.560809 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569586b-8326-4d54-9d30-999aca7f1cc4 admin admin] PATH_INFO: `/v3/projects/6647eb58e76649e1a1eec717f182bb3f` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:48.566862 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3569586b-8326-4d54-9d30-999aca7f1cc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6647eb58e76649e1a1eec717f182bb3f)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:48.572144 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3569586b-8326-4d54-9d30-999aca7f1cc4 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:48.623874 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:48.763269 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-31aac581-867f-425f-afad-54a271ebb46f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6045a607f36a42d382e8451ec2dcb610'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:48.766383 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-31aac581-867f-425f-afad-54a271ebb46f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6045a607f36a42d382e8451ec2dcb610'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:48.769167 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-31aac581-867f-425f-afad-54a271ebb46f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6045a607f36a42d382e8451ec2dcb610'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:48.796262 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3569586b-8326-4d54-9d30-999aca7f1cc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6647eb58e76649e1a1eec717f182bb3f', 'request_id': 'req-3569586b-8326-4d54-9d30-999aca7f1cc4'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:48.831871 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3569586b-8326-4d54-9d30-999aca7f1cc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6647eb58e76649e1a1eec717f182bb3f', 'request_id': 'req-3569586b-8326-4d54-9d30-999aca7f1cc4'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:48.839340 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=81,keystone:DELETE=16,keystone:INSERT=3 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:48.843885 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-31aac581-867f-425f-afad-54a271ebb46f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6045a607f36a42d382e8451ec2dcb610'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:48.860430 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3569586b-8326-4d54-9d30-999aca7f1cc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6647eb58e76649e1a1eec717f182bb3f', 'request_id': 'req-3569586b-8326-4d54-9d30-999aca7f1cc4'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:48.875848 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-31aac581-867f-425f-afad-54a271ebb46f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6045a607f36a42d382e8451ec2dcb610'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:48.910153 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3569586b-8326-4d54-9d30-999aca7f1cc4 admin admin] The token cache is being invalidate because project 6647eb58e76649e1a1eec717f182bb3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:21:48.911060 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3569586b-8326-4d54-9d30-999aca7f1cc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:48.913517 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3569586b-8326-4d54-9d30-999aca7f1cc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:48.933557 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 901/1794] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:21:48 2022] DELETE /identity/v3/users/6045a607f36a42d382e8451ec2dcb610 => generated 0 bytes in 882 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:48.933557 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aac581-867f-425f-afad-54a271ebb46f admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:48.933557 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-31aac581-867f-425f-afad-54a271ebb46f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:48.937184 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 894/1795] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:21:48 2022] DELETE /identity/v3/projects/6647eb58e76649e1a1eec717f182bb3f => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:21:48.943100 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24641b20-17de-49b0-ac50-e4956017ef9d None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:48.944599 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24641b20-17de-49b0-ac50-e4956017ef9d None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:48.944954 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24641b20-17de-49b0-ac50-e4956017ef9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:49.079233 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-24641b20-17de-49b0-ac50-e4956017ef9d None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:49.080550 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-24641b20-17de-49b0-ac50-e4956017ef9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:49.204609 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aac581-867f-425f-afad-54a271ebb46f admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:49.221943 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7210bf96-ccad-4031-aa85-5be006db302b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:49.224669 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7210bf96-ccad-4031-aa85-5be006db302b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:49.225655 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7210bf96-ccad-4031-aa85-5be006db302b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:49.227108 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7210bf96-ccad-4031-aa85-5be006db302b admin admin] PATH_INFO: `/v3/projects/d281d93edb134e82a8a1e0d49e41a869` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:49.229684 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7210bf96-ccad-4031-aa85-5be006db302b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d281d93edb134e82a8a1e0d49e41a869)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:49.236875 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7210bf96-ccad-4031-aa85-5be006db302b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:49.371076 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 895/1796] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 429 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:49.381711 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a104cb2-ce1f-4511-b653-6c51e190b489 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:49.382002 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a104cb2-ce1f-4511-b653-6c51e190b489 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:49.382403 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a104cb2-ce1f-4511-b653-6c51e190b489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:49.407109 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7210bf96-ccad-4031-aa85-5be006db302b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd281d93edb134e82a8a1e0d49e41a869', 'request_id': 'req-7210bf96-ccad-4031-aa85-5be006db302b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:49.421951 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7210bf96-ccad-4031-aa85-5be006db302b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd281d93edb134e82a8a1e0d49e41a869', 'request_id': 'req-7210bf96-ccad-4031-aa85-5be006db302b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:49.425452 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-8a104cb2-ce1f-4511-b653-6c51e190b489 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:49.427661 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-8a104cb2-ce1f-4511-b653-6c51e190b489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:49.445272 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7210bf96-ccad-4031-aa85-5be006db302b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd281d93edb134e82a8a1e0d49e41a869', 'request_id': 'req-7210bf96-ccad-4031-aa85-5be006db302b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:49.489595 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7210bf96-ccad-4031-aa85-5be006db302b admin admin] The token cache is being invalidate because project d281d93edb134e82a8a1e0d49e41a869 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:21:49.490412 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7210bf96-ccad-4031-aa85-5be006db302b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:49.492461 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7210bf96-ccad-4031-aa85-5be006db302b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:49.495646 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 902/1797] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:21:48 2022] DELETE /identity/v3/projects/d281d93edb134e82a8a1e0d49e41a869 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:49.496577 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7210bf96-ccad-4031-aa85-5be006db302b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:49.507378 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7210bf96-ccad-4031-aa85-5be006db302b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:49.543894 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 896/1798] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:49.545054 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239ad6e-383a-43bb-8296-2861861f63fe None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:49.545352 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239ad6e-383a-43bb-8296-2861861f63fe None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:49.545637 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239ad6e-383a-43bb-8296-2861861f63fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:49.551203 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7210bf96-ccad-4031-aa85-5be006db302b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:49.572474 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8fe29e-9698-4b9e-9e4d-c3029dc361d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:49.573587 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8fe29e-9698-4b9e-9e4d-c3029dc361d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:49.574010 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8fe29e-9698-4b9e-9e4d-c3029dc361d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:49.574392 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8fe29e-9698-4b9e-9e4d-c3029dc361d5 admin admin] PATH_INFO: `/v3/projects/d1e3a0d12f8b4db98ff20ac28fb99b9f` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:49.579759 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8fe29e-9698-4b9e-9e4d-c3029dc361d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1e3a0d12f8b4db98ff20ac28fb99b9f)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:49.581904 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8fe29e-9698-4b9e-9e4d-c3029dc361d5 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:49.613923 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-b239ad6e-383a-43bb-8296-2861861f63fe None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:49.615229 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-b239ad6e-383a-43bb-8296-2861861f63fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:49.624512 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 897/1799] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:49.625486 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239ad6e-383a-43bb-8296-2861861f63fe None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:49.638547 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239ad6e-383a-43bb-8296-2861861f63fe None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:49.643897 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef6a3eb-555f-4a15-b46d-6bc620491542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:49.644585 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6a3eb-555f-4a15-b46d-6bc620491542 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:49.644879 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6a3eb-555f-4a15-b46d-6bc620491542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:49.645155 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6a3eb-555f-4a15-b46d-6bc620491542 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:49.645943 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef6a3eb-555f-4a15-b46d-6bc620491542 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:21:49.646255 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef6a3eb-555f-4a15-b46d-6bc620491542 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:49.647653 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:49.649821 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef6a3eb-555f-4a15-b46d-6bc620491542 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:49.674478 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 898/1800] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:21:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:21:49.674478 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc112f-bf79-40a8-84bb-4a5fbeb9b126 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:49.674478 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc112f-bf79-40a8-84bb-4a5fbeb9b126 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:49.674478 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc112f-bf79-40a8-84bb-4a5fbeb9b126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:49.704480 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-7fbc112f-bf79-40a8-84bb-4a5fbeb9b126 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:49.706585 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-7fbc112f-bf79-40a8-84bb-4a5fbeb9b126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:49.712032 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2f8fe29e-9698-4b9e-9e4d-c3029dc361d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1e3a0d12f8b4db98ff20ac28fb99b9f', 'request_id': 'req-2f8fe29e-9698-4b9e-9e4d-c3029dc361d5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:49.719375 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2f8fe29e-9698-4b9e-9e4d-c3029dc361d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1e3a0d12f8b4db98ff20ac28fb99b9f', 'request_id': 'req-2f8fe29e-9698-4b9e-9e4d-c3029dc361d5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:49.730447 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2f8fe29e-9698-4b9e-9e4d-c3029dc361d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1e3a0d12f8b4db98ff20ac28fb99b9f', 'request_id': 'req-2f8fe29e-9698-4b9e-9e4d-c3029dc361d5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:49.770563 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2f8fe29e-9698-4b9e-9e4d-c3029dc361d5 admin admin] The token cache is being invalidate because project d1e3a0d12f8b4db98ff20ac28fb99b9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:21:49.774146 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2f8fe29e-9698-4b9e-9e4d-c3029dc361d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:49.775993 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2f8fe29e-9698-4b9e-9e4d-c3029dc361d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:49.781820 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 903/1801] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:21:49 2022] DELETE /identity/v3/projects/d1e3a0d12f8b4db98ff20ac28fb99b9f => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:49.783519 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8fe29e-9698-4b9e-9e4d-c3029dc361d5 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:49.786731 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2f8fe29e-9698-4b9e-9e4d-c3029dc361d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:49.855180 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 899/1802] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:49.856889 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ab8e3-49b3-4a5a-915f-ff35a113e2d1 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:49.857371 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ab8e3-49b3-4a5a-915f-ff35a113e2d1 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:49.857858 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ab8e3-49b3-4a5a-915f-ff35a113e2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:49.883294 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-b93ab8e3-49b3-4a5a-915f-ff35a113e2d1 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:49.885526 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-b93ab8e3-49b3-4a5a-915f-ff35a113e2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:49.908287 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 900/1803] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:49.908287 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ab8e3-49b3-4a5a-915f-ff35a113e2d1 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:49.908698 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8fe29e-9698-4b9e-9e4d-c3029dc361d5 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:49.918414 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f1240-2955-4fe7-86ac-6edd36f409d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:49.919378 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f1240-2955-4fe7-86ac-6edd36f409d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:49.919872 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f1240-2955-4fe7-86ac-6edd36f409d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:49.920291 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f1240-2955-4fe7-86ac-6edd36f409d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:49.921813 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132f1240-2955-4fe7-86ac-6edd36f409d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:49.922477 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:49.926556 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132f1240-2955-4fe7-86ac-6edd36f409d5 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:49.929606 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ab8e3-49b3-4a5a-915f-ff35a113e2d1 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:49.945909 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eef895-1c70-46da-8e97-876205fc1b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:49.947417 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eef895-1c70-46da-8e97-876205fc1b0b admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:49.948641 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eef895-1c70-46da-8e97-876205fc1b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:49.949302 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eef895-1c70-46da-8e97-876205fc1b0b admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:49.951492 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eef895-1c70-46da-8e97-876205fc1b0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:21:49.951921 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eef895-1c70-46da-8e97-876205fc1b0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:49.954936 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eef895-1c70-46da-8e97-876205fc1b0b admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:49.979973 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 901/1804] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:21:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:21:49.981187 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 904/1805] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:21:49 2022] POST /identity/v3/projects => generated 365 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:49.984008 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dcc8df-bd45-4f3f-84d4-cc088d383fa2 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:49.985192 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dcc8df-bd45-4f3f-84d4-cc088d383fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:49.985652 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f1240-2955-4fe7-86ac-6edd36f409d5 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:49.986437 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dcc8df-bd45-4f3f-84d4-cc088d383fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:50.022965 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-29dcc8df-bd45-4f3f-84d4-cc088d383fa2 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:50.030487 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-29dcc8df-bd45-4f3f-84d4-cc088d383fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:50.149539 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 902/1806] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:50.150829 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dcc8df-bd45-4f3f-84d4-cc088d383fa2 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:50.164374 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f1240-2955-4fe7-86ac-6edd36f409d5 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:50.169491 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dcc8df-bd45-4f3f-84d4-cc088d383fa2 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:50.175614 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a5e14-ebc6-4514-ab18-fb9e2fa9d6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:50.177899 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a5e14-ebc6-4514-ab18-fb9e2fa9d6f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:50.178383 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a5e14-ebc6-4514-ab18-fb9e2fa9d6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:50.179018 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a5e14-ebc6-4514-ab18-fb9e2fa9d6f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:50.180753 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89a5e14-ebc6-4514-ab18-fb9e2fa9d6f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:50.185532 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9242e7-5695-4e3e-9221-cba8d877391a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:50.186830 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9242e7-5695-4e3e-9221-cba8d877391a admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:50.187301 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9242e7-5695-4e3e-9221-cba8d877391a admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:50.187754 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9242e7-5695-4e3e-9221-cba8d877391a admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:50.189312 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9242e7-5695-4e3e-9221-cba8d877391a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:50.191241 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89a5e14-ebc6-4514-ab18-fb9e2fa9d6f5 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:50.197144 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9242e7-5695-4e3e-9221-cba8d877391a admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:50.232303 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 905/1807] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:21:49 2022] POST /identity/v3/users => generated 283 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:50.239695 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a5e14-ebc6-4514-ab18-fb9e2fa9d6f5 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:50.258932 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a5e14-ebc6-4514-ab18-fb9e2fa9d6f5 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:50.267309 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b535875-7c0a-4ffa-a1a2-c3baef5129e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:50.271259 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 903/1808] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:21:50 2022] POST /identity/v3/projects => generated 367 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:50.271444 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b535875-7c0a-4ffa-a1a2-c3baef5129e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:50.271444 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b535875-7c0a-4ffa-a1a2-c3baef5129e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:50.271444 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b535875-7c0a-4ffa-a1a2-c3baef5129e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:50.271444 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b535875-7c0a-4ffa-a1a2-c3baef5129e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:21:50.271444 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b535875-7c0a-4ffa-a1a2-c3baef5129e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:50.272585 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9242e7-5695-4e3e-9221-cba8d877391a admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:50.273933 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b535875-7c0a-4ffa-a1a2-c3baef5129e0 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:50.292400 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 906/1809] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:21:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:21:50.292801 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b535875-7c0a-4ffa-a1a2-c3baef5129e0 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:50.303939 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b535875-7c0a-4ffa-a1a2-c3baef5129e0 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:50.310089 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:50.368760 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9242e7-5695-4e3e-9221-cba8d877391a admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:50.378681 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317622b2-7324-434c-aa92-d98926bd344c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:50.379374 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317622b2-7324-434c-aa92-d98926bd344c admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:50.380119 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317622b2-7324-434c-aa92-d98926bd344c admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:50.380419 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317622b2-7324-434c-aa92-d98926bd344c admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:50.381173 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317622b2-7324-434c-aa92-d98926bd344c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:50.383062 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317622b2-7324-434c-aa92-d98926bd344c admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:50.413924 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 904/1810] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:50.415377 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317622b2-7324-434c-aa92-d98926bd344c admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:50.435955 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317622b2-7324-434c-aa92-d98926bd344c admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:50.450257 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddbe34e-c730-466d-9449-bc6e07b0df1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:50.450661 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55ec71f-303c-497a-b4d3-5ace15054cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:50.450962 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddbe34e-c730-466d-9449-bc6e07b0df1a admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:50.451240 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddbe34e-c730-466d-9449-bc6e07b0df1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:50.451393 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ec71f-303c-497a-b4d3-5ace15054cac admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:50.451691 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddbe34e-c730-466d-9449-bc6e07b0df1a admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:50.451870 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ec71f-303c-497a-b4d3-5ace15054cac admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:50.451870 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ec71f-303c-497a-b4d3-5ace15054cac admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:50.452355 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddbe34e-c730-466d-9449-bc6e07b0df1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:50.454423 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddbe34e-c730-466d-9449-bc6e07b0df1a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:50.454593 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55ec71f-303c-497a-b4d3-5ace15054cac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:50.457603 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55ec71f-303c-497a-b4d3-5ace15054cac admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:50.489789 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 907/1811] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:21:50 2022] POST /identity/v3/users => generated 284 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:50.490656 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddbe34e-c730-466d-9449-bc6e07b0df1a admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:50.509998 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddbe34e-c730-466d-9449-bc6e07b0df1a admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:50.512618 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 905/1812] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:21:50 2022] POST /identity/v3/projects => generated 401 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:50.514550 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55ec71f-303c-497a-b4d3-5ace15054cac admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:50.630501 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:50.655432 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55ec71f-303c-497a-b4d3-5ace15054cac admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:50.662490 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67973d0-4ab7-4799-b037-52b42ddb2ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:50.663788 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67973d0-4ab7-4799-b037-52b42ddb2ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:50.664177 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67973d0-4ab7-4799-b037-52b42ddb2ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:50.664583 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67973d0-4ab7-4799-b037-52b42ddb2ca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:50.665623 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67973d0-4ab7-4799-b037-52b42ddb2ca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:50.667310 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7408ab1f-179a-47b0-870a-0c37b8e4fe71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:50.667806 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67973d0-4ab7-4799-b037-52b42ddb2ca9 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:50.668663 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408ab1f-179a-47b0-870a-0c37b8e4fe71 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:50.669110 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408ab1f-179a-47b0-870a-0c37b8e4fe71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:50.669384 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408ab1f-179a-47b0-870a-0c37b8e4fe71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:50.670181 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7408ab1f-179a-47b0-870a-0c37b8e4fe71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:50.672769 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7408ab1f-179a-47b0-870a-0c37b8e4fe71 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:50.682557 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 906/1813] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:50.684072 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67973d0-4ab7-4799-b037-52b42ddb2ca9 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:50.688104 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 908/1814] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:50.689435 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7408ab1f-179a-47b0-870a-0c37b8e4fe71 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:50.704213 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67973d0-4ab7-4799-b037-52b42ddb2ca9 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:50.704409 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7408ab1f-179a-47b0-870a-0c37b8e4fe71 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:50.719685 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d895343b-a57d-424b-bfea-acfb814377e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:50.720551 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895343b-a57d-424b-bfea-acfb814377e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:50.721049 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895343b-a57d-424b-bfea-acfb814377e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:50.721477 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895343b-a57d-424b-bfea-acfb814377e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:50.721977 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a83d11d-e086-4bb7-b970-618925d000a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:50.722592 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d895343b-a57d-424b-bfea-acfb814377e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:50.723271 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83d11d-e086-4bb7-b970-618925d000a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:50.723725 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83d11d-e086-4bb7-b970-618925d000a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:50.724166 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83d11d-e086-4bb7-b970-618925d000a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:50.724987 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a83d11d-e086-4bb7-b970-618925d000a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:50.725681 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d895343b-a57d-424b-bfea-acfb814377e7 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:50.727857 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a83d11d-e086-4bb7-b970-618925d000a2 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:50.738462 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 909/1815] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:50.739766 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d895343b-a57d-424b-bfea-acfb814377e7 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:50.768610 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d895343b-a57d-424b-bfea-acfb814377e7 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:50.775579 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cfee43-1a5d-48aa-9a05-7c27c389b856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:50.776576 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cfee43-1a5d-48aa-9a05-7c27c389b856 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:50.777181 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cfee43-1a5d-48aa-9a05-7c27c389b856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:50.777499 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cfee43-1a5d-48aa-9a05-7c27c389b856 admin admin] PATH_INFO: `/v3/projects/b3cd5f7a267d4571b3d13bda70b53638/users/25aa19e33f87441a920eaa45adfee500/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:50.780356 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 907/1816] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:21:50 2022] POST /identity/v3/users => generated 301 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:50.781397 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a83d11d-e086-4bb7-b970-618925d000a2 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:50.792667 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a83d11d-e086-4bb7-b970-618925d000a2 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:50.798326 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea89cc7-620a-4240-ba92-472cddd031ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:50.799257 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea89cc7-620a-4240-ba92-472cddd031ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:50.799552 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea89cc7-620a-4240-ba92-472cddd031ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:50.799728 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cfee43-1a5d-48aa-9a05-7c27c389b856 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3cd5f7a267d4571b3d13bda70b53638, user_id=25aa19e33f87441a920eaa45adfee500, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:50.799891 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea89cc7-620a-4240-ba92-472cddd031ea admin admin] PATH_INFO: `/v3/projects/dad3c12700744fb8b6f5cbf8032a96a6/users/56d59631026d4d5e84e81066278bebe8/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:50.802517 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cfee43-1a5d-48aa-9a05-7c27c389b856 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:50.820092 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea89cc7-620a-4240-ba92-472cddd031ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=dad3c12700744fb8b6f5cbf8032a96a6, user_id=56d59631026d4d5e84e81066278bebe8, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:50.821265 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 910/1817] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:50 2022] PUT /identity/v3/projects/b3cd5f7a267d4571b3d13bda70b53638/users/25aa19e33f87441a920eaa45adfee500/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:50.823276 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea89cc7-620a-4240-ba92-472cddd031ea admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:50.828546 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cfee43-1a5d-48aa-9a05-7c27c389b856 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:50.831018 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-83cfee43-1a5d-48aa-9a05-7c27c389b856 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:50.848075 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 908/1818] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:50 2022] PUT /identity/v3/projects/dad3c12700744fb8b6f5cbf8032a96a6/users/56d59631026d4d5e84e81066278bebe8/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:50.848075 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea89cc7-620a-4240-ba92-472cddd031ea admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:50.944823 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cfee43-1a5d-48aa-9a05-7c27c389b856 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:50.951890 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:50.980586 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea89cc7-620a-4240-ba92-472cddd031ea admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:50.991595 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eda388-de9b-4ba3-9ba8-c6294c5b1119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:50.992325 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eda388-de9b-4ba3-9ba8-c6294c5b1119 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:50.992569 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eda388-de9b-4ba3-9ba8-c6294c5b1119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:50.992843 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eda388-de9b-4ba3-9ba8-c6294c5b1119 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:50.993588 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eda388-de9b-4ba3-9ba8-c6294c5b1119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:50.995400 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eda388-de9b-4ba3-9ba8-c6294c5b1119 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:51.011773 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 909/1819] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:51.014364 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da696b1-29f3-4d25-b32d-4f24db3209e9 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:51.014945 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da696b1-29f3-4d25-b32d-4f24db3209e9 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:51.015537 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da696b1-29f3-4d25-b32d-4f24db3209e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:51.072481 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-3da696b1-29f3-4d25-b32d-4f24db3209e9 None None] MFA Rules not processed for user `25aa19e33f87441a920eaa45adfee500`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:51.073816 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-3da696b1-29f3-4d25-b32d-4f24db3209e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:51.084547 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50918d91-9aaa-4355-b4d1-c6cc3e3183e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:51.085716 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50918d91-9aaa-4355-b4d1-c6cc3e3183e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:51.086167 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50918d91-9aaa-4355-b4d1-c6cc3e3183e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:51.086639 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50918d91-9aaa-4355-b4d1-c6cc3e3183e2 admin admin] PATH_INFO: `/v3/users/984cd85471084641aa9781c55b7cff1b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:51.089851 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50918d91-9aaa-4355-b4d1-c6cc3e3183e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=984cd85471084641aa9781c55b7cff1b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:51.093183 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50918d91-9aaa-4355-b4d1-c6cc3e3183e2 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:51.179674 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-50918d91-9aaa-4355-b4d1-c6cc3e3183e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '984cd85471084641aa9781c55b7cff1b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:51.181248 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-50918d91-9aaa-4355-b4d1-c6cc3e3183e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '984cd85471084641aa9781c55b7cff1b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:51.182978 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-50918d91-9aaa-4355-b4d1-c6cc3e3183e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '984cd85471084641aa9781c55b7cff1b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:51.213251 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-50918d91-9aaa-4355-b4d1-c6cc3e3183e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '984cd85471084641aa9781c55b7cff1b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:51.214669 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 910/1820] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:51 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:51.222327 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56eea0-39f1-48e5-ad2a-dd9d36982d9a None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:51.223148 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56eea0-39f1-48e5-ad2a-dd9d36982d9a None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:51.223526 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56eea0-39f1-48e5-ad2a-dd9d36982d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:51.229354 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-50918d91-9aaa-4355-b4d1-c6cc3e3183e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '984cd85471084641aa9781c55b7cff1b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:51.273980 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-0b56eea0-39f1-48e5-ad2a-dd9d36982d9a None None] MFA Rules not processed for user `56d59631026d4d5e84e81066278bebe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:51.276205 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-0b56eea0-39f1-48e5-ad2a-dd9d36982d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:51.284018 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 911/1821] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:21:50 2022] DELETE /identity/v3/users/984cd85471084641aa9781c55b7cff1b => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:51.290960 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50918d91-9aaa-4355-b4d1-c6cc3e3183e2 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:51.293750 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-50918d91-9aaa-4355-b4d1-c6cc3e3183e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:51.294366 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:51.378181 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 911/1822] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:51 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:51.378181 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b56eea0-39f1-48e5-ad2a-dd9d36982d9a None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:51.382593 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-0b56eea0-39f1-48e5-ad2a-dd9d36982d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:51.398296 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b56eea0-39f1-48e5-ad2a-dd9d36982d9a None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:51.446512 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50918d91-9aaa-4355-b4d1-c6cc3e3183e2 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:51.463966 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc0d321-ad17-41f2-ab7f-f86a6a605f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:51.464897 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0d321-ad17-41f2-ab7f-f86a6a605f6d admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:51.465269 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0d321-ad17-41f2-ab7f-f86a6a605f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:51.465637 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0d321-ad17-41f2-ab7f-f86a6a605f6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:51.466701 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc0d321-ad17-41f2-ab7f-f86a6a605f6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:51.469172 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc0d321-ad17-41f2-ab7f-f86a6a605f6d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:51.489240 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 912/1823] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:51 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:51.489240 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc0d321-ad17-41f2-ab7f-f86a6a605f6d admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:51.489240 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3dc0d321-ad17-41f2-ab7f-f86a6a605f6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:51.519141 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc0d321-ad17-41f2-ab7f-f86a6a605f6d admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:51.519853 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac964c-ccb0-4489-b2f2-52264180b6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:51.520757 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac964c-ccb0-4489-b2f2-52264180b6c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:51.521040 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac964c-ccb0-4489-b2f2-52264180b6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:51.521315 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac964c-ccb0-4489-b2f2-52264180b6c7 admin admin] PATH_INFO: `/v3/projects/b177dde55836458c8edc9b4b1d1407e4` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:51.522858 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ac964c-ccb0-4489-b2f2-52264180b6c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b177dde55836458c8edc9b4b1d1407e4)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:51.524884 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ac964c-ccb0-4489-b2f2-52264180b6c7 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:51.526386 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52826c03-3e1d-46b8-bedc-1f1d5d323fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:51.527565 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52826c03-3e1d-46b8-bedc-1f1d5d323fce admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:51.528016 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52826c03-3e1d-46b8-bedc-1f1d5d323fce admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:51.528594 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52826c03-3e1d-46b8-bedc-1f1d5d323fce admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:51.529322 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52826c03-3e1d-46b8-bedc-1f1d5d323fce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:51.531711 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52826c03-3e1d-46b8-bedc-1f1d5d323fce admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:51.562952 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:51.574530 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 913/1824] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:21:51 2022] POST /identity/v3/projects => generated 363 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:51.576922 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7dcfdb-99d6-4ed7-bf49-3b90e7f03be7 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:51.577916 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7dcfdb-99d6-4ed7-bf49-3b90e7f03be7 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:51.578304 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7dcfdb-99d6-4ed7-bf49-3b90e7f03be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:51.601798 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-db7dcfdb-99d6-4ed7-bf49-3b90e7f03be7 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:51.603075 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-db7dcfdb-99d6-4ed7-bf49-3b90e7f03be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:51.627398 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-d6ac964c-ccb0-4489-b2f2-52264180b6c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b177dde55836458c8edc9b4b1d1407e4', 'request_id': 'req-d6ac964c-ccb0-4489-b2f2-52264180b6c7'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:51.640322 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-d6ac964c-ccb0-4489-b2f2-52264180b6c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b177dde55836458c8edc9b4b1d1407e4', 'request_id': 'req-d6ac964c-ccb0-4489-b2f2-52264180b6c7'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:51.652949 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-d6ac964c-ccb0-4489-b2f2-52264180b6c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b177dde55836458c8edc9b4b1d1407e4', 'request_id': 'req-d6ac964c-ccb0-4489-b2f2-52264180b6c7'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:51.675453 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-d6ac964c-ccb0-4489-b2f2-52264180b6c7 admin admin] The token cache is being invalidate because project b177dde55836458c8edc9b4b1d1407e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:21:51.676158 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-d6ac964c-ccb0-4489-b2f2-52264180b6c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:51.677635 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-d6ac964c-ccb0-4489-b2f2-52264180b6c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:51.681184 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 912/1825] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:21:51 2022] DELETE /identity/v3/projects/b177dde55836458c8edc9b4b1d1407e4 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:51.682538 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac964c-ccb0-4489-b2f2-52264180b6c7 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:51.685101 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-d6ac964c-ccb0-4489-b2f2-52264180b6c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:51.719274 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 914/1826] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:51.726092 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7dcfdb-99d6-4ed7-bf49-3b90e7f03be7 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:51.727447 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-db7dcfdb-99d6-4ed7-bf49-3b90e7f03be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:51.746244 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7dcfdb-99d6-4ed7-bf49-3b90e7f03be7 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:51.752197 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce78f9a-a48f-400b-ba86-e4c8ee7ea752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:51.752796 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce78f9a-a48f-400b-ba86-e4c8ee7ea752 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:51.753076 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce78f9a-a48f-400b-ba86-e4c8ee7ea752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:51.753352 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce78f9a-a48f-400b-ba86-e4c8ee7ea752 admin admin] PATH_INFO: `/v3/projects/28041cbe9ed84382ba72683d0bff4776/users/aae053c441c547fcb06e2406ef46864f/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:51.782915 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:51.786521 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce78f9a-a48f-400b-ba86-e4c8ee7ea752 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28041cbe9ed84382ba72683d0bff4776, user_id=aae053c441c547fcb06e2406ef46864f, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:51.793355 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce78f9a-a48f-400b-ba86-e4c8ee7ea752 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:51.843989 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac964c-ccb0-4489-b2f2-52264180b6c7 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:51.855296 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 915/1827] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:51 2022] PUT /identity/v3/projects/28041cbe9ed84382ba72683d0bff4776/users/aae053c441c547fcb06e2406ef46864f/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:51.857745 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce78f9a-a48f-400b-ba86-e4c8ee7ea752 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:51.863311 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9ce78f9a-a48f-400b-ba86-e4c8ee7ea752 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:51.966029 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004c1e9-9d87-4a9a-ba91-4c3da69fa1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:51.967098 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004c1e9-9d87-4a9a-ba91-4c3da69fa1d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:51.967638 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004c1e9-9d87-4a9a-ba91-4c3da69fa1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:51.968170 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004c1e9-9d87-4a9a-ba91-4c3da69fa1d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:51.969460 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c004c1e9-9d87-4a9a-ba91-4c3da69fa1d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:51.973154 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c004c1e9-9d87-4a9a-ba91-4c3da69fa1d9 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:51.998609 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce78f9a-a48f-400b-ba86-e4c8ee7ea752 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:52.009424 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de1340-a72f-4453-8f8c-276ff56d6f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:52.010653 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de1340-a72f-4453-8f8c-276ff56d6f85 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:52.011151 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de1340-a72f-4453-8f8c-276ff56d6f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:52.011726 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de1340-a72f-4453-8f8c-276ff56d6f85 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:52.013020 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2de1340-a72f-4453-8f8c-276ff56d6f85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:52.017085 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2de1340-a72f-4453-8f8c-276ff56d6f85 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:52.021802 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 913/1828] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:21:51 2022] POST /identity/v3/projects => generated 369 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:52.023594 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc46e9-acdb-4ba1-86b7-26ad39bcaca0 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:52.024342 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc46e9-acdb-4ba1-86b7-26ad39bcaca0 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:52.024829 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc46e9-acdb-4ba1-86b7-26ad39bcaca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:52.065524 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 916/1829] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:21:51 2022] POST /identity/v3/users => generated 288 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:52.065524 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de1340-a72f-4453-8f8c-276ff56d6f85 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:52.071972 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f2de1340-a72f-4453-8f8c-276ff56d6f85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:52.081151 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-18fc46e9-acdb-4ba1-86b7-26ad39bcaca0 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:52.083377 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-18fc46e9-acdb-4ba1-86b7-26ad39bcaca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:52.160508 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de1340-a72f-4453-8f8c-276ff56d6f85 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:52.182856 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 914/1830] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:52.185865 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d63d27-7297-44e8-b5b5-06fb1f93a47c None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:52.186522 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d63d27-7297-44e8-b5b5-06fb1f93a47c None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:52.187146 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d63d27-7297-44e8-b5b5-06fb1f93a47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:52.191884 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:52.232845 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-60d63d27-7297-44e8-b5b5-06fb1f93a47c None None] MFA Rules not processed for user `aae053c441c547fcb06e2406ef46864f`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:52.234349 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-60d63d27-7297-44e8-b5b5-06fb1f93a47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:52.249802 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca4375-9954-4cfb-8e54-3309b535ac9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:52.250593 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca4375-9954-4cfb-8e54-3309b535ac9a service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:52.250973 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca4375-9954-4cfb-8e54-3309b535ac9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:52.251338 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca4375-9954-4cfb-8e54-3309b535ac9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:52.269425 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ca4375-9954-4cfb-8e54-3309b535ac9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:52.272477 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ca4375-9954-4cfb-8e54-3309b535ac9a service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:52.289571 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 917/1831] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:52.291332 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca4375-9954-4cfb-8e54-3309b535ac9a service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:52.316160 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca4375-9954-4cfb-8e54-3309b535ac9a service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:52.326180 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99bdc55-6a93-4114-84ca-be5fe97258e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:52.327003 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bdc55-6a93-4114-84ca-be5fe97258e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:52.328138 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bdc55-6a93-4114-84ca-be5fe97258e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:52.328651 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bdc55-6a93-4114-84ca-be5fe97258e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:52.330427 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99bdc55-6a93-4114-84ca-be5fe97258e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:52.336686 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99bdc55-6a93-4114-84ca-be5fe97258e1 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:52.355905 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 915/1832] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:52 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:52.356763 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d63d27-7297-44e8-b5b5-06fb1f93a47c None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:52.373420 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d63d27-7297-44e8-b5b5-06fb1f93a47c None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:52.379471 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe461d-3be6-4587-893c-16049ebce72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:52.380773 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe461d-3be6-4587-893c-16049ebce72d admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:52.381065 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe461d-3be6-4587-893c-16049ebce72d admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:52.381382 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe461d-3be6-4587-893c-16049ebce72d admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:52.382979 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffe461d-3be6-4587-893c-16049ebce72d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:52.385179 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffe461d-3be6-4587-893c-16049ebce72d admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:52.386123 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 918/1833] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:21:52 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:52.388050 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:52.388451 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846f359-54ef-4d6a-852e-4595d4d1f76a None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:52.388925 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846f359-54ef-4d6a-852e-4595d4d1f76a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:52.389455 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846f359-54ef-4d6a-852e-4595d4d1f76a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:52.413984 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 916/1834] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:52.415965 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe461d-3be6-4587-893c-16049ebce72d admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:52.423671 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-3846f359-54ef-4d6a-852e-4595d4d1f76a None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:52.425535 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3846f359-54ef-4d6a-852e-4595d4d1f76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:52.431653 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe461d-3be6-4587-893c-16049ebce72d admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:52.438785 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457581e6-e03c-45b2-b1a5-ad4b29e29ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:52.439961 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457581e6-e03c-45b2-b1a5-ad4b29e29ea3 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:52.440246 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457581e6-e03c-45b2-b1a5-ad4b29e29ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:52.440516 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457581e6-e03c-45b2-b1a5-ad4b29e29ea3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:52.441224 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457581e6-e03c-45b2-b1a5-ad4b29e29ea3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:52.443213 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457581e6-e03c-45b2-b1a5-ad4b29e29ea3 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:52.447688 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 919/1835] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:52.448728 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3846f359-54ef-4d6a-852e-4595d4d1f76a None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:52.461534 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3846f359-54ef-4d6a-852e-4595d4d1f76a None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:52.468670 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1dbd9d-c3eb-4ef5-9763-1aba901b039e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:52.470050 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1dbd9d-c3eb-4ef5-9763-1aba901b039e admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:52.470662 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1dbd9d-c3eb-4ef5-9763-1aba901b039e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:52.471241 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1dbd9d-c3eb-4ef5-9763-1aba901b039e admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:52.472742 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1dbd9d-c3eb-4ef5-9763-1aba901b039e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:52.476495 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1dbd9d-c3eb-4ef5-9763-1aba901b039e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:52.491019 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 920/1836] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:52.492079 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1dbd9d-c3eb-4ef5-9763-1aba901b039e admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:52.512271 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 917/1837] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:21:52 2022] POST /identity/v3/projects => generated 401 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:52.514410 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457581e6-e03c-45b2-b1a5-ad4b29e29ea3 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:52.538624 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1dbd9d-c3eb-4ef5-9763-1aba901b039e admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:52.644852 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457581e6-e03c-45b2-b1a5-ad4b29e29ea3 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:52.660907 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc02ec8d-3b04-43d4-8987-37d6d151983b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:52.660907 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02ec8d-3b04-43d4-8987-37d6d151983b admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:52.661544 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02ec8d-3b04-43d4-8987-37d6d151983b admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:52.661963 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02ec8d-3b04-43d4-8987-37d6d151983b admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:52.664032 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc02ec8d-3b04-43d4-8987-37d6d151983b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:21:52.666881 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc02ec8d-3b04-43d4-8987-37d6d151983b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:52.670895 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc02ec8d-3b04-43d4-8987-37d6d151983b admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:52.671219 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25e34d-841b-4053-868c-102792b57adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:52.672038 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25e34d-841b-4053-868c-102792b57adb admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:52.674242 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25e34d-841b-4053-868c-102792b57adb admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:52.674639 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25e34d-841b-4053-868c-102792b57adb admin admin] PATH_INFO: `/v3/projects/140a00f65a874c07929fb5ce07025b7a/users/dc00811d6e5548a29399f8c4d79b89d8/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:52.700260 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 918/1838] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:21:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:21:52.707298 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc02ec8d-3b04-43d4-8987-37d6d151983b admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:52.713087 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f25e34d-841b-4053-868c-102792b57adb admin admin] RBAC: Authorizing `identity:create_grant(project_id=140a00f65a874c07929fb5ce07025b7a, user_id=dc00811d6e5548a29399f8c4d79b89d8, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:52.726705 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc02ec8d-3b04-43d4-8987-37d6d151983b admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:52.733554 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f25e34d-841b-4053-868c-102792b57adb admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:52.736863 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313c6b5-6116-4d29-b7c0-bb5a6d91ffff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:52.738384 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313c6b5-6116-4d29-b7c0-bb5a6d91ffff admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:52.738806 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313c6b5-6116-4d29-b7c0-bb5a6d91ffff admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:52.739253 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313c6b5-6116-4d29-b7c0-bb5a6d91ffff admin admin] PATH_INFO: `/v3/projects/31e88e0252474ce09c4072590b9c99c7/users/d87bb2341a7c4df9944bc8b18c3f8466/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:52.765507 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e313c6b5-6116-4d29-b7c0-bb5a6d91ffff admin admin] RBAC: Authorizing `identity:create_grant(project_id=31e88e0252474ce09c4072590b9c99c7, user_id=d87bb2341a7c4df9944bc8b18c3f8466, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:52.769965 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e313c6b5-6116-4d29-b7c0-bb5a6d91ffff admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:52.788668 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 921/1839] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:52 2022] PUT /identity/v3/projects/140a00f65a874c07929fb5ce07025b7a/users/dc00811d6e5548a29399f8c4d79b89d8/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:52.790984 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25e34d-841b-4053-868c-102792b57adb admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:52.800724 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 919/1840] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:52 2022] PUT /identity/v3/projects/31e88e0252474ce09c4072590b9c99c7/users/d87bb2341a7c4df9944bc8b18c3f8466/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:52.801687 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313c6b5-6116-4d29-b7c0-bb5a6d91ffff admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:52.918422 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313c6b5-6116-4d29-b7c0-bb5a6d91ffff admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:52.926591 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b920a6b-381f-4bd7-b34e-3cbbfd0add9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:52.927335 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b920a6b-381f-4bd7-b34e-3cbbfd0add9f admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:52.927629 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b920a6b-381f-4bd7-b34e-3cbbfd0add9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:52.927910 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b920a6b-381f-4bd7-b34e-3cbbfd0add9f admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:52.928697 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b920a6b-381f-4bd7-b34e-3cbbfd0add9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:52.930931 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b920a6b-381f-4bd7-b34e-3cbbfd0add9f admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:52.983576 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 920/1841] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:21:52 2022] POST /identity/v3/projects => generated 369 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:52.984729 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25e34d-841b-4053-868c-102792b57adb admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:52.985374 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b920a6b-381f-4bd7-b34e-3cbbfd0add9f admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:52.988218 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-9b920a6b-381f-4bd7-b34e-3cbbfd0add9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:53.027349 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:53.082445 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:53.121251 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c79932-c500-4a1a-81b1-1766e8c430ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:53.122169 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c79932-c500-4a1a-81b1-1766e8c430ee admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:53.122483 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c79932-c500-4a1a-81b1-1766e8c430ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:53.122907 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c79932-c500-4a1a-81b1-1766e8c430ee admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:53.123758 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c79932-c500-4a1a-81b1-1766e8c430ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:53.126932 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c79932-c500-4a1a-81b1-1766e8c430ee admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:53.147417 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b920a6b-381f-4bd7-b34e-3cbbfd0add9f admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:53.155518 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea51a0-a0ba-4ee6-925d-e6c1f93471f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:53.156893 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea51a0-a0ba-4ee6-925d-e6c1f93471f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:53.158649 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea51a0-a0ba-4ee6-925d-e6c1f93471f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:53.159252 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea51a0-a0ba-4ee6-925d-e6c1f93471f7 admin admin] PATH_INFO: `/v3/projects/b0fd1bb99bbe4fb0aa43706dcf3bd5b0` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:53.162122 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ea51a0-a0ba-4ee6-925d-e6c1f93471f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0fd1bb99bbe4fb0aa43706dcf3bd5b0)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:53.168721 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 922/1842] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:21:52 2022] POST /identity/v3/users => generated 307 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:53.168721 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c79932-c500-4a1a-81b1-1766e8c430ee admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:53.169096 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ea51a0-a0ba-4ee6-925d-e6c1f93471f7 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:53.187139 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c79932-c500-4a1a-81b1-1766e8c430ee admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:53.196506 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55df726-e3dc-4eaf-a8e2-f438c87d3c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:53.197631 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55df726-e3dc-4eaf-a8e2-f438c87d3c60 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:53.198181 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55df726-e3dc-4eaf-a8e2-f438c87d3c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:53.198656 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55df726-e3dc-4eaf-a8e2-f438c87d3c60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:53.199995 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55df726-e3dc-4eaf-a8e2-f438c87d3c60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:53.203072 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55df726-e3dc-4eaf-a8e2-f438c87d3c60 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:53.228598 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 923/1843] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:53.228598 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55df726-e3dc-4eaf-a8e2-f438c87d3c60 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:53.248516 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55df726-e3dc-4eaf-a8e2-f438c87d3c60 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:53.282837 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-87ea51a0-a0ba-4ee6-925d-e6c1f93471f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0fd1bb99bbe4fb0aa43706dcf3bd5b0', 'request_id': 'req-87ea51a0-a0ba-4ee6-925d-e6c1f93471f7'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:53.299695 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-87ea51a0-a0ba-4ee6-925d-e6c1f93471f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0fd1bb99bbe4fb0aa43706dcf3bd5b0', 'request_id': 'req-87ea51a0-a0ba-4ee6-925d-e6c1f93471f7'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:53.315794 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-87ea51a0-a0ba-4ee6-925d-e6c1f93471f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0fd1bb99bbe4fb0aa43706dcf3bd5b0', 'request_id': 'req-87ea51a0-a0ba-4ee6-925d-e6c1f93471f7'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:53.344018 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-87ea51a0-a0ba-4ee6-925d-e6c1f93471f7 admin admin] The token cache is being invalidate because project b0fd1bb99bbe4fb0aa43706dcf3bd5b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:21:53.344018 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-87ea51a0-a0ba-4ee6-925d-e6c1f93471f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:53.345045 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-87ea51a0-a0ba-4ee6-925d-e6c1f93471f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:53.354646 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 921/1844] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:21:52 2022] DELETE /identity/v3/projects/b0fd1bb99bbe4fb0aa43706dcf3bd5b0 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:53.357093 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea51a0-a0ba-4ee6-925d-e6c1f93471f7 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:53.360801 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-87ea51a0-a0ba-4ee6-925d-e6c1f93471f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:53.384039 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c61ed8-08f8-4331-bf1c-fa65a144868b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:53.385523 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c61ed8-08f8-4331-bf1c-fa65a144868b admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:53.402277 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c61ed8-08f8-4331-bf1c-fa65a144868b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:53.402565 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c61ed8-08f8-4331-bf1c-fa65a144868b admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:53.403376 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c61ed8-08f8-4331-bf1c-fa65a144868b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:53.405249 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c61ed8-08f8-4331-bf1c-fa65a144868b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:53.426863 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 924/1845] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:53.427347 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c61ed8-08f8-4331-bf1c-fa65a144868b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:53.433374 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-79c61ed8-08f8-4331-bf1c-fa65a144868b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:53.465322 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c61ed8-08f8-4331-bf1c-fa65a144868b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:53.470840 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a89ad2-db85-4c88-a58c-bf4894937cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:53.471550 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a89ad2-db85-4c88-a58c-bf4894937cfd admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:53.471957 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a89ad2-db85-4c88-a58c-bf4894937cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:53.472146 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a89ad2-db85-4c88-a58c-bf4894937cfd admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:53.472874 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a89ad2-db85-4c88-a58c-bf4894937cfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:53.474630 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a89ad2-db85-4c88-a58c-bf4894937cfd admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:53.487892 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea51a0-a0ba-4ee6-925d-e6c1f93471f7 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:53.496185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e5fb81-f3f7-47fe-9e25-ae1c97786a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:53.496683 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5fb81-f3f7-47fe-9e25-ae1c97786a4a admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:53.498001 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5fb81-f3f7-47fe-9e25-ae1c97786a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:53.498001 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5fb81-f3f7-47fe-9e25-ae1c97786a4a admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:53.499000 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e5fb81-f3f7-47fe-9e25-ae1c97786a4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:53.502770 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e5fb81-f3f7-47fe-9e25-ae1c97786a4a admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:53.509052 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 925/1846] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:53.509347 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a89ad2-db85-4c88-a58c-bf4894937cfd admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:53.521227 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d9a89ad2-db85-4c88-a58c-bf4894937cfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:53.547942 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 922/1847] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:21:53 2022] POST /identity/v3/users => generated 285 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:53.549183 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e5fb81-f3f7-47fe-9e25-ae1c97786a4a admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:53.551698 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-08e5fb81-f3f7-47fe-9e25-ae1c97786a4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:53.560143 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a89ad2-db85-4c88-a58c-bf4894937cfd admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:53.571797 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e5fb81-f3f7-47fe-9e25-ae1c97786a4a admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:53.578912 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36c560-dd8a-4075-b962-1cd1aba17345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:53.580112 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4004dfb-629f-4802-8fe0-4c884d8c5ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:53.580248 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36c560-dd8a-4075-b962-1cd1aba17345 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:53.580437 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36c560-dd8a-4075-b962-1cd1aba17345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:53.580840 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36c560-dd8a-4075-b962-1cd1aba17345 admin admin] PATH_INFO: `/v3/projects/140a00f65a874c07929fb5ce07025b7a/users/dc00811d6e5548a29399f8c4d79b89d8/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:53.581862 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4004dfb-629f-4802-8fe0-4c884d8c5ac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:53.582988 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4004dfb-629f-4802-8fe0-4c884d8c5ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:53.585193 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4004dfb-629f-4802-8fe0-4c884d8c5ac9 admin admin] PATH_INFO: `/v3/users/11745917dd6244009d6c61f0e39ed703` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:53.586807 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b36c560-dd8a-4075-b962-1cd1aba17345 admin admin] RBAC: Authorizing `identity:create_grant(project_id=140a00f65a874c07929fb5ce07025b7a, user_id=dc00811d6e5548a29399f8c4d79b89d8, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:53.587713 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4004dfb-629f-4802-8fe0-4c884d8c5ac9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11745917dd6244009d6c61f0e39ed703)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:53.590528 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b36c560-dd8a-4075-b962-1cd1aba17345 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:53.591581 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4004dfb-629f-4802-8fe0-4c884d8c5ac9 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:53.628474 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 926/1848] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:53 2022] PUT /identity/v3/projects/140a00f65a874c07929fb5ce07025b7a/users/dc00811d6e5548a29399f8c4d79b89d8/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:53.629853 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36c560-dd8a-4075-b962-1cd1aba17345 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:53.631614 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5b36c560-dd8a-4075-b962-1cd1aba17345 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:53.678519 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=83,keystone:DELETE=13,keystone:INSERT=4 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:53.683129 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-e4004dfb-629f-4802-8fe0-4c884d8c5ac9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11745917dd6244009d6c61f0e39ed703'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:53.717620 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-e4004dfb-629f-4802-8fe0-4c884d8c5ac9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11745917dd6244009d6c61f0e39ed703'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:53.736416 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-e4004dfb-629f-4802-8fe0-4c884d8c5ac9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11745917dd6244009d6c61f0e39ed703'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:53.737623 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-e4004dfb-629f-4802-8fe0-4c884d8c5ac9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11745917dd6244009d6c61f0e39ed703'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:53.753620 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-e4004dfb-629f-4802-8fe0-4c884d8c5ac9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11745917dd6244009d6c61f0e39ed703'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:53.771374 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36c560-dd8a-4075-b962-1cd1aba17345 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:53.779639 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71c7749-a7a9-42a0-befa-5b61d891ac6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:53.780943 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c7749-a7a9-42a0-befa-5b61d891ac6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:53.781464 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c7749-a7a9-42a0-befa-5b61d891ac6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:53.782082 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c7749-a7a9-42a0-befa-5b61d891ac6e admin admin] PATH_INFO: `/v3/projects/31e88e0252474ce09c4072590b9c99c7/users/d87bb2341a7c4df9944bc8b18c3f8466/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:53.786027 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71c7749-a7a9-42a0-befa-5b61d891ac6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=31e88e0252474ce09c4072590b9c99c7, user_id=d87bb2341a7c4df9944bc8b18c3f8466, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:53.788078 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 923/1849] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:21:53 2022] DELETE /identity/v3/users/11745917dd6244009d6c61f0e39ed703 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:53.789380 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4004dfb-629f-4802-8fe0-4c884d8c5ac9 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:53.792914 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e4004dfb-629f-4802-8fe0-4c884d8c5ac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:53.793236 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71c7749-a7a9-42a0-befa-5b61d891ac6e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:53.849043 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 927/1850] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:53 2022] PUT /identity/v3/projects/31e88e0252474ce09c4072590b9c99c7/users/d87bb2341a7c4df9944bc8b18c3f8466/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:53.849043 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71c7749-a7a9-42a0-befa-5b61d891ac6e admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:53.849043 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b71c7749-a7a9-42a0-befa-5b61d891ac6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:53.858481 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:53.949060 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4004dfb-629f-4802-8fe0-4c884d8c5ac9 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:54.012648 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71c7749-a7a9-42a0-befa-5b61d891ac6e admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:54.027821 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b072666a-89bb-4b80-ba7f-10df327494b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:54.036572 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b072666a-89bb-4b80-ba7f-10df327494b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:54.037078 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b072666a-89bb-4b80-ba7f-10df327494b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:54.037806 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b072666a-89bb-4b80-ba7f-10df327494b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:54.040313 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b072666a-89bb-4b80-ba7f-10df327494b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:54.042289 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b072666a-89bb-4b80-ba7f-10df327494b7 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:54.089871 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 928/1851] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:54.092866 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b3708-0ace-4a7c-8e21-3677f401da71 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:54.094016 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b3708-0ace-4a7c-8e21-3677f401da71 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:54.095464 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b3708-0ace-4a7c-8e21-3677f401da71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:54.136295 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f529936-0477-411c-a9ba-45e77e7161f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:54.139871 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f529936-0477-411c-a9ba-45e77e7161f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:54.140817 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f529936-0477-411c-a9ba-45e77e7161f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:54.141358 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f529936-0477-411c-a9ba-45e77e7161f1 admin admin] PATH_INFO: `/v3/projects/ef8354773f504569b8efc5c79c53fdd9/users/7c2ac8f7c18444a58ae2f9919b91051c/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:54.174706 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f529936-0477-411c-a9ba-45e77e7161f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef8354773f504569b8efc5c79c53fdd9, user_id=7c2ac8f7c18444a58ae2f9919b91051c, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:54.180041 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f529936-0477-411c-a9ba-45e77e7161f1 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:54.183641 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-d23b3708-0ace-4a7c-8e21-3677f401da71 None None] MFA Rules not processed for user `dc00811d6e5548a29399f8c4d79b89d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:54.185883 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d23b3708-0ace-4a7c-8e21-3677f401da71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:54.219846 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 924/1852] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:53 2022] PUT /identity/v3/projects/ef8354773f504569b8efc5c79c53fdd9/users/7c2ac8f7c18444a58ae2f9919b91051c/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:54.222552 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a48847-fc35-464d-8b1f-d5ac0ff3c728 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:54.223169 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a48847-fc35-464d-8b1f-d5ac0ff3c728 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:54.223770 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a48847-fc35-464d-8b1f-d5ac0ff3c728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:54.286750 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-43a48847-fc35-464d-8b1f-d5ac0ff3c728 None None] MFA Rules not processed for user `d87bb2341a7c4df9944bc8b18c3f8466`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:54.289533 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-43a48847-fc35-464d-8b1f-d5ac0ff3c728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:54.350783 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 929/1853] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:54 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:54.352662 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b3708-0ace-4a7c-8e21-3677f401da71 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:54.381907 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b3708-0ace-4a7c-8e21-3677f401da71 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:54.405662 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:54.492609 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc39294c-bc9d-46a5-bdeb-e0dfc26b832e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:54.493374 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39294c-bc9d-46a5-bdeb-e0dfc26b832e admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:54.495427 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39294c-bc9d-46a5-bdeb-e0dfc26b832e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:54.495739 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39294c-bc9d-46a5-bdeb-e0dfc26b832e admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:54.496547 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc39294c-bc9d-46a5-bdeb-e0dfc26b832e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:54.497445 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 925/1854] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:54 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:54.499326 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a48847-fc35-464d-8b1f-d5ac0ff3c728 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:54.505460 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc39294c-bc9d-46a5-bdeb-e0dfc26b832e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:54.520165 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a48847-fc35-464d-8b1f-d5ac0ff3c728 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:54.528203 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d9b71f-6f05-416f-ae5a-0090e66c9aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:54.529982 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d9b71f-6f05-416f-ae5a-0090e66c9aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:54.530436 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d9b71f-6f05-416f-ae5a-0090e66c9aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:54.530859 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d9b71f-6f05-416f-ae5a-0090e66c9aa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:54.534433 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 930/1855] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:54 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:54.534433 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc39294c-bc9d-46a5-bdeb-e0dfc26b832e admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:54.535356 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d9b71f-6f05-416f-ae5a-0090e66c9aa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:54.536892 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-bc39294c-bc9d-46a5-bdeb-e0dfc26b832e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:54.538114 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d9b71f-6f05-416f-ae5a-0090e66c9aa9 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:54.555032 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 926/1856] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:54 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:54.555970 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d9b71f-6f05-416f-ae5a-0090e66c9aa9 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:54.558454 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-c4d9b71f-6f05-416f-ae5a-0090e66c9aa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:54.577477 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d9b71f-6f05-416f-ae5a-0090e66c9aa9 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:54.583458 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:54.584370 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d3f3f-a173-4935-81b9-0c2b8909c9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:54.585671 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d3f3f-a173-4935-81b9-0c2b8909c9c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:54.586077 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d3f3f-a173-4935-81b9-0c2b8909c9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:54.586430 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d3f3f-a173-4935-81b9-0c2b8909c9c3 admin admin] PATH_INFO: `/v3/projects/d4e5676971d941c0b915ed8c20b11741` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:54.588311 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d3f3f-a173-4935-81b9-0c2b8909c9c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4e5676971d941c0b915ed8c20b11741)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:54.591684 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d3f3f-a173-4935-81b9-0c2b8909c9c3 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:54.621654 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc39294c-bc9d-46a5-bdeb-e0dfc26b832e admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:54.626315 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df9ef5e-58c5-4653-8459-120905a8ae43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:54.627276 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9ef5e-58c5-4653-8459-120905a8ae43 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:54.639020 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9ef5e-58c5-4653-8459-120905a8ae43 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:54.639537 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9ef5e-58c5-4653-8459-120905a8ae43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:54.704294 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-820d3f3f-a173-4935-81b9-0c2b8909c9c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4e5676971d941c0b915ed8c20b11741', 'request_id': 'req-820d3f3f-a173-4935-81b9-0c2b8909c9c3'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:54.715102 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-820d3f3f-a173-4935-81b9-0c2b8909c9c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4e5676971d941c0b915ed8c20b11741', 'request_id': 'req-820d3f3f-a173-4935-81b9-0c2b8909c9c3'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:54.728366 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-820d3f3f-a173-4935-81b9-0c2b8909c9c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4e5676971d941c0b915ed8c20b11741', 'request_id': 'req-820d3f3f-a173-4935-81b9-0c2b8909c9c3'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:54.768395 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-820d3f3f-a173-4935-81b9-0c2b8909c9c3 admin admin] The token cache is being invalidate because project d4e5676971d941c0b915ed8c20b11741 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:21:54.768866 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-820d3f3f-a173-4935-81b9-0c2b8909c9c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:54.769120 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df9ef5e-58c5-4653-8459-120905a8ae43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:54.770028 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-820d3f3f-a173-4935-81b9-0c2b8909c9c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:21:54.771000 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df9ef5e-58c5-4653-8459-120905a8ae43 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:54.774842 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 927/1857] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:21:54 2022] DELETE /identity/v3/projects/d4e5676971d941c0b915ed8c20b11741 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:54.776625 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d3f3f-a173-4935-81b9-0c2b8909c9c3 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:54.779609 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-820d3f3f-a173-4935-81b9-0c2b8909c9c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:54.783910 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 931/1858] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:54 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:54.784796 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df9ef5e-58c5-4653-8459-120905a8ae43 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:54.796813 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df9ef5e-58c5-4653-8459-120905a8ae43 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:54.919957 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6686e0af-cb7e-4de5-8cc1-ba15fef0f3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:54.922096 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6686e0af-cb7e-4de5-8cc1-ba15fef0f3cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:54.922381 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6686e0af-cb7e-4de5-8cc1-ba15fef0f3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:54.923758 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6686e0af-cb7e-4de5-8cc1-ba15fef0f3cf admin admin] PATH_INFO: `/v3/projects/6bf72271361144f390b20a1ffe844945/users/16abb8f7385c49239011f67534363625/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:54.974893 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6686e0af-cb7e-4de5-8cc1-ba15fef0f3cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bf72271361144f390b20a1ffe844945, user_id=16abb8f7385c49239011f67534363625, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:54.977957 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6686e0af-cb7e-4de5-8cc1-ba15fef0f3cf admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:54.979665 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d3f3f-a173-4935-81b9-0c2b8909c9c3 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:54.986777 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eecbddb-72b4-414b-ac75-05030383afb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:54.987916 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eecbddb-72b4-414b-ac75-05030383afb8 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:54.988270 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eecbddb-72b4-414b-ac75-05030383afb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:54.992934 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eecbddb-72b4-414b-ac75-05030383afb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:55.000861 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-1eecbddb-72b4-414b-ac75-05030383afb8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:55.018925 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 932/1859] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:54 2022] PUT /identity/v3/projects/6bf72271361144f390b20a1ffe844945/users/16abb8f7385c49239011f67534363625/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:55.020416 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6686e0af-cb7e-4de5-8cc1-ba15fef0f3cf admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:55.035093 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6686e0af-cb7e-4de5-8cc1-ba15fef0f3cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:55.179847 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eecbddb-72b4-414b-ac75-05030383afb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:55.184416 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eecbddb-72b4-414b-ac75-05030383afb8 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:55.192554 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:55.196153 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:55.207971 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6686e0af-cb7e-4de5-8cc1-ba15fef0f3cf admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:55.211356 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 928/1860] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:54 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:55.214171 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63978ebb-6d23-4e27-a2d6-212a098b2592 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:55.215056 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63978ebb-6d23-4e27-a2d6-212a098b2592 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:55.216954 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63978ebb-6d23-4e27-a2d6-212a098b2592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:55.218208 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feb8cdb-4e64-468b-b891-4049a0aedcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:55.219826 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb8cdb-4e64-468b-b891-4049a0aedcdb admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:55.220365 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb8cdb-4e64-468b-b891-4049a0aedcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:55.221269 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb8cdb-4e64-468b-b891-4049a0aedcdb admin admin] PATH_INFO: `/v3/projects/ef8354773f504569b8efc5c79c53fdd9/users/7c2ac8f7c18444a58ae2f9919b91051c/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:55.226323 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feb8cdb-4e64-468b-b891-4049a0aedcdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef8354773f504569b8efc5c79c53fdd9, user_id=7c2ac8f7c18444a58ae2f9919b91051c, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:55.231685 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feb8cdb-4e64-468b-b891-4049a0aedcdb admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:55.267159 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 933/1861] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:55 2022] PUT /identity/v3/projects/ef8354773f504569b8efc5c79c53fdd9/users/7c2ac8f7c18444a58ae2f9919b91051c/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:55.268857 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feb8cdb-4e64-468b-b891-4049a0aedcdb admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:55.276897 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-63978ebb-6d23-4e27-a2d6-212a098b2592 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:55.279145 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-63978ebb-6d23-4e27-a2d6-212a098b2592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:55.279689 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4feb8cdb-4e64-468b-b891-4049a0aedcdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:55.408963 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 929/1862] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:55.413880 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a3d9ac-e738-4f0a-b5a8-dbd5656e8e29 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:55.414611 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a3d9ac-e738-4f0a-b5a8-dbd5656e8e29 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:55.416397 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feb8cdb-4e64-468b-b891-4049a0aedcdb admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:55.416604 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a3d9ac-e738-4f0a-b5a8-dbd5656e8e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:55.422441 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18918a86-ab7a-44f8-8e22-b1e75a506e56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:55.423665 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18918a86-ab7a-44f8-8e22-b1e75a506e56 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:55.424704 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18918a86-ab7a-44f8-8e22-b1e75a506e56 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:55.424704 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18918a86-ab7a-44f8-8e22-b1e75a506e56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:55.428688 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-18918a86-ab7a-44f8-8e22-b1e75a506e56 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:55.511169 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-92a3d9ac-e738-4f0a-b5a8-dbd5656e8e29 None None] MFA Rules not processed for user `16abb8f7385c49239011f67534363625`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:55.516429 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-92a3d9ac-e738-4f0a-b5a8-dbd5656e8e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:55.524091 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18918a86-ab7a-44f8-8e22-b1e75a506e56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:55.527890 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18918a86-ab7a-44f8-8e22-b1e75a506e56 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:55.545745 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 934/1863] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:55 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:55.556784 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75208a3-d1ac-4822-9b1a-5506bf415a17 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:55.558584 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75208a3-d1ac-4822-9b1a-5506bf415a17 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:55.559027 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75208a3-d1ac-4822-9b1a-5506bf415a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:55.595985 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-a75208a3-d1ac-4822-9b1a-5506bf415a17 None None] MFA Rules not processed for user `7c2ac8f7c18444a58ae2f9919b91051c`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:55.602594 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a75208a3-d1ac-4822-9b1a-5506bf415a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:55.735153 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 935/1864] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:55 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:55.736834 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b25805-3387-4a6c-a2ce-39f7e9a25644 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:55.740821 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b25805-3387-4a6c-a2ce-39f7e9a25644 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:55.741448 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b25805-3387-4a6c-a2ce-39f7e9a25644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:55.792074 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 930/1865] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:55 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:55.792074 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a3d9ac-e738-4f0a-b5a8-dbd5656e8e29 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:55.792485 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-82b25805-3387-4a6c-a2ce-39f7e9a25644 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:55.792485 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-82b25805-3387-4a6c-a2ce-39f7e9a25644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:55.815340 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a3d9ac-e738-4f0a-b5a8-dbd5656e8e29 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:55.823513 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 936/1866] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:55.825217 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b0328-8109-4259-a928-76ab7ded0fbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:55.825398 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b0328-8109-4259-a928-76ab7ded0fbd service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:55.825662 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b0328-8109-4259-a928-76ab7ded0fbd service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:55.825966 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b0328-8109-4259-a928-76ab7ded0fbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:55.827493 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b25805-3387-4a6c-a2ce-39f7e9a25644 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:55.830241 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-82b25805-3387-4a6c-a2ce-39f7e9a25644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:55.848128 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704b0328-8109-4259-a928-76ab7ded0fbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:55.852134 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704b0328-8109-4259-a928-76ab7ded0fbd service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:55.859733 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b25805-3387-4a6c-a2ce-39f7e9a25644 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:55.871947 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35997b9-703e-4421-b18a-740815a0cbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:55.872645 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35997b9-703e-4421-b18a-740815a0cbd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:55.873100 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35997b9-703e-4421-b18a-740815a0cbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:55.873488 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35997b9-703e-4421-b18a-740815a0cbd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:55.874593 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35997b9-703e-4421-b18a-740815a0cbd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:55.876775 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 931/1867] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:55 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:55.880362 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b0328-8109-4259-a928-76ab7ded0fbd service cinder] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:55.888894 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35997b9-703e-4421-b18a-740815a0cbd1 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:55.911558 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b0328-8109-4259-a928-76ab7ded0fbd service cinder] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:55.928214 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7baa52-7d55-43a4-b744-49cef38ba98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:55.928999 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7baa52-7d55-43a4-b744-49cef38ba98f admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:55.929469 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7baa52-7d55-43a4-b744-49cef38ba98f admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:55.929835 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7baa52-7d55-43a4-b744-49cef38ba98f admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:55.930838 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7baa52-7d55-43a4-b744-49cef38ba98f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:21:55.931269 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7baa52-7d55-43a4-b744-49cef38ba98f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:55.935060 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7baa52-7d55-43a4-b744-49cef38ba98f admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:55.935594 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:55.950208 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 937/1868] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:21:55 2022] POST /identity/v3/projects => generated 367 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:55.951874 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 932/1869] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:21:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:21:55.958753 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35997b9-703e-4421-b18a-740815a0cbd1 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:55.961540 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7baa52-7d55-43a4-b744-49cef38ba98f admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:55.981296 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7baa52-7d55-43a4-b744-49cef38ba98f admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:56.119314 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e498d94-e95b-4a20-83c9-7b1d353024fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:56.121257 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e498d94-e95b-4a20-83c9-7b1d353024fa admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:56.138859 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e498d94-e95b-4a20-83c9-7b1d353024fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:56.141180 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e498d94-e95b-4a20-83c9-7b1d353024fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:56.143858 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e498d94-e95b-4a20-83c9-7b1d353024fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:56.153908 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e498d94-e95b-4a20-83c9-7b1d353024fa admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:56.169543 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:56.189223 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35997b9-703e-4421-b18a-740815a0cbd1 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:56.197637 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7fcb3-b5ea-49b3-ab43-139926314795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:56.198956 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7fcb3-b5ea-49b3-ab43-139926314795 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:56.199426 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7fcb3-b5ea-49b3-ab43-139926314795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:56.200645 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7fcb3-b5ea-49b3-ab43-139926314795 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:56.201198 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c7fcb3-b5ea-49b3-ab43-139926314795 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:56.205133 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c7fcb3-b5ea-49b3-ab43-139926314795 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:56.239243 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 938/1870] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:21:55 2022] POST /identity/v3/users => generated 290 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:56.240110 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7fcb3-b5ea-49b3-ab43-139926314795 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:56.271880 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 933/1871] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:21:55 2022] POST /identity/v3/projects => generated 373 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:56.274271 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e498d94-e95b-4a20-83c9-7b1d353024fa admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:56.351906 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7fcb3-b5ea-49b3-ab43-139926314795 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:56.425794 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e498d94-e95b-4a20-83c9-7b1d353024fa admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:56.443332 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc35cf0-9acb-4f9c-82b6-c86df441a0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:56.444096 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc35cf0-9acb-4f9c-82b6-c86df441a0d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:56.444415 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc35cf0-9acb-4f9c-82b6-c86df441a0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:56.444701 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc35cf0-9acb-4f9c-82b6-c86df441a0d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:56.445495 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc35cf0-9acb-4f9c-82b6-c86df441a0d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:56.446201 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a5c27-241a-4977-a767-eadbe1d52d93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:56.447610 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc35cf0-9acb-4f9c-82b6-c86df441a0d5 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:56.447766 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a5c27-241a-4977-a767-eadbe1d52d93 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:56.447766 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a5c27-241a-4977-a767-eadbe1d52d93 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:56.448003 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a5c27-241a-4977-a767-eadbe1d52d93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:56.451022 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7e6a5c27-241a-4977-a767-eadbe1d52d93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:56.462683 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 934/1872] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:56.462683 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc35cf0-9acb-4f9c-82b6-c86df441a0d5 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:56.473295 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc35cf0-9acb-4f9c-82b6-c86df441a0d5 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:56.480917 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c6482-142b-464c-8f02-40c0e38cee5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:56.481759 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c6482-142b-464c-8f02-40c0e38cee5f admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:56.482058 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c6482-142b-464c-8f02-40c0e38cee5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:56.482341 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c6482-142b-464c-8f02-40c0e38cee5f admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:56.483091 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320c6482-142b-464c-8f02-40c0e38cee5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:56.486823 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320c6482-142b-464c-8f02-40c0e38cee5f admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:56.534410 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 935/1873] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:21:56 2022] POST /identity/v3/users => generated 287 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:56.536216 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c6482-142b-464c-8f02-40c0e38cee5f admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:56.556244 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c6482-142b-464c-8f02-40c0e38cee5f admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:56.558674 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6a5c27-241a-4977-a767-eadbe1d52d93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:56.560657 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6a5c27-241a-4977-a767-eadbe1d52d93 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:56.566360 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:56.571461 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94000b5c-3803-47b1-a6bb-c7f172223010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:56.572982 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94000b5c-3803-47b1-a6bb-c7f172223010 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:56.573318 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94000b5c-3803-47b1-a6bb-c7f172223010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:56.573612 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94000b5c-3803-47b1-a6bb-c7f172223010 admin admin] PATH_INFO: `/v3/projects/ca46e5fca02e490995224df60fb2c8fa/users/f2b022acc06e4746a589329884efe072/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:56.607276 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94000b5c-3803-47b1-a6bb-c7f172223010 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca46e5fca02e490995224df60fb2c8fa, user_id=f2b022acc06e4746a589329884efe072, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:56.612139 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94000b5c-3803-47b1-a6bb-c7f172223010 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:56.612750 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 939/1874] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:56 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:56.615900 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a5c27-241a-4977-a767-eadbe1d52d93 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:56.646323 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 936/1875] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:56 2022] PUT /identity/v3/projects/ca46e5fca02e490995224df60fb2c8fa/users/f2b022acc06e4746a589329884efe072/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:56.658919 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a5c27-241a-4977-a767-eadbe1d52d93 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:56.660371 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94000b5c-3803-47b1-a6bb-c7f172223010 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:56.816575 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94000b5c-3803-47b1-a6bb-c7f172223010 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:56.831223 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741efac2-6dff-44c7-8f0c-ce6b8ac9c40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:56.836679 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741efac2-6dff-44c7-8f0c-ce6b8ac9c40a admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:56.836965 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741efac2-6dff-44c7-8f0c-ce6b8ac9c40a admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:56.837240 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741efac2-6dff-44c7-8f0c-ce6b8ac9c40a admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:56.838044 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741efac2-6dff-44c7-8f0c-ce6b8ac9c40a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:56.849451 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741efac2-6dff-44c7-8f0c-ce6b8ac9c40a admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:56.871026 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e3f64-ca98-4244-9c3f-372f01177531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:56.871821 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e3f64-ca98-4244-9c3f-372f01177531 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:56.872037 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e3f64-ca98-4244-9c3f-372f01177531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:56.872302 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e3f64-ca98-4244-9c3f-372f01177531 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:56.873328 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e3f64-ca98-4244-9c3f-372f01177531 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:56.880297 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e3f64-ca98-4244-9c3f-372f01177531 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:56.893738 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 937/1876] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:56.894941 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741efac2-6dff-44c7-8f0c-ce6b8ac9c40a admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:56.911248 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 940/1877] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:56.916492 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e3f64-ca98-4244-9c3f-372f01177531 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:56.925687 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741efac2-6dff-44c7-8f0c-ce6b8ac9c40a admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:56.937370 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf234d-6874-4291-b229-d22ffd2ca54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:56.939955 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf234d-6874-4291-b229-d22ffd2ca54c admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:56.940312 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf234d-6874-4291-b229-d22ffd2ca54c admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:56.940754 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf234d-6874-4291-b229-d22ffd2ca54c admin admin] PATH_INFO: `/v3/projects/ca46e5fca02e490995224df60fb2c8fa/users/f2b022acc06e4746a589329884efe072/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:56.946640 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbf234d-6874-4291-b229-d22ffd2ca54c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca46e5fca02e490995224df60fb2c8fa, user_id=f2b022acc06e4746a589329884efe072, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:56.955544 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbf234d-6874-4291-b229-d22ffd2ca54c admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:56.968786 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e3f64-ca98-4244-9c3f-372f01177531 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:56.989941 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7be791-f2dd-4dc9-931d-be0d733d1e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:56.990048 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 938/1878] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:56 2022] PUT /identity/v3/projects/ca46e5fca02e490995224df60fb2c8fa/users/f2b022acc06e4746a589329884efe072/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:56.990701 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7be791-f2dd-4dc9-931d-be0d733d1e00 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:56.990954 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7be791-f2dd-4dc9-931d-be0d733d1e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:56.991447 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7be791-f2dd-4dc9-931d-be0d733d1e00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:56.992900 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7be791-f2dd-4dc9-931d-be0d733d1e00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:57.005088 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7be791-f2dd-4dc9-931d-be0d733d1e00 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:57.005414 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb67dd34-3e4a-4d77-90da-2593e062b376 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:57.005414 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb67dd34-3e4a-4d77-90da-2593e062b376 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:57.005414 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb67dd34-3e4a-4d77-90da-2593e062b376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:57.054048 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 941/1879] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:57.060065 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7be791-f2dd-4dc9-931d-be0d733d1e00 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:57.086825 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7be791-f2dd-4dc9-931d-be0d733d1e00 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:57.110829 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-eb67dd34-3e4a-4d77-90da-2593e062b376 None None] MFA Rules not processed for user `f2b022acc06e4746a589329884efe072`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:57.114144 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-eb67dd34-3e4a-4d77-90da-2593e062b376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:57.181786 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:57.340305 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a9005d-4364-4d11-913e-c157df552474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:57.341356 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9005d-4364-4d11-913e-c157df552474 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:57.341679 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9005d-4364-4d11-913e-c157df552474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:57.344840 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9005d-4364-4d11-913e-c157df552474 admin admin] PATH_INFO: `/v3/projects/ace5557f6f51468bafeefaa81e69e1af/users/99f66cb2728e40afb68b60031770a6ba/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:57.394838 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a9005d-4364-4d11-913e-c157df552474 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ace5557f6f51468bafeefaa81e69e1af, user_id=99f66cb2728e40afb68b60031770a6ba, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:57.397585 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a9005d-4364-4d11-913e-c157df552474 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:57.436615 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 942/1880] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:57 2022] PUT /identity/v3/projects/ace5557f6f51468bafeefaa81e69e1af/users/99f66cb2728e40afb68b60031770a6ba/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:57.441035 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a7eb3-dabb-4261-8d42-7d865d63f9ab None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:57.441328 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a7eb3-dabb-4261-8d42-7d865d63f9ab None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:57.441663 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a7eb3-dabb-4261-8d42-7d865d63f9ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:57.446751 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 939/1881] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:57 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 445 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:57.514178 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb67dd34-3e4a-4d77-90da-2593e062b376 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:57.517883 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-b01a7eb3-dabb-4261-8d42-7d865d63f9ab None None] MFA Rules not processed for user `99f66cb2728e40afb68b60031770a6ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:57.519267 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b01a7eb3-dabb-4261-8d42-7d865d63f9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:57.692613 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:57.708372 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 943/1882] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:57.711306 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a7eb3-dabb-4261-8d42-7d865d63f9ab None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:57.749783 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb67dd34-3e4a-4d77-90da-2593e062b376 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:57.865651 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de261f28-05a2-4399-8d2e-649a44f5b5f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:57.866930 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de261f28-05a2-4399-8d2e-649a44f5b5f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:57.867491 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de261f28-05a2-4399-8d2e-649a44f5b5f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:57.867969 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de261f28-05a2-4399-8d2e-649a44f5b5f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:57.869947 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a7eb3-dabb-4261-8d42-7d865d63f9ab None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:57.877979 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a833f-a005-4609-96bf-b149a7071d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:57.879231 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a833f-a005-4609-96bf-b149a7071d6a admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:57.879640 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a833f-a005-4609-96bf-b149a7071d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:57.880177 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a833f-a005-4609-96bf-b149a7071d6a admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:57.881383 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62a833f-a005-4609-96bf-b149a7071d6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:57.887254 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62a833f-a005-4609-96bf-b149a7071d6a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:57.929958 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 944/1883] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:21:57 2022] POST /identity/v3/projects => generated 371 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:21:57.931518 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a833f-a005-4609-96bf-b149a7071d6a admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:57.996677 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de261f28-05a2-4399-8d2e-649a44f5b5f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:57.998414 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de261f28-05a2-4399-8d2e-649a44f5b5f5 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:58.013631 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 940/1884] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:57 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:58.047438 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a833f-a005-4609-96bf-b149a7071d6a admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:58.063607 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075deca7-42fb-448e-a2f4-8a5759d7ac74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:58.065160 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075deca7-42fb-448e-a2f4-8a5759d7ac74 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:58.065743 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075deca7-42fb-448e-a2f4-8a5759d7ac74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:58.066923 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075deca7-42fb-448e-a2f4-8a5759d7ac74 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:58.068137 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075deca7-42fb-448e-a2f4-8a5759d7ac74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:58.072501 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075deca7-42fb-448e-a2f4-8a5759d7ac74 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:58.108794 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 945/1885] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:21:57 2022] POST /identity/v3/users => generated 292 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:21:58.110712 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de261f28-05a2-4399-8d2e-649a44f5b5f5 service cinder] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:58.126941 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de261f28-05a2-4399-8d2e-649a44f5b5f5 service cinder] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:58.130953 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075deca7-42fb-448e-a2f4-8a5759d7ac74 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:58.142466 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee850f5-4d83-410b-87c7-7bcd4cfca70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:58.143888 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee850f5-4d83-410b-87c7-7bcd4cfca70d admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:58.144405 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee850f5-4d83-410b-87c7-7bcd4cfca70d admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:58.145015 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee850f5-4d83-410b-87c7-7bcd4cfca70d admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:58.146287 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee850f5-4d83-410b-87c7-7bcd4cfca70d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:58.149207 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee850f5-4d83-410b-87c7-7bcd4cfca70d admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:58.190709 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 941/1886] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:21:58.193321 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee850f5-4d83-410b-87c7-7bcd4cfca70d admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:58.203160 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:58.212029 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee850f5-4d83-410b-87c7-7bcd4cfca70d admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:58.221144 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dbd075-ad26-4639-8b1e-bd479c341f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:58.222954 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbd075-ad26-4639-8b1e-bd479c341f5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:58.223600 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbd075-ad26-4639-8b1e-bd479c341f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:58.224184 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbd075-ad26-4639-8b1e-bd479c341f5a admin admin] PATH_INFO: `/v3/projects/72a0e03c66b54694a9876c8c5ee4bf18/users/6eeab7721a9748c0b63e87b935edb8f4/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:58.252326 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dbd075-ad26-4639-8b1e-bd479c341f5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=72a0e03c66b54694a9876c8c5ee4bf18, user_id=6eeab7721a9748c0b63e87b935edb8f4, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:58.257912 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dbd075-ad26-4639-8b1e-bd479c341f5a admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:58.272536 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075deca7-42fb-448e-a2f4-8a5759d7ac74 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:58.281174 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 942/1887] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:58 2022] PUT /identity/v3/projects/72a0e03c66b54694a9876c8c5ee4bf18/users/6eeab7721a9748c0b63e87b935edb8f4/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:21:58.282616 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dbd075-ad26-4639-8b1e-bd479c341f5a admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:58.318683 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:21:58.370557 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07117b-7ef5-458b-9b03-c0ebb18d286f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:58.371701 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07117b-7ef5-458b-9b03-c0ebb18d286f service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:58.372168 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07117b-7ef5-458b-9b03-c0ebb18d286f service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:58.372640 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07117b-7ef5-458b-9b03-c0ebb18d286f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:58.386893 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dbd075-ad26-4639-8b1e-bd479c341f5a admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:58.396437 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa5b8df-da32-4e07-9954-b94ddf55c1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:58.398359 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5b8df-da32-4e07-9954-b94ddf55c1e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:58.398864 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5b8df-da32-4e07-9954-b94ddf55c1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:58.399428 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5b8df-da32-4e07-9954-b94ddf55c1e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:58.400834 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa5b8df-da32-4e07-9954-b94ddf55c1e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:58.405022 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa5b8df-da32-4e07-9954-b94ddf55c1e9 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:58.432827 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 943/1888] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:21:58.435692 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa5b8df-da32-4e07-9954-b94ddf55c1e9 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:58.455492 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa5b8df-da32-4e07-9954-b94ddf55c1e9 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:58.463010 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a913424-9147-48d1-b270-cea46faa8fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:58.464466 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a913424-9147-48d1-b270-cea46faa8fd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:58.464929 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a913424-9147-48d1-b270-cea46faa8fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:58.465390 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a913424-9147-48d1-b270-cea46faa8fd8 admin admin] PATH_INFO: `/v3/projects/72a0e03c66b54694a9876c8c5ee4bf18/users/6eeab7721a9748c0b63e87b935edb8f4/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:58.468925 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a913424-9147-48d1-b270-cea46faa8fd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72a0e03c66b54694a9876c8c5ee4bf18, user_id=6eeab7721a9748c0b63e87b935edb8f4, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:58.474066 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a913424-9147-48d1-b270-cea46faa8fd8 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:58.482212 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb07117b-7ef5-458b-9b03-c0ebb18d286f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:58.484753 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb07117b-7ef5-458b-9b03-c0ebb18d286f service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:58.492687 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 944/1889] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:21:58 2022] PUT /identity/v3/projects/72a0e03c66b54694a9876c8c5ee4bf18/users/6eeab7721a9748c0b63e87b935edb8f4/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:21:58.509625 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41699ee0-f495-4651-8af6-9d71dc8194a6 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:58.510187 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41699ee0-f495-4651-8af6-9d71dc8194a6 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:58.510550 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41699ee0-f495-4651-8af6-9d71dc8194a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:58.511998 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 946/1890] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:58 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:58.593221 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-41699ee0-f495-4651-8af6-9d71dc8194a6 None None] MFA Rules not processed for user `6eeab7721a9748c0b63e87b935edb8f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:58.594547 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-41699ee0-f495-4651-8af6-9d71dc8194a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:58.741599 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 945/1891] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:21:58 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:21:59.074821 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07117b-7ef5-458b-9b03-c0ebb18d286f service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:59.109333 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07117b-7ef5-458b-9b03-c0ebb18d286f service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:59.291889 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0822fbc-cf78-4690-9731-88d1f9e0283a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:59.293170 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0822fbc-cf78-4690-9731-88d1f9e0283a service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:59.294466 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0822fbc-cf78-4690-9731-88d1f9e0283a service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:59.294466 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0822fbc-cf78-4690-9731-88d1f9e0283a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:59.312699 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0822fbc-cf78-4690-9731-88d1f9e0283a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:59.315216 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0822fbc-cf78-4690-9731-88d1f9e0283a service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:59.333569 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 947/1892] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:59 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:21:59.504533 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ef1b9-978b-4ee1-88d4-02a21bc11e38 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:59.505419 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ef1b9-978b-4ee1-88d4-02a21bc11e38 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:59.505908 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ef1b9-978b-4ee1-88d4-02a21bc11e38 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:59.509089 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 946/1893] 10.222.0.27 () {54 vars in 921 bytes} [Wed Jun 29 12:21:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:21:59.524343 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f9c36-fc1a-4177-a311-4c90a090e977 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:59.524864 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f9c36-fc1a-4177-a311-4c90a090e977 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:59.525439 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f9c36-fc1a-4177-a311-4c90a090e977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:59.556854 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f18f9c36-fc1a-4177-a311-4c90a090e977 None None] MFA Rules not processed for user `7adaa2ef440941aa8214f2b2fd49b54e`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:21:59.558641 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f18f9c36-fc1a-4177-a311-4c90a090e977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:59.697294 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 948/1894] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Jun 29 12:21:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:21:59.742845 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ef1b9-978b-4ee1-88d4-02a21bc11e38 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:21:59.744839 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-383ef1b9-978b-4ee1-88d4-02a21bc11e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:21:59.789136 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ef1b9-978b-4ee1-88d4-02a21bc11e38 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:21:59.805426 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba6c0d8-6c76-40a4-bd24-0189dfa541ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7adaa2ef440941aa8214f2b2fd49b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:21:59.806627 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6c0d8-6c76-40a4-bd24-0189dfa541ec service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:21:59.809262 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6c0d8-6c76-40a4-bd24-0189dfa541ec service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:21:59.809900 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6c0d8-6c76-40a4-bd24-0189dfa541ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:21:59.834106 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba6c0d8-6c76-40a4-bd24-0189dfa541ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:21:59.837013 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba6c0d8-6c76-40a4-bd24-0189dfa541ec service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:21:59.854719 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 947/1895] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:21:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:22:01.382573 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f9c36-fc1a-4177-a311-4c90a090e977 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:01.422059 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:01.504282 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba6c0d8-6c76-40a4-bd24-0189dfa541ec service nova] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:01.508016 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-7ba6c0d8-6c76-40a4-bd24-0189dfa541ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:01.542215 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f9c36-fc1a-4177-a311-4c90a090e977 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:01.552262 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c33e5a6-637a-45f2-b31c-b51dd1ff585c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:01.554166 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33e5a6-637a-45f2-b31c-b51dd1ff585c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:01.554918 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33e5a6-637a-45f2-b31c-b51dd1ff585c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:01.555617 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33e5a6-637a-45f2-b31c-b51dd1ff585c admin admin] PATH_INFO: `/v3/users/99f66cb2728e40afb68b60031770a6ba` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:01.558371 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c33e5a6-637a-45f2-b31c-b51dd1ff585c admin admin] RBAC: Authorizing `identity:delete_user(user_id=99f66cb2728e40afb68b60031770a6ba)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:01.563160 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c33e5a6-637a-45f2-b31c-b51dd1ff585c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:01.580633 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:01.657366 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba6c0d8-6c76-40a4-bd24-0189dfa541ec service nova] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:01.664811 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0c33e5a6-637a-45f2-b31c-b51dd1ff585c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99f66cb2728e40afb68b60031770a6ba'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:01.665717 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0c33e5a6-637a-45f2-b31c-b51dd1ff585c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99f66cb2728e40afb68b60031770a6ba'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:01.666545 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0c33e5a6-637a-45f2-b31c-b51dd1ff585c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99f66cb2728e40afb68b60031770a6ba'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:01.671524 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc55e3-73ec-4e29-abf8-86b8897113c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:01.673193 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc55e3-73ec-4e29-abf8-86b8897113c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:01.673193 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc55e3-73ec-4e29-abf8-86b8897113c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:01.674252 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc55e3-73ec-4e29-abf8-86b8897113c1 admin admin] PATH_INFO: `/v3/users/56d59631026d4d5e84e81066278bebe8` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:01.674816 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc55e3-73ec-4e29-abf8-86b8897113c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56d59631026d4d5e84e81066278bebe8)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:01.678343 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc55e3-73ec-4e29-abf8-86b8897113c1 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:01.701262 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0c33e5a6-637a-45f2-b31c-b51dd1ff585c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99f66cb2728e40afb68b60031770a6ba'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:01.714710 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0c33e5a6-637a-45f2-b31c-b51dd1ff585c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99f66cb2728e40afb68b60031770a6ba'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:01.743908 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 949/1896] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:22:01 2022] DELETE /identity/v3/users/99f66cb2728e40afb68b60031770a6ba => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:01.750126 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5ea64-1db4-48db-9de0-eda813d07bb9 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:01.750622 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5ea64-1db4-48db-9de0-eda813d07bb9 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:01.751189 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5ea64-1db4-48db-9de0-eda813d07bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:01.778612 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c1b5ea64-1db4-48db-9de0-eda813d07bb9 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:01.780127 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c1b5ea64-1db4-48db-9de0-eda813d07bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:01.780826 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-05bc55e3-73ec-4e29-abf8-86b8897113c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56d59631026d4d5e84e81066278bebe8'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:01.829463 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-05bc55e3-73ec-4e29-abf8-86b8897113c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56d59631026d4d5e84e81066278bebe8'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:01.838664 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-05bc55e3-73ec-4e29-abf8-86b8897113c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56d59631026d4d5e84e81066278bebe8'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:01.839695 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-05bc55e3-73ec-4e29-abf8-86b8897113c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56d59631026d4d5e84e81066278bebe8'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:01.850861 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-05bc55e3-73ec-4e29-abf8-86b8897113c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56d59631026d4d5e84e81066278bebe8'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:01.873400 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 948/1897] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:22:01 2022] DELETE /identity/v3/users/56d59631026d4d5e84e81066278bebe8 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:01.875517 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0866ee39-32c3-4737-8288-9d8780e087a1 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:01.876123 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0866ee39-32c3-4737-8288-9d8780e087a1 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:01.876890 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0866ee39-32c3-4737-8288-9d8780e087a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:01.889323 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 950/1898] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:01.905960 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5ea64-1db4-48db-9de0-eda813d07bb9 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:01.907475 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c1b5ea64-1db4-48db-9de0-eda813d07bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:01.909740 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-0866ee39-32c3-4737-8288-9d8780e087a1 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:01.911040 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-0866ee39-32c3-4737-8288-9d8780e087a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:02.001976 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:02.053325 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5ea64-1db4-48db-9de0-eda813d07bb9 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:02.099504 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 949/1899] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:02.110218 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0866ee39-32c3-4737-8288-9d8780e087a1 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:02.153420 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d795ae-464d-44b5-86b2-1b6b97032743 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:02.154309 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d795ae-464d-44b5-86b2-1b6b97032743 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:02.154785 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d795ae-464d-44b5-86b2-1b6b97032743 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:02.155689 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d795ae-464d-44b5-86b2-1b6b97032743 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:02.183401 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d795ae-464d-44b5-86b2-1b6b97032743 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:02.191565 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d795ae-464d-44b5-86b2-1b6b97032743 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:02.248782 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 951/1900] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:22:02.250625 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d795ae-464d-44b5-86b2-1b6b97032743 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:02.253994 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-92d795ae-464d-44b5-86b2-1b6b97032743 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:02.304220 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0866ee39-32c3-4737-8288-9d8780e087a1 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:02.318720 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bfae4c-fdc9-48a5-995e-7d857362484c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:02.319820 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfae4c-fdc9-48a5-995e-7d857362484c service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:02.320299 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfae4c-fdc9-48a5-995e-7d857362484c service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:02.320792 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfae4c-fdc9-48a5-995e-7d857362484c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:02.326522 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d795ae-464d-44b5-86b2-1b6b97032743 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:02.340347 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767aaedd-d6ff-4b79-8c90-ed8a014c1a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:02.341374 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767aaedd-d6ff-4b79-8c90-ed8a014c1a4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:02.345606 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767aaedd-d6ff-4b79-8c90-ed8a014c1a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:02.345606 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767aaedd-d6ff-4b79-8c90-ed8a014c1a4a admin admin] PATH_INFO: `/v3/users/16abb8f7385c49239011f67534363625` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:02.346992 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767aaedd-d6ff-4b79-8c90-ed8a014c1a4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=16abb8f7385c49239011f67534363625)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:02.352749 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bfae4c-fdc9-48a5-995e-7d857362484c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:02.354671 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bfae4c-fdc9-48a5-995e-7d857362484c service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:02.356414 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767aaedd-d6ff-4b79-8c90-ed8a014c1a4a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:02.360118 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:02.386985 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 950/1901] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:22:02.439265 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bfae4c-fdc9-48a5-995e-7d857362484c service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:02.440924 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-74bfae4c-fdc9-48a5-995e-7d857362484c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:02.466071 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bfae4c-fdc9-48a5-995e-7d857362484c service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:02.480039 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae80e9-68f2-4420-a936-9e45fed6c9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:02.480971 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae80e9-68f2-4420-a936-9e45fed6c9bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:02.481250 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae80e9-68f2-4420-a936-9e45fed6c9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:02.481526 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae80e9-68f2-4420-a936-9e45fed6c9bf admin admin] PATH_INFO: `/v3/users/aae053c441c547fcb06e2406ef46864f` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:02.484384 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ae80e9-68f2-4420-a936-9e45fed6c9bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=aae053c441c547fcb06e2406ef46864f)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:02.487019 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ae80e9-68f2-4420-a936-9e45fed6c9bf admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:02.499143 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-767aaedd-d6ff-4b79-8c90-ed8a014c1a4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16abb8f7385c49239011f67534363625'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:02.501514 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-767aaedd-d6ff-4b79-8c90-ed8a014c1a4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16abb8f7385c49239011f67534363625'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:02.502638 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-767aaedd-d6ff-4b79-8c90-ed8a014c1a4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16abb8f7385c49239011f67534363625'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:02.540077 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-767aaedd-d6ff-4b79-8c90-ed8a014c1a4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16abb8f7385c49239011f67534363625'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:02.573735 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-767aaedd-d6ff-4b79-8c90-ed8a014c1a4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16abb8f7385c49239011f67534363625'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:02.595108 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 952/1902] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:22:02 2022] DELETE /identity/v3/users/16abb8f7385c49239011f67534363625 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:02.604158 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71d020-3cdc-47f4-942c-50fd06b847eb None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:02.605430 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71d020-3cdc-47f4-942c-50fd06b847eb None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:02.606380 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71d020-3cdc-47f4-942c-50fd06b847eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:02.614438 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-79ae80e9-68f2-4420-a936-9e45fed6c9bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aae053c441c547fcb06e2406ef46864f'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:02.635969 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-79ae80e9-68f2-4420-a936-9e45fed6c9bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aae053c441c547fcb06e2406ef46864f'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:02.658836 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-1b71d020-3cdc-47f4-942c-50fd06b847eb None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:02.659117 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-79ae80e9-68f2-4420-a936-9e45fed6c9bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aae053c441c547fcb06e2406ef46864f'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:02.661742 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-79ae80e9-68f2-4420-a936-9e45fed6c9bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aae053c441c547fcb06e2406ef46864f'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:02.665141 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1b71d020-3cdc-47f4-942c-50fd06b847eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:02.687147 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-79ae80e9-68f2-4420-a936-9e45fed6c9bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aae053c441c547fcb06e2406ef46864f'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:02.714104 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 951/1903] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:22:02 2022] DELETE /identity/v3/users/aae053c441c547fcb06e2406ef46864f => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:02.722792 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8f6b1-2b78-493c-a8bc-35c66539e8f3 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:02.724112 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8f6b1-2b78-493c-a8bc-35c66539e8f3 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:02.724847 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8f6b1-2b78-493c-a8bc-35c66539e8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:02.803389 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-64d8f6b1-2b78-493c-a8bc-35c66539e8f3 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:02.806898 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-64d8f6b1-2b78-493c-a8bc-35c66539e8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:02.887833 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 953/1904] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:22:02.889608 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71d020-3cdc-47f4-942c-50fd06b847eb None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:02.899149 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1b71d020-3cdc-47f4-942c-50fd06b847eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:02.958302 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71d020-3cdc-47f4-942c-50fd06b847eb None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:02.964434 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 952/1905] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:22:02.966441 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d8f6b1-2b78-493c-a8bc-35c66539e8f3 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:02.971153 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-64d8f6b1-2b78-493c-a8bc-35c66539e8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:02.980218 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870fb1b4-72cc-448e-b515-cbe5084fb7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:02.982233 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870fb1b4-72cc-448e-b515-cbe5084fb7dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:02.982759 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870fb1b4-72cc-448e-b515-cbe5084fb7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:02.983290 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870fb1b4-72cc-448e-b515-cbe5084fb7dc admin admin] PATH_INFO: `/v3/users/25aa19e33f87441a920eaa45adfee500` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:02.989143 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870fb1b4-72cc-448e-b515-cbe5084fb7dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=25aa19e33f87441a920eaa45adfee500)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:03.010479 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870fb1b4-72cc-448e-b515-cbe5084fb7dc admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:03.016436 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:03.176354 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-870fb1b4-72cc-448e-b515-cbe5084fb7dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25aa19e33f87441a920eaa45adfee500'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:03.177940 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-870fb1b4-72cc-448e-b515-cbe5084fb7dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25aa19e33f87441a920eaa45adfee500'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:03.180221 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-870fb1b4-72cc-448e-b515-cbe5084fb7dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25aa19e33f87441a920eaa45adfee500'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:03.193167 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d8f6b1-2b78-493c-a8bc-35c66539e8f3 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:03.202725 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe88f5a-7e4e-4ad8-a86e-1dffa807d6de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:03.204131 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe88f5a-7e4e-4ad8-a86e-1dffa807d6de service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:03.204635 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe88f5a-7e4e-4ad8-a86e-1dffa807d6de service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:03.206150 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe88f5a-7e4e-4ad8-a86e-1dffa807d6de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:03.211997 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-8fe88f5a-7e4e-4ad8-a86e-1dffa807d6de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:03.222940 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-870fb1b4-72cc-448e-b515-cbe5084fb7dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25aa19e33f87441a920eaa45adfee500'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:03.240152 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-870fb1b4-72cc-448e-b515-cbe5084fb7dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25aa19e33f87441a920eaa45adfee500'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:03.241573 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe88f5a-7e4e-4ad8-a86e-1dffa807d6de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:03.244443 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe88f5a-7e4e-4ad8-a86e-1dffa807d6de service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:03.269840 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 953/1906] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:22:03.270931 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 954/1907] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:22:02 2022] DELETE /identity/v3/users/25aa19e33f87441a920eaa45adfee500 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:03.271387 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe88f5a-7e4e-4ad8-a86e-1dffa807d6de service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:03.274524 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-8fe88f5a-7e4e-4ad8-a86e-1dffa807d6de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:03.305878 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0bd65e-e2ae-45a9-b77b-7232e64124d7 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:03.306406 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0bd65e-e2ae-45a9-b77b-7232e64124d7 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:03.306707 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0bd65e-e2ae-45a9-b77b-7232e64124d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:03.326119 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe88f5a-7e4e-4ad8-a86e-1dffa807d6de service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:03.348090 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:03.348313 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-7d0bd65e-e2ae-45a9-b77b-7232e64124d7 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:03.350182 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7d0bd65e-e2ae-45a9-b77b-7232e64124d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:03.447239 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 955/1908] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:03.448411 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0bd65e-e2ae-45a9-b77b-7232e64124d7 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:03.450591 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7d0bd65e-e2ae-45a9-b77b-7232e64124d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:03.465448 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0bd65e-e2ae-45a9-b77b-7232e64124d7 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:03.471199 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7584c15b-02ff-42b6-a1ef-4307f5aa13bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:03.472244 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584c15b-02ff-42b6-a1ef-4307f5aa13bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:03.472527 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584c15b-02ff-42b6-a1ef-4307f5aa13bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:03.472796 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584c15b-02ff-42b6-a1ef-4307f5aa13bd admin admin] PATH_INFO: `/v3/projects/ace5557f6f51468bafeefaa81e69e1af` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:03.481214 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7584c15b-02ff-42b6-a1ef-4307f5aa13bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ace5557f6f51468bafeefaa81e69e1af)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:03.484261 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7584c15b-02ff-42b6-a1ef-4307f5aa13bd admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:03.507917 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70461dd-3b58-4415-b71c-40f6cf40c9d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:03.509100 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70461dd-3b58-4415-b71c-40f6cf40c9d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:03.516359 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70461dd-3b58-4415-b71c-40f6cf40c9d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:03.517232 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70461dd-3b58-4415-b71c-40f6cf40c9d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:03.527360 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-c70461dd-3b58-4415-b71c-40f6cf40c9d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:03.546947 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70461dd-3b58-4415-b71c-40f6cf40c9d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:03.548672 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70461dd-3b58-4415-b71c-40f6cf40c9d0 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:03.576590 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7584c15b-02ff-42b6-a1ef-4307f5aa13bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ace5557f6f51468bafeefaa81e69e1af', 'request_id': 'req-7584c15b-02ff-42b6-a1ef-4307f5aa13bd'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:03.578171 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 954/1909] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:22:03.579210 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70461dd-3b58-4415-b71c-40f6cf40c9d0 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:03.581479 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-c70461dd-3b58-4415-b71c-40f6cf40c9d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:03.585553 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7584c15b-02ff-42b6-a1ef-4307f5aa13bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ace5557f6f51468bafeefaa81e69e1af', 'request_id': 'req-7584c15b-02ff-42b6-a1ef-4307f5aa13bd'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:03.594001 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70461dd-3b58-4415-b71c-40f6cf40c9d0 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:03.596520 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7584c15b-02ff-42b6-a1ef-4307f5aa13bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ace5557f6f51468bafeefaa81e69e1af', 'request_id': 'req-7584c15b-02ff-42b6-a1ef-4307f5aa13bd'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:03.616237 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7584c15b-02ff-42b6-a1ef-4307f5aa13bd admin admin] The token cache is being invalidate because project ace5557f6f51468bafeefaa81e69e1af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:22:03.616510 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7584c15b-02ff-42b6-a1ef-4307f5aa13bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:03.618063 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7584c15b-02ff-42b6-a1ef-4307f5aa13bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:03.619847 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 956/1910] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:22:03 2022] DELETE /identity/v3/projects/ace5557f6f51468bafeefaa81e69e1af => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:03.624497 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7584c15b-02ff-42b6-a1ef-4307f5aa13bd admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:03.626868 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7584c15b-02ff-42b6-a1ef-4307f5aa13bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:03.637502 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:03.666150 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71e1a3-78a6-4bda-bf83-5ab5d1abe651 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:03.667594 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71e1a3-78a6-4bda-bf83-5ab5d1abe651 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:03.667594 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71e1a3-78a6-4bda-bf83-5ab5d1abe651 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:03.667594 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71e1a3-78a6-4bda-bf83-5ab5d1abe651 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:03.670555 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-1c71e1a3-78a6-4bda-bf83-5ab5d1abe651 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:03.733413 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7584c15b-02ff-42b6-a1ef-4307f5aa13bd admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:03.743601 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed407b60-5585-4db6-8987-f956709de115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:03.745327 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed407b60-5585-4db6-8987-f956709de115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:03.746504 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed407b60-5585-4db6-8987-f956709de115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:03.746504 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed407b60-5585-4db6-8987-f956709de115 admin admin] PATH_INFO: `/v3/users/6eeab7721a9748c0b63e87b935edb8f4` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:03.748766 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed407b60-5585-4db6-8987-f956709de115 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6eeab7721a9748c0b63e87b935edb8f4)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:03.752706 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed407b60-5585-4db6-8987-f956709de115 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:03.769466 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c71e1a3-78a6-4bda-bf83-5ab5d1abe651 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:03.771125 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c71e1a3-78a6-4bda-bf83-5ab5d1abe651 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:03.786775 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 955/1911] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:22:03.816151 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71e1a3-78a6-4bda-bf83-5ab5d1abe651 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:03.817664 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-1c71e1a3-78a6-4bda-bf83-5ab5d1abe651 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:03.829755 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ed407b60-5585-4db6-8987-f956709de115 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6eeab7721a9748c0b63e87b935edb8f4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:03.830487 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ed407b60-5585-4db6-8987-f956709de115 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6eeab7721a9748c0b63e87b935edb8f4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:03.831303 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ed407b60-5585-4db6-8987-f956709de115 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6eeab7721a9748c0b63e87b935edb8f4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:03.836432 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71e1a3-78a6-4bda-bf83-5ab5d1abe651 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:03.843250 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b93180d-6197-41aa-a2ea-467465aafb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:03.844152 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93180d-6197-41aa-a2ea-467465aafb47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:03.844441 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93180d-6197-41aa-a2ea-467465aafb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:03.844710 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93180d-6197-41aa-a2ea-467465aafb47 admin admin] PATH_INFO: `/v3/projects/dad3c12700744fb8b6f5cbf8032a96a6` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:03.846191 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b93180d-6197-41aa-a2ea-467465aafb47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dad3c12700744fb8b6f5cbf8032a96a6)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:03.848236 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b93180d-6197-41aa-a2ea-467465aafb47 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:03.849383 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ed407b60-5585-4db6-8987-f956709de115 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6eeab7721a9748c0b63e87b935edb8f4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:03.861787 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ed407b60-5585-4db6-8987-f956709de115 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6eeab7721a9748c0b63e87b935edb8f4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:03.881116 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 957/1912] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:22:03 2022] DELETE /identity/v3/users/6eeab7721a9748c0b63e87b935edb8f4 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:22:03.952731 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7b93180d-6197-41aa-a2ea-467465aafb47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dad3c12700744fb8b6f5cbf8032a96a6', 'request_id': 'req-7b93180d-6197-41aa-a2ea-467465aafb47'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:03.964686 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7b93180d-6197-41aa-a2ea-467465aafb47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dad3c12700744fb8b6f5cbf8032a96a6', 'request_id': 'req-7b93180d-6197-41aa-a2ea-467465aafb47'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:03.969861 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:03.981512 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7b93180d-6197-41aa-a2ea-467465aafb47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dad3c12700744fb8b6f5cbf8032a96a6', 'request_id': 'req-7b93180d-6197-41aa-a2ea-467465aafb47'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:04.000954 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7b93180d-6197-41aa-a2ea-467465aafb47 admin admin] The token cache is being invalidate because project dad3c12700744fb8b6f5cbf8032a96a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:22:04.001517 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7b93180d-6197-41aa-a2ea-467465aafb47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:04.002452 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7b93180d-6197-41aa-a2ea-467465aafb47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:04.005038 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 956/1913] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:22:03 2022] DELETE /identity/v3/projects/dad3c12700744fb8b6f5cbf8032a96a6 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:04.009245 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed407b60-5585-4db6-8987-f956709de115 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:04.011059 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ed407b60-5585-4db6-8987-f956709de115 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:04.160654 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed407b60-5585-4db6-8987-f956709de115 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:04.208990 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:04.257322 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba30671-3d96-4ba5-aa74-1693de3b9eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:04.259606 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba30671-3d96-4ba5-aa74-1693de3b9eca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:04.259777 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba30671-3d96-4ba5-aa74-1693de3b9eca admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:04.260819 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba30671-3d96-4ba5-aa74-1693de3b9eca admin admin] PATH_INFO: `/v3/users/d87bb2341a7c4df9944bc8b18c3f8466` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:04.262518 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba30671-3d96-4ba5-aa74-1693de3b9eca admin admin] RBAC: Authorizing `identity:delete_user(user_id=d87bb2341a7c4df9944bc8b18c3f8466)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:04.265316 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba30671-3d96-4ba5-aa74-1693de3b9eca admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:04.355080 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3ba30671-3d96-4ba5-aa74-1693de3b9eca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd87bb2341a7c4df9944bc8b18c3f8466'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:04.355893 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3ba30671-3d96-4ba5-aa74-1693de3b9eca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd87bb2341a7c4df9944bc8b18c3f8466'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:04.356968 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3ba30671-3d96-4ba5-aa74-1693de3b9eca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd87bb2341a7c4df9944bc8b18c3f8466'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:04.376254 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b93180d-6197-41aa-a2ea-467465aafb47 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:04.378403 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-7b93180d-6197-41aa-a2ea-467465aafb47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:04.401775 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3ba30671-3d96-4ba5-aa74-1693de3b9eca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd87bb2341a7c4df9944bc8b18c3f8466'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:04.415726 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b93180d-6197-41aa-a2ea-467465aafb47 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:04.422485 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6cd1bf-932d-40a0-bb3b-241f9e7e74e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:04.423643 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6cd1bf-932d-40a0-bb3b-241f9e7e74e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:04.424049 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6cd1bf-932d-40a0-bb3b-241f9e7e74e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:04.424429 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6cd1bf-932d-40a0-bb3b-241f9e7e74e9 admin admin] PATH_INFO: `/v3/projects/72a0e03c66b54694a9876c8c5ee4bf18` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:04.430218 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3ba30671-3d96-4ba5-aa74-1693de3b9eca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd87bb2341a7c4df9944bc8b18c3f8466'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:04.433386 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6cd1bf-932d-40a0-bb3b-241f9e7e74e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72a0e03c66b54694a9876c8c5ee4bf18)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:04.436038 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6cd1bf-932d-40a0-bb3b-241f9e7e74e9 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:04.484347 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 958/1914] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:22:04 2022] DELETE /identity/v3/users/d87bb2341a7c4df9944bc8b18c3f8466 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:22:04.485527 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba30671-3d96-4ba5-aa74-1693de3b9eca admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:04.488657 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3ba30671-3d96-4ba5-aa74-1693de3b9eca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:04.572559 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9e6cd1bf-932d-40a0-bb3b-241f9e7e74e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72a0e03c66b54694a9876c8c5ee4bf18', 'request_id': 'req-9e6cd1bf-932d-40a0-bb3b-241f9e7e74e9'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:04.581857 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9e6cd1bf-932d-40a0-bb3b-241f9e7e74e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72a0e03c66b54694a9876c8c5ee4bf18', 'request_id': 'req-9e6cd1bf-932d-40a0-bb3b-241f9e7e74e9'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:04.593111 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9e6cd1bf-932d-40a0-bb3b-241f9e7e74e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72a0e03c66b54694a9876c8c5ee4bf18', 'request_id': 'req-9e6cd1bf-932d-40a0-bb3b-241f9e7e74e9'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:04.613773 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9e6cd1bf-932d-40a0-bb3b-241f9e7e74e9 admin admin] The token cache is being invalidate because project 72a0e03c66b54694a9876c8c5ee4bf18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:22:04.614155 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9e6cd1bf-932d-40a0-bb3b-241f9e7e74e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:04.614861 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9e6cd1bf-932d-40a0-bb3b-241f9e7e74e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:04.620022 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 957/1915] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:22:04 2022] DELETE /identity/v3/projects/72a0e03c66b54694a9876c8c5ee4bf18 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:22:04.620022 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6cd1bf-932d-40a0-bb3b-241f9e7e74e9 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:04.620022 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-9e6cd1bf-932d-40a0-bb3b-241f9e7e74e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:04.669865 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba30671-3d96-4ba5-aa74-1693de3b9eca admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:04.770171 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6cd1bf-932d-40a0-bb3b-241f9e7e74e9 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:04.777653 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd8c964-6eae-45bf-ac37-770ca5f53902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:04.778935 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8c964-6eae-45bf-ac37-770ca5f53902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:04.779486 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8c964-6eae-45bf-ac37-770ca5f53902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:04.780564 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8c964-6eae-45bf-ac37-770ca5f53902 admin admin] PATH_INFO: `/v3/projects/b3cd5f7a267d4571b3d13bda70b53638` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:04.782641 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd8c964-6eae-45bf-ac37-770ca5f53902 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3cd5f7a267d4571b3d13bda70b53638)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:04.785836 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd8c964-6eae-45bf-ac37-770ca5f53902 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:04.800367 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:04.815329 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a62649-5275-4ca1-8f58-de0ca4b43ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:04.818509 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a62649-5275-4ca1-8f58-de0ca4b43ae6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:04.819136 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a62649-5275-4ca1-8f58-de0ca4b43ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:04.819548 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a62649-5275-4ca1-8f58-de0ca4b43ae6 admin admin] PATH_INFO: `/v3/projects/6bf72271361144f390b20a1ffe844945` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:04.822048 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a62649-5275-4ca1-8f58-de0ca4b43ae6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bf72271361144f390b20a1ffe844945)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:04.824482 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a62649-5275-4ca1-8f58-de0ca4b43ae6 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:04.896004 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-46a62649-5275-4ca1-8f58-de0ca4b43ae6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bf72271361144f390b20a1ffe844945', 'request_id': 'req-46a62649-5275-4ca1-8f58-de0ca4b43ae6'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:04.900707 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-dcd8c964-6eae-45bf-ac37-770ca5f53902 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3cd5f7a267d4571b3d13bda70b53638', 'request_id': 'req-dcd8c964-6eae-45bf-ac37-770ca5f53902'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:04.905578 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-46a62649-5275-4ca1-8f58-de0ca4b43ae6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bf72271361144f390b20a1ffe844945', 'request_id': 'req-46a62649-5275-4ca1-8f58-de0ca4b43ae6'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:04.909263 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-dcd8c964-6eae-45bf-ac37-770ca5f53902 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3cd5f7a267d4571b3d13bda70b53638', 'request_id': 'req-dcd8c964-6eae-45bf-ac37-770ca5f53902'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:04.917771 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-46a62649-5275-4ca1-8f58-de0ca4b43ae6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bf72271361144f390b20a1ffe844945', 'request_id': 'req-46a62649-5275-4ca1-8f58-de0ca4b43ae6'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:04.934786 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-dcd8c964-6eae-45bf-ac37-770ca5f53902 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3cd5f7a267d4571b3d13bda70b53638', 'request_id': 'req-dcd8c964-6eae-45bf-ac37-770ca5f53902'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:04.941218 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-46a62649-5275-4ca1-8f58-de0ca4b43ae6 admin admin] The token cache is being invalidate because project 6bf72271361144f390b20a1ffe844945 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:22:04.941712 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-46a62649-5275-4ca1-8f58-de0ca4b43ae6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:04.943032 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-46a62649-5275-4ca1-8f58-de0ca4b43ae6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:04.945756 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 959/1916] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:22:04 2022] DELETE /identity/v3/projects/6bf72271361144f390b20a1ffe844945 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:04.947378 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a62649-5275-4ca1-8f58-de0ca4b43ae6 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:04.949480 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-46a62649-5275-4ca1-8f58-de0ca4b43ae6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:04.963380 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-dcd8c964-6eae-45bf-ac37-770ca5f53902 admin admin] The token cache is being invalidate because project b3cd5f7a267d4571b3d13bda70b53638 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:22:04.963668 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-dcd8c964-6eae-45bf-ac37-770ca5f53902 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:04.964356 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-dcd8c964-6eae-45bf-ac37-770ca5f53902 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:04.966016 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 958/1917] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:22:04 2022] DELETE /identity/v3/projects/b3cd5f7a267d4571b3d13bda70b53638 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:04.967445 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca119c-dba7-4743-87c0-c95aa01b01c1 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:04.967728 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca119c-dba7-4743-87c0-c95aa01b01c1 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:04.968003 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca119c-dba7-4743-87c0-c95aa01b01c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:04.975012 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:05.002415 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-77ca119c-dba7-4743-87c0-c95aa01b01c1 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:05.003770 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-77ca119c-dba7-4743-87c0-c95aa01b01c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:05.065395 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a62649-5275-4ca1-8f58-de0ca4b43ae6 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:05.070732 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a656f-efa5-437e-b174-2130373ce3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:05.071620 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a656f-efa5-437e-b174-2130373ce3c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:05.071907 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a656f-efa5-437e-b174-2130373ce3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:05.072181 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a656f-efa5-437e-b174-2130373ce3c3 admin admin] PATH_INFO: `/v3/projects/28041cbe9ed84382ba72683d0bff4776` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:05.073447 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a656f-efa5-437e-b174-2130373ce3c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28041cbe9ed84382ba72683d0bff4776)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:05.075461 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a656f-efa5-437e-b174-2130373ce3c3 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:05.096567 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 959/1918] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:05.104279 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca119c-dba7-4743-87c0-c95aa01b01c1 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:05.106772 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-77ca119c-dba7-4743-87c0-c95aa01b01c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:05.128946 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca119c-dba7-4743-87c0-c95aa01b01c1 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:05.139273 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ca0b4-5cf5-4f5f-b667-4c586fa765da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:05.140147 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ca0b4-5cf5-4f5f-b667-4c586fa765da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:05.140690 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ca0b4-5cf5-4f5f-b667-4c586fa765da admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:05.141035 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ca0b4-5cf5-4f5f-b667-4c586fa765da admin admin] PATH_INFO: `/v3/users/f2b022acc06e4746a589329884efe072` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:05.142593 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ca0b4-5cf5-4f5f-b667-4c586fa765da admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2b022acc06e4746a589329884efe072)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:05.144416 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ca0b4-5cf5-4f5f-b667-4c586fa765da admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:05.161086 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-495a656f-efa5-437e-b174-2130373ce3c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28041cbe9ed84382ba72683d0bff4776', 'request_id': 'req-495a656f-efa5-437e-b174-2130373ce3c3'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:05.169184 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-495a656f-efa5-437e-b174-2130373ce3c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28041cbe9ed84382ba72683d0bff4776', 'request_id': 'req-495a656f-efa5-437e-b174-2130373ce3c3'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:05.179708 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-495a656f-efa5-437e-b174-2130373ce3c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28041cbe9ed84382ba72683d0bff4776', 'request_id': 'req-495a656f-efa5-437e-b174-2130373ce3c3'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:05.200802 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-495a656f-efa5-437e-b174-2130373ce3c3 admin admin] The token cache is being invalidate because project 28041cbe9ed84382ba72683d0bff4776 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:22:05.201095 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-495a656f-efa5-437e-b174-2130373ce3c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:05.201826 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-495a656f-efa5-437e-b174-2130373ce3c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:05.203777 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 960/1919] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:22:04 2022] DELETE /identity/v3/projects/28041cbe9ed84382ba72683d0bff4776 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:05.204715 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a656f-efa5-437e-b174-2130373ce3c3 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:05.206344 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-495a656f-efa5-437e-b174-2130373ce3c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:05.219702 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2f4ca0b4-5cf5-4f5f-b667-4c586fa765da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2b022acc06e4746a589329884efe072'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:05.229932 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:05.234709 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2f4ca0b4-5cf5-4f5f-b667-4c586fa765da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2b022acc06e4746a589329884efe072'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:05.245883 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2f4ca0b4-5cf5-4f5f-b667-4c586fa765da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2b022acc06e4746a589329884efe072'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:05.246965 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2f4ca0b4-5cf5-4f5f-b667-4c586fa765da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2b022acc06e4746a589329884efe072'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:05.257496 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2f4ca0b4-5cf5-4f5f-b667-4c586fa765da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2b022acc06e4746a589329884efe072'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:05.264711 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 960/1920] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:22:05 2022] DELETE /identity/v3/users/f2b022acc06e4746a589329884efe072 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:05.265640 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ca0b4-5cf5-4f5f-b667-4c586fa765da admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:05.267501 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-2f4ca0b4-5cf5-4f5f-b667-4c586fa765da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:05.307549 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a656f-efa5-437e-b174-2130373ce3c3 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:05.367173 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ca0b4-5cf5-4f5f-b667-4c586fa765da admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:05.374804 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b53bd89-503f-479b-8c3d-c0916829b2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:05.375698 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53bd89-503f-479b-8c3d-c0916829b2f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:05.375980 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53bd89-503f-479b-8c3d-c0916829b2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:05.376898 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53bd89-503f-479b-8c3d-c0916829b2f4 admin admin] PATH_INFO: `/v3/projects/31e88e0252474ce09c4072590b9c99c7` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:05.378645 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b53bd89-503f-479b-8c3d-c0916829b2f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31e88e0252474ce09c4072590b9c99c7)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:05.393127 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b53bd89-503f-479b-8c3d-c0916829b2f4 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:05.420845 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:05.429351 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06838b37-a5dc-4d8f-9514-1eef79de4e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:05.430866 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06838b37-a5dc-4d8f-9514-1eef79de4e55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:05.431330 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06838b37-a5dc-4d8f-9514-1eef79de4e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:05.431779 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06838b37-a5dc-4d8f-9514-1eef79de4e55 admin admin] PATH_INFO: `/v3/users/dc00811d6e5548a29399f8c4d79b89d8` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:05.433921 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06838b37-a5dc-4d8f-9514-1eef79de4e55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc00811d6e5548a29399f8c4d79b89d8)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:05.437360 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06838b37-a5dc-4d8f-9514-1eef79de4e55 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:05.487025 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9b53bd89-503f-479b-8c3d-c0916829b2f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31e88e0252474ce09c4072590b9c99c7', 'request_id': 'req-9b53bd89-503f-479b-8c3d-c0916829b2f4'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:05.496677 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9b53bd89-503f-479b-8c3d-c0916829b2f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31e88e0252474ce09c4072590b9c99c7', 'request_id': 'req-9b53bd89-503f-479b-8c3d-c0916829b2f4'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:05.509281 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9b53bd89-503f-479b-8c3d-c0916829b2f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31e88e0252474ce09c4072590b9c99c7', 'request_id': 'req-9b53bd89-503f-479b-8c3d-c0916829b2f4'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:05.511914 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-06838b37-a5dc-4d8f-9514-1eef79de4e55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc00811d6e5548a29399f8c4d79b89d8'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:05.512750 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-06838b37-a5dc-4d8f-9514-1eef79de4e55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc00811d6e5548a29399f8c4d79b89d8'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:05.513581 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-06838b37-a5dc-4d8f-9514-1eef79de4e55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc00811d6e5548a29399f8c4d79b89d8'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:05.523166 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9b53bd89-503f-479b-8c3d-c0916829b2f4 admin admin] The token cache is being invalidate because project 31e88e0252474ce09c4072590b9c99c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:22:05.523527 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9b53bd89-503f-479b-8c3d-c0916829b2f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:05.525101 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9b53bd89-503f-479b-8c3d-c0916829b2f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:05.527187 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 961/1921] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:22:05 2022] DELETE /identity/v3/projects/31e88e0252474ce09c4072590b9c99c7 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:05.528852 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d12c2-389a-4016-b3fd-f143cdea62e8 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:05.529137 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d12c2-389a-4016-b3fd-f143cdea62e8 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:05.529413 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d12c2-389a-4016-b3fd-f143cdea62e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:05.534680 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-06838b37-a5dc-4d8f-9514-1eef79de4e55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc00811d6e5548a29399f8c4d79b89d8'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:05.545465 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-06838b37-a5dc-4d8f-9514-1eef79de4e55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc00811d6e5548a29399f8c4d79b89d8'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:05.551873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-fc3d12c2-389a-4016-b3fd-f143cdea62e8 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:05.552911 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-fc3d12c2-389a-4016-b3fd-f143cdea62e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:05.564294 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 961/1922] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:22:05 2022] DELETE /identity/v3/users/dc00811d6e5548a29399f8c4d79b89d8 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:05.564294 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06838b37-a5dc-4d8f-9514-1eef79de4e55 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:05.564294 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-06838b37-a5dc-4d8f-9514-1eef79de4e55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:05.628719 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 962/1923] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:05.630285 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c9d74-a9be-43ac-b457-63faa8e4172d None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:05.630711 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c9d74-a9be-43ac-b457-63faa8e4172d None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:05.631101 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c9d74-a9be-43ac-b457-63faa8e4172d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:05.640233 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:05.664997 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06838b37-a5dc-4d8f-9514-1eef79de4e55 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:05.671783 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c7b1b-d3a6-4794-9a59-fe3f69146564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:05.673074 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c7b1b-d3a6-4794-9a59-fe3f69146564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:05.673498 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c7b1b-d3a6-4794-9a59-fe3f69146564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:05.673902 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c7b1b-d3a6-4794-9a59-fe3f69146564 admin admin] PATH_INFO: `/v3/users/7c2ac8f7c18444a58ae2f9919b91051c` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:05.675461 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c7b1b-d3a6-4794-9a59-fe3f69146564 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c2ac8f7c18444a58ae2f9919b91051c)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:05.678371 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c7b1b-d3a6-4794-9a59-fe3f69146564 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:05.688060 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-d12c9d74-a9be-43ac-b457-63faa8e4172d None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:05.690631 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-d12c9d74-a9be-43ac-b457-63faa8e4172d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:05.711441 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 963/1924] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:05.712927 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c9d74-a9be-43ac-b457-63faa8e4172d None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:05.748350 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c9d74-a9be-43ac-b457-63faa8e4172d None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:05.757088 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967aef83-761e-4407-8279-efb36857122b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:05.757859 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967aef83-761e-4407-8279-efb36857122b admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:05.758150 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967aef83-761e-4407-8279-efb36857122b admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:05.758435 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967aef83-761e-4407-8279-efb36857122b admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:05.759582 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967aef83-761e-4407-8279-efb36857122b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:22:05.760039 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967aef83-761e-4407-8279-efb36857122b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:05.761915 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967aef83-761e-4407-8279-efb36857122b admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:05.774316 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-4e7c7b1b-d3a6-4794-9a59-fe3f69146564 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c2ac8f7c18444a58ae2f9919b91051c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:05.779969 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-4e7c7b1b-d3a6-4794-9a59-fe3f69146564 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c2ac8f7c18444a58ae2f9919b91051c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:05.783306 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-4e7c7b1b-d3a6-4794-9a59-fe3f69146564 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c2ac8f7c18444a58ae2f9919b91051c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:05.797565 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 964/1925] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:22:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:22:05.798778 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967aef83-761e-4407-8279-efb36857122b admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:05.801002 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-967aef83-761e-4407-8279-efb36857122b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:05.808344 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-4e7c7b1b-d3a6-4794-9a59-fe3f69146564 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c2ac8f7c18444a58ae2f9919b91051c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:05.822515 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-4e7c7b1b-d3a6-4794-9a59-fe3f69146564 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c2ac8f7c18444a58ae2f9919b91051c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:05.823103 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967aef83-761e-4407-8279-efb36857122b admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:05.828582 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32103fb8-eb60-48b2-b3fb-aae22ee6c8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:05.829473 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32103fb8-eb60-48b2-b3fb-aae22ee6c8f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:05.829785 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32103fb8-eb60-48b2-b3fb-aae22ee6c8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:05.830059 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32103fb8-eb60-48b2-b3fb-aae22ee6c8f8 admin admin] PATH_INFO: `/v3/projects/ca46e5fca02e490995224df60fb2c8fa` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:05.831330 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32103fb8-eb60-48b2-b3fb-aae22ee6c8f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca46e5fca02e490995224df60fb2c8fa)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:05.833665 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32103fb8-eb60-48b2-b3fb-aae22ee6c8f8 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:05.859271 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 962/1926] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:22:05 2022] DELETE /identity/v3/users/7c2ac8f7c18444a58ae2f9919b91051c => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:05.861086 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495580d1-cfc7-4ca0-bd63-f0236d45149e None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:05.861448 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495580d1-cfc7-4ca0-bd63-f0236d45149e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:05.861832 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495580d1-cfc7-4ca0-bd63-f0236d45149e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:05.900888 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-495580d1-cfc7-4ca0-bd63-f0236d45149e None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:05.903796 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-495580d1-cfc7-4ca0-bd63-f0236d45149e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:05.919936 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-32103fb8-eb60-48b2-b3fb-aae22ee6c8f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca46e5fca02e490995224df60fb2c8fa', 'request_id': 'req-32103fb8-eb60-48b2-b3fb-aae22ee6c8f8'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:05.929306 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-32103fb8-eb60-48b2-b3fb-aae22ee6c8f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca46e5fca02e490995224df60fb2c8fa', 'request_id': 'req-32103fb8-eb60-48b2-b3fb-aae22ee6c8f8'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:05.947893 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-32103fb8-eb60-48b2-b3fb-aae22ee6c8f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca46e5fca02e490995224df60fb2c8fa', 'request_id': 'req-32103fb8-eb60-48b2-b3fb-aae22ee6c8f8'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:05.993443 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-32103fb8-eb60-48b2-b3fb-aae22ee6c8f8 admin admin] The token cache is being invalidate because project ca46e5fca02e490995224df60fb2c8fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:22:05.994453 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-32103fb8-eb60-48b2-b3fb-aae22ee6c8f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:05.995410 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-32103fb8-eb60-48b2-b3fb-aae22ee6c8f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:06.001910 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 965/1927] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:22:05 2022] DELETE /identity/v3/projects/ca46e5fca02e490995224df60fb2c8fa => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:06.003893 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32103fb8-eb60-48b2-b3fb-aae22ee6c8f8 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:06.012420 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-32103fb8-eb60-48b2-b3fb-aae22ee6c8f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:06.035136 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:06.128578 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 963/1928] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:06.131138 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685c424-1d03-45ad-beeb-4ffd507e6180 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:06.131138 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685c424-1d03-45ad-beeb-4ffd507e6180 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:06.131138 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685c424-1d03-45ad-beeb-4ffd507e6180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:06.207107 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e685c424-1d03-45ad-beeb-4ffd507e6180 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:06.213723 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e685c424-1d03-45ad-beeb-4ffd507e6180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:06.228347 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32103fb8-eb60-48b2-b3fb-aae22ee6c8f8 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:06.237058 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f20735-10c3-4790-a737-11d9e8b3a451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:06.238786 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f20735-10c3-4790-a737-11d9e8b3a451 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:06.239299 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f20735-10c3-4790-a737-11d9e8b3a451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:06.239949 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f20735-10c3-4790-a737-11d9e8b3a451 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:06.241625 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f20735-10c3-4790-a737-11d9e8b3a451 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:06.245587 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f20735-10c3-4790-a737-11d9e8b3a451 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:06.247958 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 964/1929] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:06.251635 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e685c424-1d03-45ad-beeb-4ffd507e6180 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:06.296180 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e685c424-1d03-45ad-beeb-4ffd507e6180 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:06.310701 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 966/1930] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:22:06 2022] POST /identity/v3/projects => generated 363 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:06.315440 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148526ac-7e26-4cc8-9d67-27e2c190aa3d None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:06.318854 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148526ac-7e26-4cc8-9d67-27e2c190aa3d None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:06.319484 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148526ac-7e26-4cc8-9d67-27e2c190aa3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:06.320830 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4fe687-fe45-4bdb-a725-357622a01caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:06.324903 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4fe687-fe45-4bdb-a725-357622a01caf admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:06.325415 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4fe687-fe45-4bdb-a725-357622a01caf admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:06.329734 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4fe687-fe45-4bdb-a725-357622a01caf admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:06.334909 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4fe687-fe45-4bdb-a725-357622a01caf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:22:06.335476 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4fe687-fe45-4bdb-a725-357622a01caf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:06.345307 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4fe687-fe45-4bdb-a725-357622a01caf admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:06.411360 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 965/1931] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:22:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:22:06.412268 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4fe687-fe45-4bdb-a725-357622a01caf admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:06.419463 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-148526ac-7e26-4cc8-9d67-27e2c190aa3d None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:06.423423 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-148526ac-7e26-4cc8-9d67-27e2c190aa3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:06.435089 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4fe687-fe45-4bdb-a725-357622a01caf admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:06.582410 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 967/1932] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:06.583366 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148526ac-7e26-4cc8-9d67-27e2c190aa3d None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:06.595201 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148526ac-7e26-4cc8-9d67-27e2c190aa3d None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:06.617980 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2120f-fcd7-4524-841a-1169d8e4ef2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:06.619582 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2120f-fcd7-4524-841a-1169d8e4ef2c admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:06.620077 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2120f-fcd7-4524-841a-1169d8e4ef2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:06.620563 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2120f-fcd7-4524-841a-1169d8e4ef2c admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:06.621521 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2120f-fcd7-4524-841a-1169d8e4ef2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:06.623893 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2120f-fcd7-4524-841a-1169d8e4ef2c admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:06.656610 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:06.672999 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 968/1933] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:22:06 2022] POST /identity/v3/projects => generated 379 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:06.674341 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2120f-fcd7-4524-841a-1169d8e4ef2c admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:06.683318 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ccf2120f-fcd7-4524-841a-1169d8e4ef2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:06.716507 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf70dc-caa7-4868-8890-7261c976c762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:06.719735 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf70dc-caa7-4868-8890-7261c976c762 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:06.720289 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf70dc-caa7-4868-8890-7261c976c762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:06.720658 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf70dc-caa7-4868-8890-7261c976c762 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:06.721459 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf70dc-caa7-4868-8890-7261c976c762 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:06.726709 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf70dc-caa7-4868-8890-7261c976c762 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:06.791904 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 966/1934] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:22:06 2022] POST /identity/v3/users => generated 282 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:06.793585 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf70dc-caa7-4868-8890-7261c976c762 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:06.810382 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf70dc-caa7-4868-8890-7261c976c762 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:06.856305 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2120f-fcd7-4524-841a-1169d8e4ef2c admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:06.876868 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02868950-cfd7-4ca2-9d00-0cbe7b5724b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:06.878413 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02868950-cfd7-4ca2-9d00-0cbe7b5724b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:06.878877 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02868950-cfd7-4ca2-9d00-0cbe7b5724b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:06.879367 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02868950-cfd7-4ca2-9d00-0cbe7b5724b9 admin admin] PATH_INFO: `/v3/projects/140a00f65a874c07929fb5ce07025b7a` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:06.891127 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02868950-cfd7-4ca2-9d00-0cbe7b5724b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=140a00f65a874c07929fb5ce07025b7a)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:06.893284 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02868950-cfd7-4ca2-9d00-0cbe7b5724b9 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:06.977182 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:07.027134 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b4ed5-417c-4862-9060-391fc8c76def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:07.029177 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b4ed5-417c-4862-9060-391fc8c76def admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:07.030430 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b4ed5-417c-4862-9060-391fc8c76def admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:07.032193 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b4ed5-417c-4862-9060-391fc8c76def admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:07.033992 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b4ed5-417c-4862-9060-391fc8c76def admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:22:07.034738 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b4ed5-417c-4862-9060-391fc8c76def admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:07.037687 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b4ed5-417c-4862-9060-391fc8c76def admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:07.054162 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-02868950-cfd7-4ca2-9d00-0cbe7b5724b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '140a00f65a874c07929fb5ce07025b7a', 'request_id': 'req-02868950-cfd7-4ca2-9d00-0cbe7b5724b9'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:07.065609 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-02868950-cfd7-4ca2-9d00-0cbe7b5724b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '140a00f65a874c07929fb5ce07025b7a', 'request_id': 'req-02868950-cfd7-4ca2-9d00-0cbe7b5724b9'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:07.076502 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-02868950-cfd7-4ca2-9d00-0cbe7b5724b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '140a00f65a874c07929fb5ce07025b7a', 'request_id': 'req-02868950-cfd7-4ca2-9d00-0cbe7b5724b9'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:07.084012 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 967/1935] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:22:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:22:07.084012 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b4ed5-417c-4862-9060-391fc8c76def admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:07.105542 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-02868950-cfd7-4ca2-9d00-0cbe7b5724b9 admin admin] The token cache is being invalidate because project 140a00f65a874c07929fb5ce07025b7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:22:07.105654 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-02868950-cfd7-4ca2-9d00-0cbe7b5724b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:07.106630 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-02868950-cfd7-4ca2-9d00-0cbe7b5724b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:07.110672 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 969/1936] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:22:06 2022] DELETE /identity/v3/projects/140a00f65a874c07929fb5ce07025b7a => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:07.112205 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02868950-cfd7-4ca2-9d00-0cbe7b5724b9 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:07.114847 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-02868950-cfd7-4ca2-9d00-0cbe7b5724b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:07.127133 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b4ed5-417c-4862-9060-391fc8c76def admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:07.265761 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad06ded-5b69-46a2-a102-130d4d7082c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:07.266813 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad06ded-5b69-46a2-a102-130d4d7082c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:07.266813 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad06ded-5b69-46a2-a102-130d4d7082c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:07.268213 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad06ded-5b69-46a2-a102-130d4d7082c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:07.268213 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad06ded-5b69-46a2-a102-130d4d7082c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:07.270089 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad06ded-5b69-46a2-a102-130d4d7082c6 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:07.276017 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02868950-cfd7-4ca2-9d00-0cbe7b5724b9 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:07.284205 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe3d3c5-9d93-4057-9a4c-81b698b27a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:07.285299 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3d3c5-9d93-4057-9a4c-81b698b27a4b admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:07.285676 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3d3c5-9d93-4057-9a4c-81b698b27a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:07.286144 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3d3c5-9d93-4057-9a4c-81b698b27a4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:07.286851 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe3d3c5-9d93-4057-9a4c-81b698b27a4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:07.289317 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe3d3c5-9d93-4057-9a4c-81b698b27a4b admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:07.306788 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 970/1937] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:07.307925 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe3d3c5-9d93-4057-9a4c-81b698b27a4b admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:07.309288 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 968/1938] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:22:07 2022] POST /identity/v3/users => generated 290 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:07.310424 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-1fe3d3c5-9d93-4057-9a4c-81b698b27a4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:07.310809 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad06ded-5b69-46a2-a102-130d4d7082c6 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:07.313480 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7ad06ded-5b69-46a2-a102-130d4d7082c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:07.333591 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe3d3c5-9d93-4057-9a4c-81b698b27a4b admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:07.337543 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad06ded-5b69-46a2-a102-130d4d7082c6 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:07.342132 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af80e12-ec5a-4655-ae5d-e41702da67a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:07.343231 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af80e12-ec5a-4655-ae5d-e41702da67a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:07.343586 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af80e12-ec5a-4655-ae5d-e41702da67a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:07.343927 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af80e12-ec5a-4655-ae5d-e41702da67a8 admin admin] PATH_INFO: `/v3/projects/ef8354773f504569b8efc5c79c53fdd9` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:07.345528 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af80e12-ec5a-4655-ae5d-e41702da67a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef8354773f504569b8efc5c79c53fdd9)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:07.346615 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09921c3-3488-461b-be04-6ec2d17fb59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:07.347802 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09921c3-3488-461b-be04-6ec2d17fb59e admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:07.348391 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09921c3-3488-461b-be04-6ec2d17fb59e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:07.350026 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af80e12-ec5a-4655-ae5d-e41702da67a8 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:07.374341 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09921c3-3488-461b-be04-6ec2d17fb59e admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:07.375734 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09921c3-3488-461b-be04-6ec2d17fb59e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:07.387652 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09921c3-3488-461b-be04-6ec2d17fb59e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:07.448311 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 969/1939] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:22:07 2022] POST /identity/v3/projects => generated 391 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:07.450363 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae7abc-3824-4589-a507-394c114de4e5 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:07.450656 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae7abc-3824-4589-a507-394c114de4e5 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:07.450977 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae7abc-3824-4589-a507-394c114de4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:07.454317 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-6af80e12-ec5a-4655-ae5d-e41702da67a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef8354773f504569b8efc5c79c53fdd9', 'request_id': 'req-6af80e12-ec5a-4655-ae5d-e41702da67a8'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:07.462614 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-6af80e12-ec5a-4655-ae5d-e41702da67a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef8354773f504569b8efc5c79c53fdd9', 'request_id': 'req-6af80e12-ec5a-4655-ae5d-e41702da67a8'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:07.473303 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-6af80e12-ec5a-4655-ae5d-e41702da67a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef8354773f504569b8efc5c79c53fdd9', 'request_id': 'req-6af80e12-ec5a-4655-ae5d-e41702da67a8'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:07.484430 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-ddae7abc-3824-4589-a507-394c114de4e5 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:07.486323 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ddae7abc-3824-4589-a507-394c114de4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:07.491355 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-6af80e12-ec5a-4655-ae5d-e41702da67a8 admin admin] The token cache is being invalidate because project ef8354773f504569b8efc5c79c53fdd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:22:07.491651 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-6af80e12-ec5a-4655-ae5d-e41702da67a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:07.492501 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-6af80e12-ec5a-4655-ae5d-e41702da67a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:07.495144 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 971/1940] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:22:07 2022] DELETE /identity/v3/projects/ef8354773f504569b8efc5c79c53fdd9 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:07.496214 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af80e12-ec5a-4655-ae5d-e41702da67a8 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:07.498727 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-6af80e12-ec5a-4655-ae5d-e41702da67a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:07.546196 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:07.567516 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:07.635287 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 970/1941] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:07.637095 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae7abc-3824-4589-a507-394c114de4e5 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:07.639546 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ddae7abc-3824-4589-a507-394c114de4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:07.654230 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af80e12-ec5a-4655-ae5d-e41702da67a8 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:07.658093 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae7abc-3824-4589-a507-394c114de4e5 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:07.664815 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61110147-945d-4613-b4b2-05fe82410f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:07.665504 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf91e9c-d450-4121-a245-1baea7410349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:07.666031 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61110147-945d-4613-b4b2-05fe82410f37 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:07.666380 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61110147-945d-4613-b4b2-05fe82410f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:07.666713 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61110147-945d-4613-b4b2-05fe82410f37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:07.666855 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf91e9c-d450-4121-a245-1baea7410349 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:07.667125 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf91e9c-d450-4121-a245-1baea7410349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:07.667415 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf91e9c-d450-4121-a245-1baea7410349 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:07.668277 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61110147-945d-4613-b4b2-05fe82410f37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:07.668615 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf91e9c-d450-4121-a245-1baea7410349 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:07.671877 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf91e9c-d450-4121-a245-1baea7410349 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:07.672505 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61110147-945d-4613-b4b2-05fe82410f37 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:07.689908 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 972/1942] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:07.691070 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61110147-945d-4613-b4b2-05fe82410f37 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:07.691504 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 971/1943] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:07.696845 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-61110147-945d-4613-b4b2-05fe82410f37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:07.697551 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e42c1-ff6e-4e94-997f-386e8fa1f3fb None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:07.697961 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e42c1-ff6e-4e94-997f-386e8fa1f3fb None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:07.698492 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e42c1-ff6e-4e94-997f-386e8fa1f3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:07.712597 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61110147-945d-4613-b4b2-05fe82410f37 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:07.720971 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717879c7-735f-49ed-82d4-7a4f1ac3cda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:07.721886 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717879c7-735f-49ed-82d4-7a4f1ac3cda2 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:07.722367 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717879c7-735f-49ed-82d4-7a4f1ac3cda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:07.723076 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717879c7-735f-49ed-82d4-7a4f1ac3cda2 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:07.724645 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717879c7-735f-49ed-82d4-7a4f1ac3cda2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:07.724949 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-d86e42c1-ff6e-4e94-997f-386e8fa1f3fb None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:07.726671 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d86e42c1-ff6e-4e94-997f-386e8fa1f3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:07.727082 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717879c7-735f-49ed-82d4-7a4f1ac3cda2 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:07.744510 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 972/1944] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:07.746134 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0318539-e0ac-40a7-9d7c-a9d09ed9f099 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:07.746736 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0318539-e0ac-40a7-9d7c-a9d09ed9f099 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:07.747194 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0318539-e0ac-40a7-9d7c-a9d09ed9f099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:07.778313 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 973/1945] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:22:07 2022] POST /identity/v3/users => generated 296 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:07.779836 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717879c7-735f-49ed-82d4-7a4f1ac3cda2 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:07.781739 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e0318539-e0ac-40a7-9d7c-a9d09ed9f099 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:07.784010 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e0318539-e0ac-40a7-9d7c-a9d09ed9f099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:07.800498 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 973/1946] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:07.801420 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717879c7-735f-49ed-82d4-7a4f1ac3cda2 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:07.802205 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0318539-e0ac-40a7-9d7c-a9d09ed9f099 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:07.811202 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d20cb4-0bc3-4ee4-8b5d-0c7556620be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:07.813317 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d20cb4-0bc3-4ee4-8b5d-0c7556620be3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:07.814512 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d20cb4-0bc3-4ee4-8b5d-0c7556620be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:07.815271 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d20cb4-0bc3-4ee4-8b5d-0c7556620be3 admin admin] PATH_INFO: `/v3/projects/45de89ebd84b45198bf435fec8a14929/users/057ec8f0bc2b49baae1712529224893c/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:07.831883 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0318539-e0ac-40a7-9d7c-a9d09ed9f099 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:07.843233 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcdd792-6461-4648-87de-9be9867e6132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:07.844476 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcdd792-6461-4648-87de-9be9867e6132 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:07.845574 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcdd792-6461-4648-87de-9be9867e6132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:07.845574 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcdd792-6461-4648-87de-9be9867e6132 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:07.847071 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcdd792-6461-4648-87de-9be9867e6132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:07.849737 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcdd792-6461-4648-87de-9be9867e6132 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:07.853615 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d20cb4-0bc3-4ee4-8b5d-0c7556620be3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45de89ebd84b45198bf435fec8a14929, user_id=057ec8f0bc2b49baae1712529224893c, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:07.859242 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d20cb4-0bc3-4ee4-8b5d-0c7556620be3 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:07.872106 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 974/1947] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:07.876710 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e105822-ddf1-4c31-a123-96d4e3e0c57b None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:07.876996 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e105822-ddf1-4c31-a123-96d4e3e0c57b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:07.877268 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e105822-ddf1-4c31-a123-96d4e3e0c57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:07.886326 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 974/1948] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:22:07 2022] PUT /identity/v3/projects/45de89ebd84b45198bf435fec8a14929/users/057ec8f0bc2b49baae1712529224893c/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:07.887591 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d20cb4-0bc3-4ee4-8b5d-0c7556620be3 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:07.912345 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-2e105822-ddf1-4c31-a123-96d4e3e0c57b None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:07.914731 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2e105822-ddf1-4c31-a123-96d4e3e0c57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:08.026861 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d20cb4-0bc3-4ee4-8b5d-0c7556620be3 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:08.047095 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 975/1949] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:08.047758 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ff686-abeb-445f-8312-7052cc074754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:08.048635 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ff686-abeb-445f-8312-7052cc074754 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:08.048907 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ff686-abeb-445f-8312-7052cc074754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:08.049247 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ff686-abeb-445f-8312-7052cc074754 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:08.050127 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ff686-abeb-445f-8312-7052cc074754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:08.050686 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e105822-ddf1-4c31-a123-96d4e3e0c57b None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:08.055842 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ff686-abeb-445f-8312-7052cc074754 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:08.069010 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e105822-ddf1-4c31-a123-96d4e3e0c57b None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:08.081947 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 975/1950] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:08.081947 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ff686-abeb-445f-8312-7052cc074754 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:08.095206 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c8213-e893-4272-ab75-b7c748c11c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:08.097222 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c8213-e893-4272-ab75-b7c748c11c34 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:08.097575 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c8213-e893-4272-ab75-b7c748c11c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:08.097789 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c8213-e893-4272-ab75-b7c748c11c34 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:08.098575 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c8213-e893-4272-ab75-b7c748c11c34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:22:08.098885 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c8213-e893-4272-ab75-b7c748c11c34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:08.103519 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ff686-abeb-445f-8312-7052cc074754 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:08.105583 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c8213-e893-4272-ab75-b7c748c11c34 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:08.131699 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75940ab1-fb16-440a-a854-304eaffb6bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:08.133076 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75940ab1-fb16-440a-a854-304eaffb6bf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:08.133583 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75940ab1-fb16-440a-a854-304eaffb6bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:08.134111 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75940ab1-fb16-440a-a854-304eaffb6bf0 admin admin] PATH_INFO: `/v3/projects/ed2727baa5ab4eee954b96b1f69d6355/users/1d0f64bc1ec24fab890e4bbd0e4aac55/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:08.152649 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 976/1951] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:22:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:22:08.161301 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb473b2-e024-449f-a105-9c4dae888594 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:08.162671 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb473b2-e024-449f-a105-9c4dae888594 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:08.164949 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb473b2-e024-449f-a105-9c4dae888594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:08.191843 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75940ab1-fb16-440a-a854-304eaffb6bf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed2727baa5ab4eee954b96b1f69d6355, user_id=1d0f64bc1ec24fab890e4bbd0e4aac55, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:08.198637 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75940ab1-fb16-440a-a854-304eaffb6bf0 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:08.224353 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-0fb473b2-e024-449f-a105-9c4dae888594 None None] MFA Rules not processed for user `057ec8f0bc2b49baae1712529224893c`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:08.224679 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 976/1952] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:22:08 2022] PUT /identity/v3/projects/ed2727baa5ab4eee954b96b1f69d6355/users/1d0f64bc1ec24fab890e4bbd0e4aac55/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:08.227374 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0fb473b2-e024-449f-a105-9c4dae888594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:08.235368 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75940ab1-fb16-440a-a854-304eaffb6bf0 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:08.388477 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 977/1953] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:08 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:08.389091 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb473b2-e024-449f-a105-9c4dae888594 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:08.421121 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:08.458670 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:08.464689 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75940ab1-fb16-440a-a854-304eaffb6bf0 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:08.481772 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1c64b1-3954-450f-854b-c22f8bb82bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:08.482486 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c64b1-3954-450f-854b-c22f8bb82bea admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:08.482932 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c64b1-3954-450f-854b-c22f8bb82bea admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:08.483253 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c64b1-3954-450f-854b-c22f8bb82bea admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:08.484070 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1c64b1-3954-450f-854b-c22f8bb82bea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:22:08.484380 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1c64b1-3954-450f-854b-c22f8bb82bea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:08.489577 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1c64b1-3954-450f-854b-c22f8bb82bea admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:08.516737 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 977/1954] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:22:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:22:08.517743 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1c64b1-3954-450f-854b-c22f8bb82bea admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:08.530667 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1c64b1-3954-450f-854b-c22f8bb82bea admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:08.536666 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd1134-0524-4509-95a3-2d2df160d0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:08.538217 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd1134-0524-4509-95a3-2d2df160d0f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:08.538987 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd1134-0524-4509-95a3-2d2df160d0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:08.539407 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd1134-0524-4509-95a3-2d2df160d0f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:08.540632 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd1134-0524-4509-95a3-2d2df160d0f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:08.543211 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd1134-0524-4509-95a3-2d2df160d0f8 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:08.571044 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb473b2-e024-449f-a105-9c4dae888594 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:08.584034 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca68b7-d2f6-43bf-a1dc-46631a5d9c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:08.585231 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca68b7-d2f6-43bf-a1dc-46631a5d9c59 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:08.585542 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca68b7-d2f6-43bf-a1dc-46631a5d9c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:08.585972 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca68b7-d2f6-43bf-a1dc-46631a5d9c59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:08.590304 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ca68b7-d2f6-43bf-a1dc-46631a5d9c59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:08.594450 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ca68b7-d2f6-43bf-a1dc-46631a5d9c59 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:08.607075 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 978/1955] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:22:08 2022] POST /identity/v3/projects => generated 387 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:08.609803 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0498a7-3e40-4d95-bcac-5f9cbf8ed098 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:08.610287 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0498a7-3e40-4d95-bcac-5f9cbf8ed098 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:08.611290 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0498a7-3e40-4d95-bcac-5f9cbf8ed098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:08.620899 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 978/1956] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:08 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:08.620899 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca68b7-d2f6-43bf-a1dc-46631a5d9c59 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:08.637460 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca68b7-d2f6-43bf-a1dc-46631a5d9c59 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:08.672661 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-8a0498a7-3e40-4d95-bcac-5f9cbf8ed098 None None] MFA Rules not processed for user `1d0f64bc1ec24fab890e4bbd0e4aac55`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:08.674024 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-8a0498a7-3e40-4d95-bcac-5f9cbf8ed098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:08.812442 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd19925-0168-4ba5-b1a4-0792e8d5d0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:08.813247 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd19925-0168-4ba5-b1a4-0792e8d5d0eb admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:08.814094 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd19925-0168-4ba5-b1a4-0792e8d5d0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:08.814346 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd19925-0168-4ba5-b1a4-0792e8d5d0eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:08.815240 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd19925-0168-4ba5-b1a4-0792e8d5d0eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:08.817980 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd19925-0168-4ba5-b1a4-0792e8d5d0eb admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:08.833223 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 979/1957] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:08.834655 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0498a7-3e40-4d95-bcac-5f9cbf8ed098 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:08.863148 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 979/1958] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:22:08 2022] POST /identity/v3/projects => generated 365 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:08.864864 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd19925-0168-4ba5-b1a4-0792e8d5d0eb admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:08.872723 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0498a7-3e40-4d95-bcac-5f9cbf8ed098 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:08.956571 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd19925-0168-4ba5-b1a4-0792e8d5d0eb admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:08.964503 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e920e0f-d5dc-4cd9-b9ae-07893c35f83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:08.966233 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e920e0f-d5dc-4cd9-b9ae-07893c35f83d admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:08.966743 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e920e0f-d5dc-4cd9-b9ae-07893c35f83d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:08.967626 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e920e0f-d5dc-4cd9-b9ae-07893c35f83d admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:08.968716 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e920e0f-d5dc-4cd9-b9ae-07893c35f83d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:08.971354 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e920e0f-d5dc-4cd9-b9ae-07893c35f83d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:09.008238 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 980/1959] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:22:08 2022] POST /identity/v3/users => generated 294 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:09.013158 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e920e0f-d5dc-4cd9-b9ae-07893c35f83d admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:09.027630 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e920e0f-d5dc-4cd9-b9ae-07893c35f83d admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:09.048821 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b16978d-94d6-4ae8-aa93-b00ea8fc78fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:09.049128 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51755b0c-1741-4deb-b362-8d27e283a9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:09.050290 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51755b0c-1741-4deb-b362-8d27e283a9c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:09.050737 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51755b0c-1741-4deb-b362-8d27e283a9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:09.051386 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51755b0c-1741-4deb-b362-8d27e283a9c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:09.052561 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51755b0c-1741-4deb-b362-8d27e283a9c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:09.053639 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16978d-94d6-4ae8-aa93-b00ea8fc78fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:09.054139 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16978d-94d6-4ae8-aa93-b00ea8fc78fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:09.054439 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16978d-94d6-4ae8-aa93-b00ea8fc78fe admin admin] PATH_INFO: `/v3/projects/dc9f9df47ba643078bdac3c1d2d1b1d1/users/283328bb73fa4a658530d0f24579cd6e/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:09.059543 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51755b0c-1741-4deb-b362-8d27e283a9c5 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:09.078225 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b16978d-94d6-4ae8-aa93-b00ea8fc78fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc9f9df47ba643078bdac3c1d2d1b1d1, user_id=283328bb73fa4a658530d0f24579cd6e, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:09.081447 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b16978d-94d6-4ae8-aa93-b00ea8fc78fe admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:09.117947 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 980/1961] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:22:08 2022] POST /identity/v3/projects => generated 385 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:09.119681 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51755b0c-1741-4deb-b362-8d27e283a9c5 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:09.121571 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 981/1961] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:22:09 2022] PUT /identity/v3/projects/dc9f9df47ba643078bdac3c1d2d1b1d1/users/283328bb73fa4a658530d0f24579cd6e/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:09.124597 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b16978d-94d6-4ae8-aa93-b00ea8fc78fe admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:09.140273 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:09.231890 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:09.274576 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b16978d-94d6-4ae8-aa93-b00ea8fc78fe admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:09.296388 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51755b0c-1741-4deb-b362-8d27e283a9c5 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:09.309973 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a018f-7eba-45b5-973b-43618546fd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:09.311298 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a018f-7eba-45b5-973b-43618546fd1b admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:09.311810 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a018f-7eba-45b5-973b-43618546fd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:09.312331 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a018f-7eba-45b5-973b-43618546fd1b admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:09.315115 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0a018f-7eba-45b5-973b-43618546fd1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:09.318696 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0a018f-7eba-45b5-973b-43618546fd1b admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:09.361600 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 981/1962] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:22:09 2022] POST /identity/v3/projects => generated 379 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:09.363068 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a018f-7eba-45b5-973b-43618546fd1b admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:09.383022 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac2081-edcd-44e9-a94c-7109b44b39ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:09.383965 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac2081-edcd-44e9-a94c-7109b44b39ae admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:09.384368 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac2081-edcd-44e9-a94c-7109b44b39ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:09.384997 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac2081-edcd-44e9-a94c-7109b44b39ae admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:09.386658 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dac2081-edcd-44e9-a94c-7109b44b39ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:09.391215 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dac2081-edcd-44e9-a94c-7109b44b39ae admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:09.431707 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 982/1963] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:22:09 2022] POST /identity/v3/users => generated 289 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:09.441539 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac2081-edcd-44e9-a94c-7109b44b39ae admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:09.459589 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac2081-edcd-44e9-a94c-7109b44b39ae admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:09.496809 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a018f-7eba-45b5-973b-43618546fd1b admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:09.503772 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ca342-f45b-4c06-8c30-863d483b7460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:09.504856 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ca342-f45b-4c06-8c30-863d483b7460 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:09.505505 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ca342-f45b-4c06-8c30-863d483b7460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:09.506061 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ca342-f45b-4c06-8c30-863d483b7460 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:09.508218 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941ca342-f45b-4c06-8c30-863d483b7460 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:09.510246 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941ca342-f45b-4c06-8c30-863d483b7460 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:09.522006 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 982/1964] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:09 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:09.526335 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeee2d6-e466-4729-b82a-9e3f040a8bba None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:09.526608 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeee2d6-e466-4729-b82a-9e3f040a8bba None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:09.527034 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeee2d6-e466-4729-b82a-9e3f040a8bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:09.541415 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd6a0c-6951-4b20-9571-df9de2ce5eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:09.541933 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd6a0c-6951-4b20-9571-df9de2ce5eb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:09.542218 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd6a0c-6951-4b20-9571-df9de2ce5eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:09.542497 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd6a0c-6951-4b20-9571-df9de2ce5eb7 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:09.543224 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bd6a0c-6951-4b20-9571-df9de2ce5eb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:09.545333 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bd6a0c-6951-4b20-9571-df9de2ce5eb7 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:09.562429 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-eaeee2d6-e466-4729-b82a-9e3f040a8bba None None] MFA Rules not processed for user `283328bb73fa4a658530d0f24579cd6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:09.564103 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-eaeee2d6-e466-4729-b82a-9e3f040a8bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:09.576034 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 983/1965] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:22:09 2022] POST /identity/v3/users => generated 293 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:09.576034 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd6a0c-6951-4b20-9571-df9de2ce5eb7 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:09.586829 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd6a0c-6951-4b20-9571-df9de2ce5eb7 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:09.592223 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd39d06-7b4b-49c9-ae88-ee418f6c2a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:09.593024 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd39d06-7b4b-49c9-ae88-ee418f6c2a49 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:09.593435 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd39d06-7b4b-49c9-ae88-ee418f6c2a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:09.593808 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd39d06-7b4b-49c9-ae88-ee418f6c2a49 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:09.594639 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd39d06-7b4b-49c9-ae88-ee418f6c2a49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:09.596787 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd39d06-7b4b-49c9-ae88-ee418f6c2a49 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:09.628943 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 984/1966] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:22:09 2022] POST /identity/v3/users => generated 296 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:09.628943 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd39d06-7b4b-49c9-ae88-ee418f6c2a49 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:09.642335 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd39d06-7b4b-49c9-ae88-ee418f6c2a49 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:09.648327 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b0632-5a7b-40c8-a76b-d3abb0810804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:09.649481 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b0632-5a7b-40c8-a76b-d3abb0810804 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:09.649819 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b0632-5a7b-40c8-a76b-d3abb0810804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:09.650088 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b0632-5a7b-40c8-a76b-d3abb0810804 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:09.651056 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981b0632-5a7b-40c8-a76b-d3abb0810804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:09.652783 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981b0632-5a7b-40c8-a76b-d3abb0810804 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:09.664530 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 983/1967] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:09.665220 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeee2d6-e466-4729-b82a-9e3f040a8bba None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:09.669728 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 985/1968] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:09.670905 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b0632-5a7b-40c8-a76b-d3abb0810804 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:09.677231 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeee2d6-e466-4729-b82a-9e3f040a8bba None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:09.677465 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:09.685677 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b0632-5a7b-40c8-a76b-d3abb0810804 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:09.687103 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc3422-5bcb-481a-8057-316c96769d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:09.687803 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc3422-5bcb-481a-8057-316c96769d66 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:09.688086 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc3422-5bcb-481a-8057-316c96769d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:09.688362 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc3422-5bcb-481a-8057-316c96769d66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:09.689513 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fc3422-5bcb-481a-8057-316c96769d66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:09.691204 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fc3422-5bcb-481a-8057-316c96769d66 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:09.698780 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3951b201-b132-4e25-b3b8-c0aea5b73f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:09.699391 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951b201-b132-4e25-b3b8-c0aea5b73f05 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:09.699677 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951b201-b132-4e25-b3b8-c0aea5b73f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:09.699954 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951b201-b132-4e25-b3b8-c0aea5b73f05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:09.700697 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3951b201-b132-4e25-b3b8-c0aea5b73f05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:09.702355 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3951b201-b132-4e25-b3b8-c0aea5b73f05 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:09.706705 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 984/1969] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:09 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:09.707744 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc3422-5bcb-481a-8057-316c96769d66 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:09.723130 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc3422-5bcb-481a-8057-316c96769d66 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:09.725342 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 986/1970] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:09 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:09.729445 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2421e-756d-4089-abde-b5cecd77f8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:09.730712 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2421e-756d-4089-abde-b5cecd77f8aa admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:09.730830 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3951b201-b132-4e25-b3b8-c0aea5b73f05 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:09.731234 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2421e-756d-4089-abde-b5cecd77f8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:09.731741 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2421e-756d-4089-abde-b5cecd77f8aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:09.732942 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd2421e-756d-4089-abde-b5cecd77f8aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:09.734832 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd2421e-756d-4089-abde-b5cecd77f8aa admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:09.747145 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3951b201-b132-4e25-b3b8-c0aea5b73f05 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:09.747844 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 985/1971] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:09 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:09.748925 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2421e-756d-4089-abde-b5cecd77f8aa admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:09.754934 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9700027-ecce-462a-b0f1-37fd6edd0c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:09.756106 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9700027-ecce-462a-b0f1-37fd6edd0c05 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:09.756580 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9700027-ecce-462a-b0f1-37fd6edd0c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:09.757049 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9700027-ecce-462a-b0f1-37fd6edd0c05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:09.758363 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9700027-ecce-462a-b0f1-37fd6edd0c05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:09.761210 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2421e-756d-4089-abde-b5cecd77f8aa admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:09.762222 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9700027-ecce-462a-b0f1-37fd6edd0c05 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:09.767077 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a731e-9b43-4650-8e10-b69f73cecc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:09.768188 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a731e-9b43-4650-8e10-b69f73cecc2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:09.768467 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a731e-9b43-4650-8e10-b69f73cecc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:09.768991 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a731e-9b43-4650-8e10-b69f73cecc2d admin admin] PATH_INFO: `/v3/projects/0c4f6e54262d4e34bf6cdd82d4c78e7d/users/4460aea155134815b328f6f93ff4cd75/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:09.785852 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6a731e-9b43-4650-8e10-b69f73cecc2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c4f6e54262d4e34bf6cdd82d4c78e7d, user_id=4460aea155134815b328f6f93ff4cd75, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:09.789433 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6a731e-9b43-4650-8e10-b69f73cecc2d admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:09.801594 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:09.807395 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 986/1972] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:22:09 2022] PUT /identity/v3/projects/0c4f6e54262d4e34bf6cdd82d4c78e7d/users/4460aea155134815b328f6f93ff4cd75/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:09.811613 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a731e-9b43-4650-8e10-b69f73cecc2d admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:09.813346 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 987/1973] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:22:09 2022] POST /identity/v3/projects => generated 393 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:09.815278 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9700027-ecce-462a-b0f1-37fd6edd0c05 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:09.921212 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a731e-9b43-4650-8e10-b69f73cecc2d admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:09.986207 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9700027-ecce-462a-b0f1-37fd6edd0c05 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:09.998761 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85725362-f383-4b19-b967-28d525cf6129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:09.999471 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85725362-f383-4b19-b967-28d525cf6129 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:09.999760 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85725362-f383-4b19-b967-28d525cf6129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:10.000033 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85725362-f383-4b19-b967-28d525cf6129 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:10.001298 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85725362-f383-4b19-b967-28d525cf6129 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:10.005628 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85725362-f383-4b19-b967-28d525cf6129 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:10.020897 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 988/1974] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:09 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:10.024776 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85725362-f383-4b19-b967-28d525cf6129 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:10.031248 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5878d-7f9f-4aaf-9c7a-e7e76448779f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:10.032174 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5878d-7f9f-4aaf-9c7a-e7e76448779f admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:10.032642 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5878d-7f9f-4aaf-9c7a-e7e76448779f admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:10.032923 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5878d-7f9f-4aaf-9c7a-e7e76448779f admin admin] PATH_INFO: `/v3/projects/7fd5624ed6334a698cf4986ae6eab851/users/cba1c62d1a1c494e9ab02bec3372f144/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:10.041476 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85725362-f383-4b19-b967-28d525cf6129 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:10.047423 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a87a88-324f-406f-abca-09c794b8c80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:10.049621 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a87a88-324f-406f-abca-09c794b8c80e admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:10.050028 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a87a88-324f-406f-abca-09c794b8c80e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:10.050391 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a87a88-324f-406f-abca-09c794b8c80e admin admin] PATH_INFO: `/v3/projects/49c9977d02a54f27bf8b3a689573821b/users/ae37761df5794ec9b8ccf51bc28ec587/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:10.074047 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb5878d-7f9f-4aaf-9c7a-e7e76448779f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fd5624ed6334a698cf4986ae6eab851, user_id=cba1c62d1a1c494e9ab02bec3372f144, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:10.076484 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb5878d-7f9f-4aaf-9c7a-e7e76448779f admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:10.083949 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a87a88-324f-406f-abca-09c794b8c80e admin admin] RBAC: Authorizing `identity:create_grant(project_id=49c9977d02a54f27bf8b3a689573821b, user_id=ae37761df5794ec9b8ccf51bc28ec587, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:10.088239 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a87a88-324f-406f-abca-09c794b8c80e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:10.096760 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 987/1975] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:22:09 2022] PUT /identity/v3/projects/7fd5624ed6334a698cf4986ae6eab851/users/cba1c62d1a1c494e9ab02bec3372f144/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:10.097861 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5878d-7f9f-4aaf-9c7a-e7e76448779f admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:10.118411 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 989/1976] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:22:10 2022] PUT /identity/v3/projects/49c9977d02a54f27bf8b3a689573821b/users/ae37761df5794ec9b8ccf51bc28ec587/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:10.122757 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a87a88-324f-406f-abca-09c794b8c80e admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:10.222294 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a87a88-324f-406f-abca-09c794b8c80e admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:10.228702 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1787397-1140-49d3-9930-6abd6c85f5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:10.230079 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1787397-1140-49d3-9930-6abd6c85f5da admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:10.230079 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1787397-1140-49d3-9930-6abd6c85f5da admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:10.230079 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1787397-1140-49d3-9930-6abd6c85f5da admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:10.230710 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1787397-1140-49d3-9930-6abd6c85f5da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:10.232840 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1787397-1140-49d3-9930-6abd6c85f5da admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:10.249783 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5878d-7f9f-4aaf-9c7a-e7e76448779f admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:10.258141 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71255a-21a4-4a90-9644-b3b87ac415b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:10.259552 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71255a-21a4-4a90-9644-b3b87ac415b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:10.260042 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71255a-21a4-4a90-9644-b3b87ac415b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:10.260329 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71255a-21a4-4a90-9644-b3b87ac415b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:10.261313 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad71255a-21a4-4a90-9644-b3b87ac415b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:10.263668 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad71255a-21a4-4a90-9644-b3b87ac415b1 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:10.289901 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 988/1977] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:10.293092 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71255a-21a4-4a90-9644-b3b87ac415b1 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:10.298409 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 990/1978] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:22:10 2022] POST /identity/v3/users => generated 303 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:10.316964 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71255a-21a4-4a90-9644-b3b87ac415b1 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:10.317740 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3cf9b-d3df-43aa-98e1-75a6b0c7cda1 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:10.319649 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3cf9b-d3df-43aa-98e1-75a6b0c7cda1 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:10.320202 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3cf9b-d3df-43aa-98e1-75a6b0c7cda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:10.324200 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041b62ee-cb96-45a7-a287-84a596ff01d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:10.326219 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b62ee-cb96-45a7-a287-84a596ff01d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:10.326733 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b62ee-cb96-45a7-a287-84a596ff01d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:10.327400 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b62ee-cb96-45a7-a287-84a596ff01d7 admin admin] PATH_INFO: `/v3/projects/82950ad561d040a3a4d039897b37e7bc/users/5732ea8b241648f4a96dc75a9d5e7e8d/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:10.375066 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041b62ee-cb96-45a7-a287-84a596ff01d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82950ad561d040a3a4d039897b37e7bc, user_id=5732ea8b241648f4a96dc75a9d5e7e8d, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:10.376861 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-1bc3cf9b-d3df-43aa-98e1-75a6b0c7cda1 None None] MFA Rules not processed for user `cba1c62d1a1c494e9ab02bec3372f144`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:10.378178 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041b62ee-cb96-45a7-a287-84a596ff01d7 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:10.378329 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1bc3cf9b-d3df-43aa-98e1-75a6b0c7cda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:10.401454 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 989/1979] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:22:10 2022] PUT /identity/v3/projects/82950ad561d040a3a4d039897b37e7bc/users/5732ea8b241648f4a96dc75a9d5e7e8d/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:10.403542 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041b62ee-cb96-45a7-a287-84a596ff01d7 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:10.411013 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:10.411595 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:10.510339 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 991/1980] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:10.514100 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041b62ee-cb96-45a7-a287-84a596ff01d7 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:10.514213 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc3cf9b-d3df-43aa-98e1-75a6b0c7cda1 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:10.517669 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29179a-6982-4b72-a0d6-b9904c047138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:10.518581 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29179a-6982-4b72-a0d6-b9904c047138 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:10.519160 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29179a-6982-4b72-a0d6-b9904c047138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:10.519689 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29179a-6982-4b72-a0d6-b9904c047138 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:10.520674 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc29179a-6982-4b72-a0d6-b9904c047138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:10.522781 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc29179a-6982-4b72-a0d6-b9904c047138 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:10.537432 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc3cf9b-d3df-43aa-98e1-75a6b0c7cda1 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:10.541008 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 990/1981] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:10.542113 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29179a-6982-4b72-a0d6-b9904c047138 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:10.550551 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6939c3f6-e357-42e1-902e-d31937156868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:10.551487 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939c3f6-e357-42e1-902e-d31937156868 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:10.551773 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939c3f6-e357-42e1-902e-d31937156868 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:10.552127 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939c3f6-e357-42e1-902e-d31937156868 admin admin] PATH_INFO: `/v3/projects/0c4f6e54262d4e34bf6cdd82d4c78e7d/users/4460aea155134815b328f6f93ff4cd75/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:10.555722 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6939c3f6-e357-42e1-902e-d31937156868 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c4f6e54262d4e34bf6cdd82d4c78e7d, user_id=4460aea155134815b328f6f93ff4cd75, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:10.560990 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6939c3f6-e357-42e1-902e-d31937156868 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:10.564891 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29179a-6982-4b72-a0d6-b9904c047138 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:10.582329 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 992/1982] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:22:10 2022] PUT /identity/v3/projects/0c4f6e54262d4e34bf6cdd82d4c78e7d/users/4460aea155134815b328f6f93ff4cd75/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:10.584343 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1815d2-5e96-4ebe-9c64-689d9b221303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:10.585358 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1815d2-5e96-4ebe-9c64-689d9b221303 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:10.585567 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1815d2-5e96-4ebe-9c64-689d9b221303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:10.585860 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1815d2-5e96-4ebe-9c64-689d9b221303 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:10.589019 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1815d2-5e96-4ebe-9c64-689d9b221303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:10.596644 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614506fc-273f-4e3e-b8f0-0b35ebcddf80 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:10.598295 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614506fc-273f-4e3e-b8f0-0b35ebcddf80 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:10.598513 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1815d2-5e96-4ebe-9c64-689d9b221303 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:10.598808 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614506fc-273f-4e3e-b8f0-0b35ebcddf80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:10.612625 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 991/1983] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:10.614026 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1815d2-5e96-4ebe-9c64-689d9b221303 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:10.631003 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1815d2-5e96-4ebe-9c64-689d9b221303 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:10.642221 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-614506fc-273f-4e3e-b8f0-0b35ebcddf80 None None] MFA Rules not processed for user `5732ea8b241648f4a96dc75a9d5e7e8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:10.644259 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-614506fc-273f-4e3e-b8f0-0b35ebcddf80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:10.720530 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d7d86c-e6d0-4c03-b5b7-0d5743442bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:10.721571 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7d86c-e6d0-4c03-b5b7-0d5743442bc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:10.722114 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7d86c-e6d0-4c03-b5b7-0d5743442bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:10.722601 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7d86c-e6d0-4c03-b5b7-0d5743442bc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:10.738467 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d7d86c-e6d0-4c03-b5b7-0d5743442bc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:10.741145 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d7d86c-e6d0-4c03-b5b7-0d5743442bc2 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:10.754051 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 993/1984] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:10.754894 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614506fc-273f-4e3e-b8f0-0b35ebcddf80 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:10.779288 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614506fc-273f-4e3e-b8f0-0b35ebcddf80 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:10.785687 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6592378-8933-402a-80e3-d7f02ed87a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:10.786653 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6592378-8933-402a-80e3-d7f02ed87a41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:10.786937 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6592378-8933-402a-80e3-d7f02ed87a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:10.787288 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6592378-8933-402a-80e3-d7f02ed87a41 admin admin] PATH_INFO: `/v3/projects/49c9977d02a54f27bf8b3a689573821b/users/ae37761df5794ec9b8ccf51bc28ec587/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:10.790016 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6592378-8933-402a-80e3-d7f02ed87a41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49c9977d02a54f27bf8b3a689573821b, user_id=ae37761df5794ec9b8ccf51bc28ec587, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:10.792116 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 992/1985] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:22:10 2022] POST /identity/v3/projects => generated 387 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:10.793833 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6592378-8933-402a-80e3-d7f02ed87a41 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:10.794462 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f31d7-a61a-4b01-a259-153ce85d6185 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:10.794936 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f31d7-a61a-4b01-a259-153ce85d6185 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:10.795418 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f31d7-a61a-4b01-a259-153ce85d6185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:10.811539 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 994/1986] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:22:10 2022] PUT /identity/v3/projects/49c9977d02a54f27bf8b3a689573821b/users/ae37761df5794ec9b8ccf51bc28ec587/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:10.813397 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6592378-8933-402a-80e3-d7f02ed87a41 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:10.855572 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-2c6f31d7-a61a-4b01-a259-153ce85d6185 None None] MFA Rules not processed for user `4460aea155134815b328f6f93ff4cd75`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:10.857165 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-2c6f31d7-a61a-4b01-a259-153ce85d6185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:10.928998 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6592378-8933-402a-80e3-d7f02ed87a41 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:10.936760 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351bad7-a590-42c8-8c54-1bba85f28506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:10.937838 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351bad7-a590-42c8-8c54-1bba85f28506 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:10.938016 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351bad7-a590-42c8-8c54-1bba85f28506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:10.938274 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351bad7-a590-42c8-8c54-1bba85f28506 admin admin] PATH_INFO: `/v3/projects/fcc87990872d47f28c02f684195fce0c/users/5502cff34b1c46788024497e3cfe5972/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:10.966805 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c351bad7-a590-42c8-8c54-1bba85f28506 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcc87990872d47f28c02f684195fce0c, user_id=5502cff34b1c46788024497e3cfe5972, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:10.970010 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c351bad7-a590-42c8-8c54-1bba85f28506 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:10.987172 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:10.993796 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 995/1987] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:22:10 2022] PUT /identity/v3/projects/fcc87990872d47f28c02f684195fce0c/users/5502cff34b1c46788024497e3cfe5972/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:10.995563 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351bad7-a590-42c8-8c54-1bba85f28506 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:11.000190 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c351bad7-a590-42c8-8c54-1bba85f28506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:11.010255 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 993/1988] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:10 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:11.011587 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f31d7-a61a-4b01-a259-153ce85d6185 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:11.018336 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:11.026299 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f31d7-a61a-4b01-a259-153ce85d6185 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:11.100313 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351bad7-a590-42c8-8c54-1bba85f28506 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:11.105125 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bab919-1086-4800-a8a5-3b45090049e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:11.106100 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bab919-1086-4800-a8a5-3b45090049e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:11.106672 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bab919-1086-4800-a8a5-3b45090049e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:11.106820 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bab919-1086-4800-a8a5-3b45090049e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:11.109270 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89958445-ed5d-4d73-b821-52f615a6732f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:11.110042 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89958445-ed5d-4d73-b821-52f615a6732f admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:11.110272 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89958445-ed5d-4d73-b821-52f615a6732f admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:11.110542 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89958445-ed5d-4d73-b821-52f615a6732f admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:11.111452 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89958445-ed5d-4d73-b821-52f615a6732f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:11.114056 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89958445-ed5d-4d73-b821-52f615a6732f admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:11.136384 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 994/1989] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:22:11 2022] POST /identity/v3/users => generated 300 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:11.137746 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7d752-d184-4900-9eb9-95f0c9f4d20d None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:11.138363 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7d752-d184-4900-9eb9-95f0c9f4d20d None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:11.138363 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7d752-d184-4900-9eb9-95f0c9f4d20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:11.169120 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-27e7d752-d184-4900-9eb9-95f0c9f4d20d None None] MFA Rules not processed for user `ae37761df5794ec9b8ccf51bc28ec587`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:11.170490 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-27e7d752-d184-4900-9eb9-95f0c9f4d20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:11.186635 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bab919-1086-4800-a8a5-3b45090049e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:11.188222 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bab919-1086-4800-a8a5-3b45090049e3 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:11.202151 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 996/1990] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:22:11.203817 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bab919-1086-4800-a8a5-3b45090049e3 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:11.221182 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bab919-1086-4800-a8a5-3b45090049e3 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:11.230042 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785c4e4-13ec-426b-b1b2-90ce59b9cf42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:11.231083 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785c4e4-13ec-426b-b1b2-90ce59b9cf42 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:11.231484 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785c4e4-13ec-426b-b1b2-90ce59b9cf42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:11.231952 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785c4e4-13ec-426b-b1b2-90ce59b9cf42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:11.233141 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3785c4e4-13ec-426b-b1b2-90ce59b9cf42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:11.235763 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3785c4e4-13ec-426b-b1b2-90ce59b9cf42 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:11.256833 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 997/1991] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:11 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:11.258480 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785c4e4-13ec-426b-b1b2-90ce59b9cf42 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:11.260550 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3785c4e4-13ec-426b-b1b2-90ce59b9cf42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:11.272544 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 995/1992] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:11 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:11.273972 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e7d752-d184-4900-9eb9-95f0c9f4d20d None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:11.274495 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785c4e4-13ec-426b-b1b2-90ce59b9cf42 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:11.282427 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e20db1-5a1e-4c73-a05a-cf383b662d19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:11.283323 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e20db1-5a1e-4c73-a05a-cf383b662d19 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:11.283607 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e20db1-5a1e-4c73-a05a-cf383b662d19 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:11.283883 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e20db1-5a1e-4c73-a05a-cf383b662d19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:11.305216 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e7d752-d184-4900-9eb9-95f0c9f4d20d None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:11.317822 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16002539-8bc5-4b9f-851d-9af4e2c58e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:11.318946 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16002539-8bc5-4b9f-851d-9af4e2c58e2c admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:11.319713 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16002539-8bc5-4b9f-851d-9af4e2c58e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:11.320104 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16002539-8bc5-4b9f-851d-9af4e2c58e2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:11.321991 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16002539-8bc5-4b9f-851d-9af4e2c58e2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:11.323698 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16002539-8bc5-4b9f-851d-9af4e2c58e2c admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:11.335289 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 996/1993] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:11 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:11.335917 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16002539-8bc5-4b9f-851d-9af4e2c58e2c admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:11.351348 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16002539-8bc5-4b9f-851d-9af4e2c58e2c admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:11.368669 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9199357-02e7-4e98-9bda-5183035dfd18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:11.370090 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9199357-02e7-4e98-9bda-5183035dfd18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:11.370594 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9199357-02e7-4e98-9bda-5183035dfd18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:11.370989 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9199357-02e7-4e98-9bda-5183035dfd18 admin admin] PATH_INFO: `/v3/users/5732ea8b241648f4a96dc75a9d5e7e8d` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:11.378057 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9199357-02e7-4e98-9bda-5183035dfd18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5732ea8b241648f4a96dc75a9d5e7e8d)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:11.381542 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9199357-02e7-4e98-9bda-5183035dfd18 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:11.403155 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e20db1-5a1e-4c73-a05a-cf383b662d19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:11.404943 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e20db1-5a1e-4c73-a05a-cf383b662d19 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:11.428925 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 998/1994] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:11 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:22:11.430830 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e20db1-5a1e-4c73-a05a-cf383b662d19 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:11.454923 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e20db1-5a1e-4c73-a05a-cf383b662d19 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:11.466667 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f27fb2d-1dcb-424a-b028-50481111bfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:11.467962 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27fb2d-1dcb-424a-b028-50481111bfa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:11.468483 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27fb2d-1dcb-424a-b028-50481111bfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:11.468922 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27fb2d-1dcb-424a-b028-50481111bfa9 admin admin] PATH_INFO: `/v3/projects/fcc87990872d47f28c02f684195fce0c/users/5502cff34b1c46788024497e3cfe5972/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:11.471436 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f27fb2d-1dcb-424a-b028-50481111bfa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcc87990872d47f28c02f684195fce0c, user_id=5502cff34b1c46788024497e3cfe5972, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:11.475685 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f27fb2d-1dcb-424a-b028-50481111bfa9 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:11.483003 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f9199357-02e7-4e98-9bda-5183035dfd18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5732ea8b241648f4a96dc75a9d5e7e8d'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:11.505274 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 999/1995] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:22:11 2022] PUT /identity/v3/projects/fcc87990872d47f28c02f684195fce0c/users/5502cff34b1c46788024497e3cfe5972/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:11.505274 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f27fb2d-1dcb-424a-b028-50481111bfa9 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:11.512415 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:11.529953 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f9199357-02e7-4e98-9bda-5183035dfd18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5732ea8b241648f4a96dc75a9d5e7e8d'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:11.551619 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f9199357-02e7-4e98-9bda-5183035dfd18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5732ea8b241648f4a96dc75a9d5e7e8d'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:11.554803 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f9199357-02e7-4e98-9bda-5183035dfd18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5732ea8b241648f4a96dc75a9d5e7e8d'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:11.569546 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f9199357-02e7-4e98-9bda-5183035dfd18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5732ea8b241648f4a96dc75a9d5e7e8d'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:11.576587 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:11.580527 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 997/1996] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:22:11 2022] DELETE /identity/v3/users/5732ea8b241648f4a96dc75a9d5e7e8d => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:11.584364 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9199357-02e7-4e98-9bda-5183035dfd18 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:11.585878 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-f9199357-02e7-4e98-9bda-5183035dfd18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:11.619469 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f27fb2d-1dcb-424a-b028-50481111bfa9 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:11.725136 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9199357-02e7-4e98-9bda-5183035dfd18 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:11.730890 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae92ba4-f774-4b19-ba96-9071b056e647 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:11.731639 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae92ba4-f774-4b19-ba96-9071b056e647 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:11.731865 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae92ba4-f774-4b19-ba96-9071b056e647 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:11.732109 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae92ba4-f774-4b19-ba96-9071b056e647 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:11.733404 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676424dd-5b17-433f-95e9-d011ae05e4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:11.734446 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676424dd-5b17-433f-95e9-d011ae05e4e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:11.734748 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676424dd-5b17-433f-95e9-d011ae05e4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:11.735155 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676424dd-5b17-433f-95e9-d011ae05e4e3 admin admin] PATH_INFO: `/v3/projects/fc95b99e2c794bc0a278f82075b09656/users/8a1cc35d751949678eeeae925f636219/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:11.739597 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-eae92ba4-f774-4b19-ba96-9071b056e647 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:11.758363 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676424dd-5b17-433f-95e9-d011ae05e4e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc95b99e2c794bc0a278f82075b09656, user_id=8a1cc35d751949678eeeae925f636219, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:11.763429 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676424dd-5b17-433f-95e9-d011ae05e4e3 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:11.782318 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 998/1997] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:22:11 2022] PUT /identity/v3/projects/fc95b99e2c794bc0a278f82075b09656/users/8a1cc35d751949678eeeae925f636219/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:11.784000 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe91c78-564e-4340-89ef-596eee06e015 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:11.784296 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe91c78-564e-4340-89ef-596eee06e015 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:11.784579 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe91c78-564e-4340-89ef-596eee06e015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:11.829056 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-abe91c78-564e-4340-89ef-596eee06e015 None None] MFA Rules not processed for user `5502cff34b1c46788024497e3cfe5972`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:11.830403 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-abe91c78-564e-4340-89ef-596eee06e015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:11.831717 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae92ba4-f774-4b19-ba96-9071b056e647 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:11.833346 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae92ba4-f774-4b19-ba96-9071b056e647 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:11.849294 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1000/1998] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:11 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:22:11.851722 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f532f38-13e3-4be5-ace8-ef629276e8b4 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:11.852434 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f532f38-13e3-4be5-ace8-ef629276e8b4 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:11.852727 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f532f38-13e3-4be5-ace8-ef629276e8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:11.888866 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-3f532f38-13e3-4be5-ace8-ef629276e8b4 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:11.892264 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3f532f38-13e3-4be5-ace8-ef629276e8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:11.971873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 999/1999] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:11 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:11.974730 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe91c78-564e-4340-89ef-596eee06e015 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:12.025807 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1001/2000] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:12.027336 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f532f38-13e3-4be5-ace8-ef629276e8b4 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:12.033976 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3f532f38-13e3-4be5-ace8-ef629276e8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:12.129068 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:12.130604 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:12.160663 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f532f38-13e3-4be5-ace8-ef629276e8b4 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:12.165095 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe91c78-564e-4340-89ef-596eee06e015 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:12.167087 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f67d49a-9b53-4a33-afa4-91b2fb48c713 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:12.169277 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67d49a-9b53-4a33-afa4-91b2fb48c713 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:12.169836 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67d49a-9b53-4a33-afa4-91b2fb48c713 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:12.170378 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67d49a-9b53-4a33-afa4-91b2fb48c713 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:12.171478 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb39a90d-ee27-4cef-a375-5354f64b3d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:12.172003 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39a90d-ee27-4cef-a375-5354f64b3d64 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:12.172359 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39a90d-ee27-4cef-a375-5354f64b3d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:12.172694 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39a90d-ee27-4cef-a375-5354f64b3d64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:12.173457 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb39a90d-ee27-4cef-a375-5354f64b3d64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:12.175279 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb39a90d-ee27-4cef-a375-5354f64b3d64 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:12.183999 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f67d49a-9b53-4a33-afa4-91b2fb48c713 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:12.185521 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f67d49a-9b53-4a33-afa4-91b2fb48c713 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:12.193637 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1000/2001] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:11 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:12.193637 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb39a90d-ee27-4cef-a375-5354f64b3d64 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:12.197014 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-cb39a90d-ee27-4cef-a375-5354f64b3d64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:12.203556 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1002/2002] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:12 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:22:12.215676 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f67d49a-9b53-4a33-afa4-91b2fb48c713 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:12.237837 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f67d49a-9b53-4a33-afa4-91b2fb48c713 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:12.242599 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec025a9-552f-4ead-ab59-478b6a8df2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:12.243408 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec025a9-552f-4ead-ab59-478b6a8df2da admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:12.243623 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec025a9-552f-4ead-ab59-478b6a8df2da admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:12.243985 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec025a9-552f-4ead-ab59-478b6a8df2da admin admin] PATH_INFO: `/v3/projects/fc95b99e2c794bc0a278f82075b09656/users/8a1cc35d751949678eeeae925f636219/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:12.246580 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec025a9-552f-4ead-ab59-478b6a8df2da admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc95b99e2c794bc0a278f82075b09656, user_id=8a1cc35d751949678eeeae925f636219, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:12.249400 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec025a9-552f-4ead-ab59-478b6a8df2da admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:12.269183 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1003/2003] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:22:12 2022] PUT /identity/v3/projects/fc95b99e2c794bc0a278f82075b09656/users/8a1cc35d751949678eeeae925f636219/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:12.285521 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a36f30-71dd-497d-98f7-0011162e87f1 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:12.286228 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a36f30-71dd-497d-98f7-0011162e87f1 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:12.287556 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a36f30-71dd-497d-98f7-0011162e87f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:12.343138 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e4a36f30-71dd-497d-98f7-0011162e87f1 None None] MFA Rules not processed for user `8a1cc35d751949678eeeae925f636219`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:12.345740 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e4a36f30-71dd-497d-98f7-0011162e87f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:12.354470 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb39a90d-ee27-4cef-a375-5354f64b3d64 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:12.447676 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc1121-e1cd-4f6e-8644-dfdcc558868a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:12.448263 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc1121-e1cd-4f6e-8644-dfdcc558868a service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:12.448683 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc1121-e1cd-4f6e-8644-dfdcc558868a service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:12.449185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc1121-e1cd-4f6e-8644-dfdcc558868a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:12.491832 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1004/2004] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:12 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:22:12.492606 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a36f30-71dd-497d-98f7-0011162e87f1 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:12.569748 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc1121-e1cd-4f6e-8644-dfdcc558868a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:12.571232 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc1121-e1cd-4f6e-8644-dfdcc558868a service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:12.574702 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a36f30-71dd-497d-98f7-0011162e87f1 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:12.580780 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb7ea7a-b238-4b20-a44f-7e8b2abcbb08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:12.581950 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7ea7a-b238-4b20-a44f-7e8b2abcbb08 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:12.582442 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7ea7a-b238-4b20-a44f-7e8b2abcbb08 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:12.582722 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1001/2005] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:22:12.582951 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7ea7a-b238-4b20-a44f-7e8b2abcbb08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:12.583661 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc1121-e1cd-4f6e-8644-dfdcc558868a service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:12.586501 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-fdb7ea7a-b238-4b20-a44f-7e8b2abcbb08 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:12.591556 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ddfc1121-e1cd-4f6e-8644-dfdcc558868a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:12.612897 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc1121-e1cd-4f6e-8644-dfdcc558868a service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:12.620359 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20cc9a-24c1-4733-88d8-24764573d5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:12.621824 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20cc9a-24c1-4733-88d8-24764573d5b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:12.622259 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20cc9a-24c1-4733-88d8-24764573d5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:12.622648 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20cc9a-24c1-4733-88d8-24764573d5b8 admin admin] PATH_INFO: `/v3/users/057ec8f0bc2b49baae1712529224893c` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:12.624624 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd20cc9a-24c1-4733-88d8-24764573d5b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=057ec8f0bc2b49baae1712529224893c)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:12.627282 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd20cc9a-24c1-4733-88d8-24764573d5b8 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:12.697315 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb7ea7a-b238-4b20-a44f-7e8b2abcbb08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:12.701034 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb7ea7a-b238-4b20-a44f-7e8b2abcbb08 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:12.710566 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:12.722462 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-cd20cc9a-24c1-4733-88d8-24764573d5b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '057ec8f0bc2b49baae1712529224893c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:12.731668 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1005/2006] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:12 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:22:12.733160 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb7ea7a-b238-4b20-a44f-7e8b2abcbb08 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:12.747080 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-cd20cc9a-24c1-4733-88d8-24764573d5b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '057ec8f0bc2b49baae1712529224893c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:12.752781 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:12.764119 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-cd20cc9a-24c1-4733-88d8-24764573d5b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '057ec8f0bc2b49baae1712529224893c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:12.765506 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-cd20cc9a-24c1-4733-88d8-24764573d5b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '057ec8f0bc2b49baae1712529224893c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:12.782695 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-cd20cc9a-24c1-4733-88d8-24764573d5b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '057ec8f0bc2b49baae1712529224893c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:12.795605 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1002/2007] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:22:12 2022] DELETE /identity/v3/users/057ec8f0bc2b49baae1712529224893c => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:12.796728 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20cc9a-24c1-4733-88d8-24764573d5b8 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:12.799009 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-cd20cc9a-24c1-4733-88d8-24764573d5b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:12.897454 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb7ea7a-b238-4b20-a44f-7e8b2abcbb08 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:12.991697 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20cc9a-24c1-4733-88d8-24764573d5b8 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:12.998836 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f79134-6a67-468a-8351-b17681353420 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:12.999914 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f79134-6a67-468a-8351-b17681353420 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:13.001186 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f79134-6a67-468a-8351-b17681353420 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:13.001787 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f79134-6a67-468a-8351-b17681353420 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:13.006724 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e7f79134-6a67-468a-8351-b17681353420 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:13.117748 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f7273-a588-4e75-aa86-30e3a7754e8b tempest-VolumeQuotaClassesTest-299716652 tempest-VolumeQuotaClassesTest-299716652-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae37761df5794ec9b8ccf51bc28ec587', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49c9977d02a54f27bf8b3a689573821b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:13.119405 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f79134-6a67-468a-8351-b17681353420 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:13.119657 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f7273-a588-4e75-aa86-30e3a7754e8b tempest-VolumeQuotaClassesTest-299716652 tempest-VolumeQuotaClassesTest-299716652-project-admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:13.119755 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f7273-a588-4e75-aa86-30e3a7754e8b tempest-VolumeQuotaClassesTest-299716652 tempest-VolumeQuotaClassesTest-299716652-project-admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:13.120240 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f7273-a588-4e75-aa86-30e3a7754e8b tempest-VolumeQuotaClassesTest-299716652 tempest-VolumeQuotaClassesTest-299716652-project-admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:13.121750 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f79134-6a67-468a-8351-b17681353420 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:13.123278 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420f7273-a588-4e75-aa86-30e3a7754e8b tempest-VolumeQuotaClassesTest-299716652 tempest-VolumeQuotaClassesTest-299716652-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:22:13.123819 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420f7273-a588-4e75-aa86-30e3a7754e8b tempest-VolumeQuotaClassesTest-299716652 tempest-VolumeQuotaClassesTest-299716652-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:13.128050 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420f7273-a588-4e75-aa86-30e3a7754e8b tempest-VolumeQuotaClassesTest-299716652 tempest-VolumeQuotaClassesTest-299716652-project-admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:13.137521 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1003/2008] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:12 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:22:13.139500 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a30d94-8820-4b45-b2a8-a073304850d3 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:13.140725 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a30d94-8820-4b45-b2a8-a073304850d3 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:13.141006 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a30d94-8820-4b45-b2a8-a073304850d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:13.152620 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1006/2009] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:22:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 416 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:22:13.155527 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f7273-a588-4e75-aa86-30e3a7754e8b tempest-VolumeQuotaClassesTest-299716652 tempest-VolumeQuotaClassesTest-299716652-project-admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:13.158641 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-420f7273-a588-4e75-aa86-30e3a7754e8b tempest-VolumeQuotaClassesTest-299716652 tempest-VolumeQuotaClassesTest-299716652-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:13.182979 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f7273-a588-4e75-aa86-30e3a7754e8b tempest-VolumeQuotaClassesTest-299716652 tempest-VolumeQuotaClassesTest-299716652-project-admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:13.188780 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-25a30d94-8820-4b45-b2a8-a073304850d3 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:13.190871 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-25a30d94-8820-4b45-b2a8-a073304850d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:13.192066 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1df34a-6cad-4238-ba91-f677df916139 tempest-VolumeQuotaClassesTest-299716652 tempest-VolumeQuotaClassesTest-299716652-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae37761df5794ec9b8ccf51bc28ec587', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49c9977d02a54f27bf8b3a689573821b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:13.193756 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1df34a-6cad-4238-ba91-f677df916139 tempest-VolumeQuotaClassesTest-299716652 tempest-VolumeQuotaClassesTest-299716652-project-admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:13.194891 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1df34a-6cad-4238-ba91-f677df916139 tempest-VolumeQuotaClassesTest-299716652 tempest-VolumeQuotaClassesTest-299716652-project-admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:13.195685 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1df34a-6cad-4238-ba91-f677df916139 tempest-VolumeQuotaClassesTest-299716652 tempest-VolumeQuotaClassesTest-299716652-project-admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:13.197086 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1df34a-6cad-4238-ba91-f677df916139 tempest-VolumeQuotaClassesTest-299716652 tempest-VolumeQuotaClassesTest-299716652-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:13.202613 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1df34a-6cad-4238-ba91-f677df916139 tempest-VolumeQuotaClassesTest-299716652 tempest-VolumeQuotaClassesTest-299716652-project-admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:13.260196 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1007/2010] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:22:13 2022] POST /identity/v3/projects => generated 355 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:13.261169 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1df34a-6cad-4238-ba91-f677df916139 tempest-VolumeQuotaClassesTest-299716652 tempest-VolumeQuotaClassesTest-299716652-project-admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:13.267830 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ab1df34a-6cad-4238-ba91-f677df916139 tempest-VolumeQuotaClassesTest-299716652 tempest-VolumeQuotaClassesTest-299716652-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:13.358141 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1004/2011] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:13.359353 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a30d94-8820-4b45-b2a8-a073304850d3 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:13.375663 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a30d94-8820-4b45-b2a8-a073304850d3 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:13.381888 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:13.458814 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1df34a-6cad-4238-ba91-f677df916139 tempest-VolumeQuotaClassesTest-299716652 tempest-VolumeQuotaClassesTest-299716652-project-admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:13.474396 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20698948-fe9d-41e4-8d59-e73fa5049a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:13.474396 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20698948-fe9d-41e4-8d59-e73fa5049a97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:13.474396 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20698948-fe9d-41e4-8d59-e73fa5049a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:13.474396 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20698948-fe9d-41e4-8d59-e73fa5049a97 admin admin] PATH_INFO: `/v3/users/cba1c62d1a1c494e9ab02bec3372f144` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:13.485465 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20698948-fe9d-41e4-8d59-e73fa5049a97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cba1c62d1a1c494e9ab02bec3372f144)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:13.489650 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20698948-fe9d-41e4-8d59-e73fa5049a97 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:13.499034 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9d92a-c1c6-4b61-bccb-7586c75b8a30 tempest-VolumeQuotaClassesTest-299716652 tempest-VolumeQuotaClassesTest-299716652-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae37761df5794ec9b8ccf51bc28ec587', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49c9977d02a54f27bf8b3a689573821b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:13.501002 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9d92a-c1c6-4b61-bccb-7586c75b8a30 tempest-VolumeQuotaClassesTest-299716652 tempest-VolumeQuotaClassesTest-299716652-project-admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:13.502071 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9d92a-c1c6-4b61-bccb-7586c75b8a30 tempest-VolumeQuotaClassesTest-299716652 tempest-VolumeQuotaClassesTest-299716652-project-admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:13.502774 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9d92a-c1c6-4b61-bccb-7586c75b8a30 tempest-VolumeQuotaClassesTest-299716652 tempest-VolumeQuotaClassesTest-299716652-project-admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:13.511283 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a9d92a-c1c6-4b61-bccb-7586c75b8a30 tempest-VolumeQuotaClassesTest-299716652 tempest-VolumeQuotaClassesTest-299716652-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:22:13.512473 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a9d92a-c1c6-4b61-bccb-7586c75b8a30 tempest-VolumeQuotaClassesTest-299716652 tempest-VolumeQuotaClassesTest-299716652-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:13.516281 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a9d92a-c1c6-4b61-bccb-7586c75b8a30 tempest-VolumeQuotaClassesTest-299716652 tempest-VolumeQuotaClassesTest-299716652-project-admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:13.582380 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1005/2012] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:22:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:22:13.585042 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9d92a-c1c6-4b61-bccb-7586c75b8a30 tempest-VolumeQuotaClassesTest-299716652 tempest-VolumeQuotaClassesTest-299716652-project-admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:13.591447 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-24a9d92a-c1c6-4b61-bccb-7586c75b8a30 tempest-VolumeQuotaClassesTest-299716652 tempest-VolumeQuotaClassesTest-299716652-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:13.619381 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:13.655675 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-20698948-fe9d-41e4-8d59-e73fa5049a97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cba1c62d1a1c494e9ab02bec3372f144'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:13.656636 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-20698948-fe9d-41e4-8d59-e73fa5049a97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cba1c62d1a1c494e9ab02bec3372f144'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:13.657676 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-20698948-fe9d-41e4-8d59-e73fa5049a97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cba1c62d1a1c494e9ab02bec3372f144'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:13.683832 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-20698948-fe9d-41e4-8d59-e73fa5049a97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cba1c62d1a1c494e9ab02bec3372f144'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:13.698362 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-20698948-fe9d-41e4-8d59-e73fa5049a97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cba1c62d1a1c494e9ab02bec3372f144'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:13.718935 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1008/2013] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:22:13 2022] DELETE /identity/v3/users/cba1c62d1a1c494e9ab02bec3372f144 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:13.719975 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20698948-fe9d-41e4-8d59-e73fa5049a97 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:13.721402 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-20698948-fe9d-41e4-8d59-e73fa5049a97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:13.726139 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9d92a-c1c6-4b61-bccb-7586c75b8a30 tempest-VolumeQuotaClassesTest-299716652 tempest-VolumeQuotaClassesTest-299716652-project-admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:13.829279 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1400352f-6d08-47ce-b4bc-49280598cd34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:13.830335 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400352f-6d08-47ce-b4bc-49280598cd34 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:13.830665 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400352f-6d08-47ce-b4bc-49280598cd34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:13.831097 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400352f-6d08-47ce-b4bc-49280598cd34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:13.834645 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-1400352f-6d08-47ce-b4bc-49280598cd34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:13.841555 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20698948-fe9d-41e4-8d59-e73fa5049a97 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:13.851006 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e68e9e-6342-4c1f-bc6b-7a657b9c0ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:13.853483 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e68e9e-6342-4c1f-bc6b-7a657b9c0ecf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:13.854339 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e68e9e-6342-4c1f-bc6b-7a657b9c0ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:13.854339 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e68e9e-6342-4c1f-bc6b-7a657b9c0ecf admin admin] PATH_INFO: `/v3/projects/82950ad561d040a3a4d039897b37e7bc` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:13.857563 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e68e9e-6342-4c1f-bc6b-7a657b9c0ecf admin admin] RBAC: Authorizing `identity:delete_project(project_id=82950ad561d040a3a4d039897b37e7bc)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:13.858248 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1400352f-6d08-47ce-b4bc-49280598cd34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:13.861841 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1400352f-6d08-47ce-b4bc-49280598cd34 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:13.862137 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e68e9e-6342-4c1f-bc6b-7a657b9c0ecf admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:13.878395 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1006/2014] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:22:13.879832 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1400352f-6d08-47ce-b4bc-49280598cd34 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:13.882067 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-1400352f-6d08-47ce-b4bc-49280598cd34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:13.972941 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b6e68e9e-6342-4c1f-bc6b-7a657b9c0ecf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82950ad561d040a3a4d039897b37e7bc', 'request_id': 'req-b6e68e9e-6342-4c1f-bc6b-7a657b9c0ecf'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:13.999704 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b6e68e9e-6342-4c1f-bc6b-7a657b9c0ecf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82950ad561d040a3a4d039897b37e7bc', 'request_id': 'req-b6e68e9e-6342-4c1f-bc6b-7a657b9c0ecf'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:14.029123 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b6e68e9e-6342-4c1f-bc6b-7a657b9c0ecf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82950ad561d040a3a4d039897b37e7bc', 'request_id': 'req-b6e68e9e-6342-4c1f-bc6b-7a657b9c0ecf'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:14.048597 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1400352f-6d08-47ce-b4bc-49280598cd34 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:14.056022 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:14.083543 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b6e68e9e-6342-4c1f-bc6b-7a657b9c0ecf admin admin] The token cache is being invalidate because project 82950ad561d040a3a4d039897b37e7bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:22:14.084373 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b6e68e9e-6342-4c1f-bc6b-7a657b9c0ecf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:14.095895 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b6e68e9e-6342-4c1f-bc6b-7a657b9c0ecf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:14.099272 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1009/2015] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:22:13 2022] DELETE /identity/v3/projects/82950ad561d040a3a4d039897b37e7bc => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:14.103083 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a904375-9908-4e9d-a0c8-c30d313de087 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:14.103664 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a904375-9908-4e9d-a0c8-c30d313de087 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:14.104137 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a904375-9908-4e9d-a0c8-c30d313de087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:14.175471 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-2a904375-9908-4e9d-a0c8-c30d313de087 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:14.178451 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2a904375-9908-4e9d-a0c8-c30d313de087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:14.230156 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653e705-8f65-42c4-837f-8e42e8790c0e tempest-VolumeQuotaClassesTest-299716652 tempest-VolumeQuotaClassesTest-299716652-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae37761df5794ec9b8ccf51bc28ec587', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49c9977d02a54f27bf8b3a689573821b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:14.231534 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653e705-8f65-42c4-837f-8e42e8790c0e tempest-VolumeQuotaClassesTest-299716652 tempest-VolumeQuotaClassesTest-299716652-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:14.231936 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653e705-8f65-42c4-837f-8e42e8790c0e tempest-VolumeQuotaClassesTest-299716652 tempest-VolumeQuotaClassesTest-299716652-project-admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:14.232374 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653e705-8f65-42c4-837f-8e42e8790c0e tempest-VolumeQuotaClassesTest-299716652 tempest-VolumeQuotaClassesTest-299716652-project-admin] PATH_INFO: `/v3/projects/bcaae62745fb44b998e61007558466c9` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:14.234189 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b653e705-8f65-42c4-837f-8e42e8790c0e tempest-VolumeQuotaClassesTest-299716652 tempest-VolumeQuotaClassesTest-299716652-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bcaae62745fb44b998e61007558466c9)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:14.236709 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b653e705-8f65-42c4-837f-8e42e8790c0e tempest-VolumeQuotaClassesTest-299716652 tempest-VolumeQuotaClassesTest-299716652-project-admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:14.255124 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:14.320776 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1010/2016] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:14.322603 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55fb70-d888-4519-b8e7-e98c34a1e00d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:14.323714 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55fb70-d888-4519-b8e7-e98c34a1e00d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:14.323714 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55fb70-d888-4519-b8e7-e98c34a1e00d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:14.348937 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b653e705-8f65-42c4-837f-8e42e8790c0e tempest-VolumeQuotaClassesTest-299716652 tempest-VolumeQuotaClassesTest-299716652-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcaae62745fb44b998e61007558466c9', 'request_id': 'req-b653e705-8f65-42c4-837f-8e42e8790c0e'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:14.359957 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b653e705-8f65-42c4-837f-8e42e8790c0e tempest-VolumeQuotaClassesTest-299716652 tempest-VolumeQuotaClassesTest-299716652-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcaae62745fb44b998e61007558466c9', 'request_id': 'req-b653e705-8f65-42c4-837f-8e42e8790c0e'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:14.363476 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-ee55fb70-d888-4519-b8e7-e98c34a1e00d None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:14.364761 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ee55fb70-d888-4519-b8e7-e98c34a1e00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:14.388558 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b653e705-8f65-42c4-837f-8e42e8790c0e tempest-VolumeQuotaClassesTest-299716652 tempest-VolumeQuotaClassesTest-299716652-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcaae62745fb44b998e61007558466c9', 'request_id': 'req-b653e705-8f65-42c4-837f-8e42e8790c0e'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:14.431031 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b653e705-8f65-42c4-837f-8e42e8790c0e tempest-VolumeQuotaClassesTest-299716652 tempest-VolumeQuotaClassesTest-299716652-project-admin] The token cache is being invalidate because project bcaae62745fb44b998e61007558466c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:22:14.431674 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b653e705-8f65-42c4-837f-8e42e8790c0e tempest-VolumeQuotaClassesTest-299716652 tempest-VolumeQuotaClassesTest-299716652-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:14.432965 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b653e705-8f65-42c4-837f-8e42e8790c0e tempest-VolumeQuotaClassesTest-299716652 tempest-VolumeQuotaClassesTest-299716652-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:14.442577 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1007/2017] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:22:13 2022] DELETE /identity/v3/projects/bcaae62745fb44b998e61007558466c9 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:14.445122 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653e705-8f65-42c4-837f-8e42e8790c0e tempest-VolumeQuotaClassesTest-299716652 tempest-VolumeQuotaClassesTest-299716652-project-admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:14.453936 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-b653e705-8f65-42c4-837f-8e42e8790c0e tempest-VolumeQuotaClassesTest-299716652 tempest-VolumeQuotaClassesTest-299716652-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:14.576995 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1011/2018] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:14.590241 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1816e-5b95-41b0-9380-99639b816005 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:14.590571 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1816e-5b95-41b0-9380-99639b816005 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:14.590827 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1816e-5b95-41b0-9380-99639b816005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:14.669006 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-d9c1816e-5b95-41b0-9380-99639b816005 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:14.671969 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653e705-8f65-42c4-837f-8e42e8790c0e tempest-VolumeQuotaClassesTest-299716652 tempest-VolumeQuotaClassesTest-299716652-project-admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:14.672751 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d9c1816e-5b95-41b0-9380-99639b816005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:14.693875 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca3d9e-fb93-4db5-b292-0eb3cb9ce302 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:14.694804 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca3d9e-fb93-4db5-b292-0eb3cb9ce302 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:14.695286 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca3d9e-fb93-4db5-b292-0eb3cb9ce302 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:14.695783 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca3d9e-fb93-4db5-b292-0eb3cb9ce302 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:14.708976 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-9fca3d9e-fb93-4db5-b292-0eb3cb9ce302 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:14.713443 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1012/2019] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:22:14.718600 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c1816e-5b95-41b0-9380-99639b816005 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:14.718600 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d9c1816e-5b95-41b0-9380-99639b816005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:14.754951 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c1816e-5b95-41b0-9380-99639b816005 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:14.756912 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca3d9e-fb93-4db5-b292-0eb3cb9ce302 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:14.758319 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca3d9e-fb93-4db5-b292-0eb3cb9ce302 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:14.781498 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43550b8e-a081-425e-b638-defa0051271c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:14.783002 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43550b8e-a081-425e-b638-defa0051271c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:14.783500 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43550b8e-a081-425e-b638-defa0051271c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:14.784007 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43550b8e-a081-425e-b638-defa0051271c admin admin] PATH_INFO: `/v3/projects/45de89ebd84b45198bf435fec8a14929` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:14.789411 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43550b8e-a081-425e-b638-defa0051271c admin admin] RBAC: Authorizing `identity:delete_project(project_id=45de89ebd84b45198bf435fec8a14929)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:14.799859 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1008/2020] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:22:14.802466 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca3d9e-fb93-4db5-b292-0eb3cb9ce302 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:14.810042 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43550b8e-a081-425e-b638-defa0051271c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:14.839642 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca3d9e-fb93-4db5-b292-0eb3cb9ce302 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:14.862394 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf07a40-0ae1-4711-8819-6384dc7b349a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:14.863964 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf07a40-0ae1-4711-8819-6384dc7b349a admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:14.864444 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf07a40-0ae1-4711-8819-6384dc7b349a admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:14.865102 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf07a40-0ae1-4711-8819-6384dc7b349a admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:14.868098 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf07a40-0ae1-4711-8819-6384dc7b349a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:22:14.869462 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf07a40-0ae1-4711-8819-6384dc7b349a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:14.872669 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf07a40-0ae1-4711-8819-6384dc7b349a admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:14.906469 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1009/2021] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:22:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:22:14.908448 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf07a40-0ae1-4711-8819-6384dc7b349a admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:14.947117 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf07a40-0ae1-4711-8819-6384dc7b349a admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:14.959518 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-43550b8e-a081-425e-b638-defa0051271c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45de89ebd84b45198bf435fec8a14929', 'request_id': 'req-43550b8e-a081-425e-b638-defa0051271c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:14.976785 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-43550b8e-a081-425e-b638-defa0051271c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45de89ebd84b45198bf435fec8a14929', 'request_id': 'req-43550b8e-a081-425e-b638-defa0051271c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:14.996100 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-43550b8e-a081-425e-b638-defa0051271c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45de89ebd84b45198bf435fec8a14929', 'request_id': 'req-43550b8e-a081-425e-b638-defa0051271c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:15.049563 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:15.049829 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-43550b8e-a081-425e-b638-defa0051271c admin admin] The token cache is being invalidate because project 45de89ebd84b45198bf435fec8a14929 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:22:15.051291 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-43550b8e-a081-425e-b638-defa0051271c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:15.054086 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-43550b8e-a081-425e-b638-defa0051271c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:15.063231 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1013/2022] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:22:14 2022] DELETE /identity/v3/projects/45de89ebd84b45198bf435fec8a14929 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:15.065268 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43550b8e-a081-425e-b638-defa0051271c admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:15.069030 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-43550b8e-a081-425e-b638-defa0051271c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:15.187074 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc576b2-fac1-4ecd-8132-a2f50cb6035b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:15.188264 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc576b2-fac1-4ecd-8132-a2f50cb6035b admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:15.190456 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc576b2-fac1-4ecd-8132-a2f50cb6035b admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:15.190943 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc576b2-fac1-4ecd-8132-a2f50cb6035b admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:15.192240 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc576b2-fac1-4ecd-8132-a2f50cb6035b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:15.196249 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc576b2-fac1-4ecd-8132-a2f50cb6035b admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:15.202584 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:15.246357 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43550b8e-a081-425e-b638-defa0051271c admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:15.272296 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0292681f-7e31-4740-a865-ca813e8e41da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:15.273665 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292681f-7e31-4740-a865-ca813e8e41da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:15.274031 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292681f-7e31-4740-a865-ca813e8e41da admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:15.279382 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1010/2023] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:22:14 2022] POST /identity/v3/projects => generated 373 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:15.280057 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292681f-7e31-4740-a865-ca813e8e41da admin admin] PATH_INFO: `/v3/users/4460aea155134815b328f6f93ff4cd75` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:15.280984 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc576b2-fac1-4ecd-8132-a2f50cb6035b admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:15.282873 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0292681f-7e31-4740-a865-ca813e8e41da admin admin] RBAC: Authorizing `identity:delete_user(user_id=4460aea155134815b328f6f93ff4cd75)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:15.283906 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-afc576b2-fac1-4ecd-8132-a2f50cb6035b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:15.286800 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0292681f-7e31-4740-a865-ca813e8e41da admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:15.375076 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc576b2-fac1-4ecd-8132-a2f50cb6035b admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:15.382635 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0292681f-7e31-4740-a865-ca813e8e41da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4460aea155134815b328f6f93ff4cd75'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:15.383800 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0292681f-7e31-4740-a865-ca813e8e41da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4460aea155134815b328f6f93ff4cd75'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:15.384472 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0292681f-7e31-4740-a865-ca813e8e41da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4460aea155134815b328f6f93ff4cd75'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:15.388674 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6352559-ab98-4770-9a31-7206141adf27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:15.389870 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6352559-ab98-4770-9a31-7206141adf27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:15.390169 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6352559-ab98-4770-9a31-7206141adf27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:15.390452 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6352559-ab98-4770-9a31-7206141adf27 admin admin] PATH_INFO: `/v3/users/1d0f64bc1ec24fab890e4bbd0e4aac55` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:15.391882 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6352559-ab98-4770-9a31-7206141adf27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d0f64bc1ec24fab890e4bbd0e4aac55)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:15.394572 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6352559-ab98-4770-9a31-7206141adf27 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:15.402314 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0292681f-7e31-4740-a865-ca813e8e41da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4460aea155134815b328f6f93ff4cd75'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:15.414672 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0292681f-7e31-4740-a865-ca813e8e41da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4460aea155134815b328f6f93ff4cd75'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:15.434696 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1014/2024] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:22:15 2022] DELETE /identity/v3/users/4460aea155134815b328f6f93ff4cd75 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:15.435653 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0292681f-7e31-4740-a865-ca813e8e41da admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:15.437170 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0292681f-7e31-4740-a865-ca813e8e41da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:15.492697 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b6352559-ab98-4770-9a31-7206141adf27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d0f64bc1ec24fab890e4bbd0e4aac55'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:15.539637 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b6352559-ab98-4770-9a31-7206141adf27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d0f64bc1ec24fab890e4bbd0e4aac55'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:15.564935 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b6352559-ab98-4770-9a31-7206141adf27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d0f64bc1ec24fab890e4bbd0e4aac55'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:15.566488 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b6352559-ab98-4770-9a31-7206141adf27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d0f64bc1ec24fab890e4bbd0e4aac55'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:15.567364 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0292681f-7e31-4740-a865-ca813e8e41da admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:15.574278 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2684bf32-fc84-4f49-8a5e-119a48a395dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:15.575580 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684bf32-fc84-4f49-8a5e-119a48a395dd admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:15.576143 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684bf32-fc84-4f49-8a5e-119a48a395dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:15.576503 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684bf32-fc84-4f49-8a5e-119a48a395dd admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:15.580036 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2684bf32-fc84-4f49-8a5e-119a48a395dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:15.582421 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2684bf32-fc84-4f49-8a5e-119a48a395dd admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:15.586585 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b6352559-ab98-4770-9a31-7206141adf27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d0f64bc1ec24fab890e4bbd0e4aac55'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:15.614797 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1015/2025] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:22:15 2022] POST /identity/v3/users => generated 287 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:15.615582 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2684bf32-fc84-4f49-8a5e-119a48a395dd admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:15.616904 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1011/2026] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:22:15 2022] DELETE /identity/v3/users/1d0f64bc1ec24fab890e4bbd0e4aac55 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:15.620788 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2684bf32-fc84-4f49-8a5e-119a48a395dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:15.625178 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6352559-ab98-4770-9a31-7206141adf27 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:15.629256 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-b6352559-ab98-4770-9a31-7206141adf27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:15.638555 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2684bf32-fc84-4f49-8a5e-119a48a395dd admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:15.710804 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:15.736673 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e28e82f-0190-49bf-9d1d-19fc88b44689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:15.738249 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28e82f-0190-49bf-9d1d-19fc88b44689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:15.738732 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28e82f-0190-49bf-9d1d-19fc88b44689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:15.739149 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28e82f-0190-49bf-9d1d-19fc88b44689 admin admin] PATH_INFO: `/v3/projects/7fd5624ed6334a698cf4986ae6eab851` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:15.741392 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e28e82f-0190-49bf-9d1d-19fc88b44689 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fd5624ed6334a698cf4986ae6eab851)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:15.744946 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e28e82f-0190-49bf-9d1d-19fc88b44689 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:15.748191 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:15.805034 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6352559-ab98-4770-9a31-7206141adf27 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:15.817553 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c344c-dba1-49c8-b519-65b545856edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:15.820087 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c344c-dba1-49c8-b519-65b545856edc admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:15.820571 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c344c-dba1-49c8-b519-65b545856edc admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:15.821039 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c344c-dba1-49c8-b519-65b545856edc admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:15.822590 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78c344c-dba1-49c8-b519-65b545856edc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:15.824926 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78c344c-dba1-49c8-b519-65b545856edc admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:15.846965 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1012/2027] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:15 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:15.850035 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb3a45-046a-47ad-8345-d57060442844 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:15.850821 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb3a45-046a-47ad-8345-d57060442844 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:15.851294 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb3a45-046a-47ad-8345-d57060442844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:15.871980 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8e28e82f-0190-49bf-9d1d-19fc88b44689 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fd5624ed6334a698cf4986ae6eab851', 'request_id': 'req-8e28e82f-0190-49bf-9d1d-19fc88b44689'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:15.887049 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8e28e82f-0190-49bf-9d1d-19fc88b44689 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fd5624ed6334a698cf4986ae6eab851', 'request_id': 'req-8e28e82f-0190-49bf-9d1d-19fc88b44689'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:15.887982 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-78eb3a45-046a-47ad-8345-d57060442844 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:15.902476 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8e28e82f-0190-49bf-9d1d-19fc88b44689 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fd5624ed6334a698cf4986ae6eab851', 'request_id': 'req-8e28e82f-0190-49bf-9d1d-19fc88b44689'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:15.903774 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-78eb3a45-046a-47ad-8345-d57060442844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:15.926344 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8e28e82f-0190-49bf-9d1d-19fc88b44689 admin admin] The token cache is being invalidate because project 7fd5624ed6334a698cf4986ae6eab851 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:22:15.926848 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8e28e82f-0190-49bf-9d1d-19fc88b44689 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:15.928689 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8e28e82f-0190-49bf-9d1d-19fc88b44689 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:15.932964 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1016/2028] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:22:15 2022] DELETE /identity/v3/projects/7fd5624ed6334a698cf4986ae6eab851 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:15.935453 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e28e82f-0190-49bf-9d1d-19fc88b44689 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:15.939225 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8e28e82f-0190-49bf-9d1d-19fc88b44689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:16.046537 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1013/2029] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:16.046537 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb3a45-046a-47ad-8345-d57060442844 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:16.047410 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-78eb3a45-046a-47ad-8345-d57060442844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:16.069832 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb3a45-046a-47ad-8345-d57060442844 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:16.078691 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc31ade-a95e-4bc5-a402-e83babe189c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:16.081226 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc31ade-a95e-4bc5-a402-e83babe189c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:16.082172 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc31ade-a95e-4bc5-a402-e83babe189c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:16.082553 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc31ade-a95e-4bc5-a402-e83babe189c4 admin admin] PATH_INFO: `/v3/users/8a1cc35d751949678eeeae925f636219` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:16.085570 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc31ade-a95e-4bc5-a402-e83babe189c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a1cc35d751949678eeeae925f636219)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:16.091763 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc31ade-a95e-4bc5-a402-e83babe189c4 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:16.099033 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e28e82f-0190-49bf-9d1d-19fc88b44689 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:16.104476 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c5fd0-8c17-4248-9c7a-c010b57390d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:16.105517 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c5fd0-8c17-4248-9c7a-c010b57390d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:16.105908 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c5fd0-8c17-4248-9c7a-c010b57390d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:16.106651 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c5fd0-8c17-4248-9c7a-c010b57390d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:16.107488 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759c5fd0-8c17-4248-9c7a-c010b57390d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:16.109307 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759c5fd0-8c17-4248-9c7a-c010b57390d5 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:16.122635 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1017/2030] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:15 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:16.123360 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c5fd0-8c17-4248-9c7a-c010b57390d5 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:16.125684 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-759c5fd0-8c17-4248-9c7a-c010b57390d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:16.195226 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9bc31ade-a95e-4bc5-a402-e83babe189c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a1cc35d751949678eeeae925f636219'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:16.213682 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9bc31ade-a95e-4bc5-a402-e83babe189c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a1cc35d751949678eeeae925f636219'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:16.221886 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9bc31ade-a95e-4bc5-a402-e83babe189c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a1cc35d751949678eeeae925f636219'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:16.223159 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9bc31ade-a95e-4bc5-a402-e83babe189c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a1cc35d751949678eeeae925f636219'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:16.231739 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c5fd0-8c17-4248-9c7a-c010b57390d5 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:16.236349 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9bc31ade-a95e-4bc5-a402-e83babe189c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a1cc35d751949678eeeae925f636219'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:16.236552 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ffd585-3747-42f0-b24a-5d5cf5c9ffb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:16.237103 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ffd585-3747-42f0-b24a-5d5cf5c9ffb7 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:16.237594 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ffd585-3747-42f0-b24a-5d5cf5c9ffb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:16.237745 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ffd585-3747-42f0-b24a-5d5cf5c9ffb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:16.239851 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c9ffd585-3747-42f0-b24a-5d5cf5c9ffb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:16.245504 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1014/2031] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:22:16 2022] DELETE /identity/v3/users/8a1cc35d751949678eeeae925f636219 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:16.248665 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc31ade-a95e-4bc5-a402-e83babe189c4 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:16.253925 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ffd585-3747-42f0-b24a-5d5cf5c9ffb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:16.255261 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-9bc31ade-a95e-4bc5-a402-e83babe189c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:16.255410 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ffd585-3747-42f0-b24a-5d5cf5c9ffb7 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:16.268073 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1018/2032] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:22:16.268966 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ffd585-3747-42f0-b24a-5d5cf5c9ffb7 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:16.270410 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c9ffd585-3747-42f0-b24a-5d5cf5c9ffb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:16.286165 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ffd585-3747-42f0-b24a-5d5cf5c9ffb7 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:16.331370 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:16.340111 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:16.395029 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc31ade-a95e-4bc5-a402-e83babe189c4 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:16.395972 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6622208b-e4f5-4642-896a-fff168460137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:16.397279 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622208b-e4f5-4642-896a-fff168460137 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:16.397615 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622208b-e4f5-4642-896a-fff168460137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:16.398065 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622208b-e4f5-4642-896a-fff168460137 admin admin] PATH_INFO: `/v3/projects/0c4f6e54262d4e34bf6cdd82d4c78e7d` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:16.399594 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6622208b-e4f5-4642-896a-fff168460137 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c4f6e54262d4e34bf6cdd82d4c78e7d)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:16.402297 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f082a47-5370-441a-af73-a5421e14368d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:16.403558 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f082a47-5370-441a-af73-a5421e14368d admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:16.403830 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f082a47-5370-441a-af73-a5421e14368d admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:16.404021 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6622208b-e4f5-4642-896a-fff168460137 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:16.404183 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f082a47-5370-441a-af73-a5421e14368d admin admin] PATH_INFO: `/v3/projects/6b65076e32374bc2b6e18962d77ea8f1/users/6e86b3c7d5f64006ac041c30ab4c639b/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:16.425946 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f082a47-5370-441a-af73-a5421e14368d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b65076e32374bc2b6e18962d77ea8f1, user_id=6e86b3c7d5f64006ac041c30ab4c639b, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:16.430023 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f082a47-5370-441a-af73-a5421e14368d admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:16.453050 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1015/2033] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:22:16 2022] PUT /identity/v3/projects/6b65076e32374bc2b6e18962d77ea8f1/users/6e86b3c7d5f64006ac041c30ab4c639b/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:16.465281 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4eb62-39f3-4862-b107-a1d70e84e203 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:16.465860 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4eb62-39f3-4862-b107-a1d70e84e203 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:16.466601 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4eb62-39f3-4862-b107-a1d70e84e203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:16.480457 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6622208b-e4f5-4642-896a-fff168460137 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c4f6e54262d4e34bf6cdd82d4c78e7d', 'request_id': 'req-6622208b-e4f5-4642-896a-fff168460137'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:16.489390 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6622208b-e4f5-4642-896a-fff168460137 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c4f6e54262d4e34bf6cdd82d4c78e7d', 'request_id': 'req-6622208b-e4f5-4642-896a-fff168460137'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:16.503267 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6622208b-e4f5-4642-896a-fff168460137 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c4f6e54262d4e34bf6cdd82d4c78e7d', 'request_id': 'req-6622208b-e4f5-4642-896a-fff168460137'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:16.528560 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-3cc4eb62-39f3-4862-b107-a1d70e84e203 None None] MFA Rules not processed for user `6e86b3c7d5f64006ac041c30ab4c639b`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:16.529907 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-3cc4eb62-39f3-4862-b107-a1d70e84e203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:16.537818 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6622208b-e4f5-4642-896a-fff168460137 admin admin] The token cache is being invalidate because project 0c4f6e54262d4e34bf6cdd82d4c78e7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:22:16.538266 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6622208b-e4f5-4642-896a-fff168460137 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:16.539468 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6622208b-e4f5-4642-896a-fff168460137 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:16.545265 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1019/2034] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:22:16 2022] DELETE /identity/v3/projects/0c4f6e54262d4e34bf6cdd82d4c78e7d => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:16.551051 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ede7f-0052-4057-9fef-ab40591fc29d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:16.551628 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ede7f-0052-4057-9fef-ab40591fc29d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:16.552290 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ede7f-0052-4057-9fef-ab40591fc29d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:16.591279 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-a57ede7f-0052-4057-9fef-ab40591fc29d None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:16.593390 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a57ede7f-0052-4057-9fef-ab40591fc29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:16.673668 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1016/2035] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:22:16.678895 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc4eb62-39f3-4862-b107-a1d70e84e203 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:16.681094 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-3cc4eb62-39f3-4862-b107-a1d70e84e203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:16.713214 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1020/2036] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:16.721116 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872adeb-0545-4782-bbcb-3068650a0b72 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:16.721406 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872adeb-0545-4782-bbcb-3068650a0b72 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:16.721708 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872adeb-0545-4782-bbcb-3068650a0b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:16.744333 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f872adeb-0545-4782-bbcb-3068650a0b72 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:16.745817 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f872adeb-0545-4782-bbcb-3068650a0b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:16.762613 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1021/2037] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:22:16.765621 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f872adeb-0545-4782-bbcb-3068650a0b72 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:16.777129 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc4eb62-39f3-4862-b107-a1d70e84e203 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:16.783222 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb85192-4258-45c1-9509-bb332e4eaeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:16.783561 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f872adeb-0545-4782-bbcb-3068650a0b72 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:16.783869 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb85192-4258-45c1-9509-bb332e4eaeb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:16.784250 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb85192-4258-45c1-9509-bb332e4eaeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:16.784627 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb85192-4258-45c1-9509-bb332e4eaeb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:16.785479 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb85192-4258-45c1-9509-bb332e4eaeb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:16.787816 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb85192-4258-45c1-9509-bb332e4eaeb2 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:16.792564 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe5993f-35f5-401a-8096-493eef60c920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:16.794224 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5993f-35f5-401a-8096-493eef60c920 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:16.794224 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5993f-35f5-401a-8096-493eef60c920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:16.794838 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5993f-35f5-401a-8096-493eef60c920 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:16.796149 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe5993f-35f5-401a-8096-493eef60c920 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:22:16.796605 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe5993f-35f5-401a-8096-493eef60c920 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:16.800694 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe5993f-35f5-401a-8096-493eef60c920 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:16.824378 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1017/2038] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:22:16 2022] POST /identity/v3/projects => generated 371 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:16.825360 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1022/2039] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:22:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:22:16.826076 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb85192-4258-45c1-9509-bb332e4eaeb2 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:16.831837 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe5993f-35f5-401a-8096-493eef60c920 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:16.851747 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe5993f-35f5-401a-8096-493eef60c920 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:16.900694 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:16.921515 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:16.934303 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb85192-4258-45c1-9509-bb332e4eaeb2 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:16.942099 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706eb89-4dc4-4ffb-b48e-5e2d5404d2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:16.942936 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706eb89-4dc4-4ffb-b48e-5e2d5404d2c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:16.943382 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706eb89-4dc4-4ffb-b48e-5e2d5404d2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:16.943655 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706eb89-4dc4-4ffb-b48e-5e2d5404d2c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:16.944598 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a706eb89-4dc4-4ffb-b48e-5e2d5404d2c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:16.946990 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a706eb89-4dc4-4ffb-b48e-5e2d5404d2c1 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:16.955802 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52804a9-3477-4d5c-ab26-9a1e18db7017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:16.956554 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52804a9-3477-4d5c-ab26-9a1e18db7017 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:16.956764 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52804a9-3477-4d5c-ab26-9a1e18db7017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:16.957095 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52804a9-3477-4d5c-ab26-9a1e18db7017 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:16.958013 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52804a9-3477-4d5c-ab26-9a1e18db7017 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:16.961773 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52804a9-3477-4d5c-ab26-9a1e18db7017 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:16.971866 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1018/2040] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:22:16 2022] POST /identity/v3/users => generated 292 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:16.972907 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706eb89-4dc4-4ffb-b48e-5e2d5404d2c1 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:16.975676 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a706eb89-4dc4-4ffb-b48e-5e2d5404d2c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:16.989263 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706eb89-4dc4-4ffb-b48e-5e2d5404d2c1 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:16.996381 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d0a4e-2382-4402-945a-3b4a09868c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:16.997526 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d0a4e-2382-4402-945a-3b4a09868c4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:16.997873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d0a4e-2382-4402-945a-3b4a09868c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:16.998053 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1023/2041] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:22:16 2022] POST /identity/v3/projects => generated 385 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:16.998330 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d0a4e-2382-4402-945a-3b4a09868c4d admin admin] PATH_INFO: `/v3/projects/ed2727baa5ab4eee954b96b1f69d6355` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:16.998927 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52804a9-3477-4d5c-ab26-9a1e18db7017 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:17.002262 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726d0a4e-2382-4402-945a-3b4a09868c4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed2727baa5ab4eee954b96b1f69d6355)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:17.002730 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f52804a9-3477-4d5c-ab26-9a1e18db7017 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:17.004205 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726d0a4e-2382-4402-945a-3b4a09868c4d admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:17.117603 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-726d0a4e-2382-4402-945a-3b4a09868c4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed2727baa5ab4eee954b96b1f69d6355', 'request_id': 'req-726d0a4e-2382-4402-945a-3b4a09868c4d'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:17.129317 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-726d0a4e-2382-4402-945a-3b4a09868c4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed2727baa5ab4eee954b96b1f69d6355', 'request_id': 'req-726d0a4e-2382-4402-945a-3b4a09868c4d'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:17.135986 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52804a9-3477-4d5c-ab26-9a1e18db7017 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:17.146114 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-726d0a4e-2382-4402-945a-3b4a09868c4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed2727baa5ab4eee954b96b1f69d6355', 'request_id': 'req-726d0a4e-2382-4402-945a-3b4a09868c4d'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:17.172784 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-726d0a4e-2382-4402-945a-3b4a09868c4d admin admin] The token cache is being invalidate because project ed2727baa5ab4eee954b96b1f69d6355 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:22:17.173441 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-726d0a4e-2382-4402-945a-3b4a09868c4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:17.174587 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-726d0a4e-2382-4402-945a-3b4a09868c4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:17.180014 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1019/2042] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:22:16 2022] DELETE /identity/v3/projects/ed2727baa5ab4eee954b96b1f69d6355 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:17.181331 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d0a4e-2382-4402-945a-3b4a09868c4d admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:17.184048 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-726d0a4e-2382-4402-945a-3b4a09868c4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:17.243597 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617fa60-c59c-43ed-a1da-813736ee8510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:17.244732 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617fa60-c59c-43ed-a1da-813736ee8510 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:17.246074 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617fa60-c59c-43ed-a1da-813736ee8510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:17.246544 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617fa60-c59c-43ed-a1da-813736ee8510 admin admin] PATH_INFO: `/v3/projects/fc95b99e2c794bc0a278f82075b09656` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:17.248207 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e617fa60-c59c-43ed-a1da-813736ee8510 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc95b99e2c794bc0a278f82075b09656)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:17.250415 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e617fa60-c59c-43ed-a1da-813736ee8510 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:17.290777 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d0a4e-2382-4402-945a-3b4a09868c4d admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:17.298364 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a11be-dd31-4068-92be-ab0ba93c1ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:17.299272 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a11be-dd31-4068-92be-ab0ba93c1ea7 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:17.299659 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a11be-dd31-4068-92be-ab0ba93c1ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:17.300057 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a11be-dd31-4068-92be-ab0ba93c1ea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:17.300869 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198a11be-dd31-4068-92be-ab0ba93c1ea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:17.302902 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198a11be-dd31-4068-92be-ab0ba93c1ea7 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:17.316684 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1020/2043] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:17.317761 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a11be-dd31-4068-92be-ab0ba93c1ea7 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:17.319632 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-198a11be-dd31-4068-92be-ab0ba93c1ea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:17.321486 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e617fa60-c59c-43ed-a1da-813736ee8510 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc95b99e2c794bc0a278f82075b09656', 'request_id': 'req-e617fa60-c59c-43ed-a1da-813736ee8510'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:17.333798 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e617fa60-c59c-43ed-a1da-813736ee8510 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc95b99e2c794bc0a278f82075b09656', 'request_id': 'req-e617fa60-c59c-43ed-a1da-813736ee8510'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:17.334469 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a11be-dd31-4068-92be-ab0ba93c1ea7 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:17.345293 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e617fa60-c59c-43ed-a1da-813736ee8510 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc95b99e2c794bc0a278f82075b09656', 'request_id': 'req-e617fa60-c59c-43ed-a1da-813736ee8510'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:17.366398 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e617fa60-c59c-43ed-a1da-813736ee8510 admin admin] The token cache is being invalidate because project fc95b99e2c794bc0a278f82075b09656 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:22:17.367192 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e617fa60-c59c-43ed-a1da-813736ee8510 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:17.368074 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e617fa60-c59c-43ed-a1da-813736ee8510 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:17.370769 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1024/2044] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:22:16 2022] DELETE /identity/v3/projects/fc95b99e2c794bc0a278f82075b09656 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:17.371857 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617fa60-c59c-43ed-a1da-813736ee8510 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:17.373363 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e617fa60-c59c-43ed-a1da-813736ee8510 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:17.380588 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:17.402717 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:17.425920 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d026f-5d24-49db-8c5c-a78a4197d815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:17.426638 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d026f-5d24-49db-8c5c-a78a4197d815 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:17.426955 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d026f-5d24-49db-8c5c-a78a4197d815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:17.427206 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d026f-5d24-49db-8c5c-a78a4197d815 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:17.428577 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d026f-5d24-49db-8c5c-a78a4197d815 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:17.430563 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d026f-5d24-49db-8c5c-a78a4197d815 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:17.457565 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1021/2045] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:22:17 2022] POST /identity/v3/users => generated 293 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:17.458858 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d026f-5d24-49db-8c5c-a78a4197d815 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:17.462279 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-7f4d026f-5d24-49db-8c5c-a78a4197d815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:17.482159 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617fa60-c59c-43ed-a1da-813736ee8510 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:17.484674 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d24f0-777f-4364-b04c-228ee30488d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:17.485834 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d24f0-777f-4364-b04c-228ee30488d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:17.486103 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d24f0-777f-4364-b04c-228ee30488d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:17.486488 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d24f0-777f-4364-b04c-228ee30488d2 admin admin] PATH_INFO: `/v3/users/ae37761df5794ec9b8ccf51bc28ec587` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:17.487171 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d026f-5d24-49db-8c5c-a78a4197d815 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:17.488126 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54d24f0-777f-4364-b04c-228ee30488d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae37761df5794ec9b8ccf51bc28ec587)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:17.490295 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54d24f0-777f-4364-b04c-228ee30488d2 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:17.494567 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce37d2f-3374-4c76-92f0-23fbb188e0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:17.496150 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce37d2f-3374-4c76-92f0-23fbb188e0d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:17.496557 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce37d2f-3374-4c76-92f0-23fbb188e0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:17.497088 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce37d2f-3374-4c76-92f0-23fbb188e0d4 admin admin] PATH_INFO: `/v3/projects/80c9ab48f5fb46f083c325cbe1f971a1/users/ee907435b8b64b9192e4bcc1930f1c0a/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:17.514805 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce37d2f-3374-4c76-92f0-23fbb188e0d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80c9ab48f5fb46f083c325cbe1f971a1, user_id=ee907435b8b64b9192e4bcc1930f1c0a, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:17.517568 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce37d2f-3374-4c76-92f0-23fbb188e0d4 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:17.534699 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1022/2046] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:22:17 2022] PUT /identity/v3/projects/80c9ab48f5fb46f083c325cbe1f971a1/users/ee907435b8b64b9192e4bcc1930f1c0a/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:17.536646 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7723b2-92de-44e6-a6ed-9ac9d0a9305d None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:17.536646 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7723b2-92de-44e6-a6ed-9ac9d0a9305d None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:17.536646 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7723b2-92de-44e6-a6ed-9ac9d0a9305d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:17.554170 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d54d24f0-777f-4364-b04c-228ee30488d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae37761df5794ec9b8ccf51bc28ec587'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:17.555040 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d54d24f0-777f-4364-b04c-228ee30488d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae37761df5794ec9b8ccf51bc28ec587'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:17.555620 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d54d24f0-777f-4364-b04c-228ee30488d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae37761df5794ec9b8ccf51bc28ec587'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:17.556242 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-ea7723b2-92de-44e6-a6ed-9ac9d0a9305d None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:17.557613 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ea7723b2-92de-44e6-a6ed-9ac9d0a9305d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:17.573872 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d54d24f0-777f-4364-b04c-228ee30488d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae37761df5794ec9b8ccf51bc28ec587'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:17.584286 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d54d24f0-777f-4364-b04c-228ee30488d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae37761df5794ec9b8ccf51bc28ec587'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:17.606693 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1025/2047] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:22:17 2022] DELETE /identity/v3/users/ae37761df5794ec9b8ccf51bc28ec587 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:17.607473 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d24f0-777f-4364-b04c-228ee30488d2 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:17.609309 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d54d24f0-777f-4364-b04c-228ee30488d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:17.651596 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1023/2048] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:17.657286 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7723b2-92de-44e6-a6ed-9ac9d0a9305d None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:17.663006 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ea7723b2-92de-44e6-a6ed-9ac9d0a9305d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:17.684531 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7723b2-92de-44e6-a6ed-9ac9d0a9305d None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:17.763508 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d24f0-777f-4364-b04c-228ee30488d2 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:17.774080 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618083f-122c-43d5-9fc6-ab2911a612a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:17.775669 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618083f-122c-43d5-9fc6-ab2911a612a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:17.776298 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618083f-122c-43d5-9fc6-ab2911a612a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:17.777561 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618083f-122c-43d5-9fc6-ab2911a612a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:17.779098 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e618083f-122c-43d5-9fc6-ab2911a612a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:17.782345 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e618083f-122c-43d5-9fc6-ab2911a612a6 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:17.802037 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1026/2049] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:17.803868 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8152de-f3b1-489b-aa00-bd366c040267 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:17.804169 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8152de-f3b1-489b-aa00-bd366c040267 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:17.804454 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8152de-f3b1-489b-aa00-bd366c040267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:17.811209 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3146ec5-f908-447b-9c11-206c33b468a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:17.816691 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3146ec5-f908-447b-9c11-206c33b468a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:17.817718 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3146ec5-f908-447b-9c11-206c33b468a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:17.818655 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3146ec5-f908-447b-9c11-206c33b468a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:17.820924 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3146ec5-f908-447b-9c11-206c33b468a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:17.826428 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3146ec5-f908-447b-9c11-206c33b468a0 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:17.829846 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-ae8152de-f3b1-489b-aa00-bd366c040267 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:17.831114 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ae8152de-f3b1-489b-aa00-bd366c040267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:17.842560 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1027/2050] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:17.844709 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8152de-f3b1-489b-aa00-bd366c040267 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:17.858250 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1024/2051] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:17.860744 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3146ec5-f908-447b-9c11-206c33b468a0 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:17.864768 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8152de-f3b1-489b-aa00-bd366c040267 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:17.873548 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d544b-80ef-4898-a1e8-9720a36be892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:17.874990 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d544b-80ef-4898-a1e8-9720a36be892 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:17.875677 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d544b-80ef-4898-a1e8-9720a36be892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:17.876171 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d544b-80ef-4898-a1e8-9720a36be892 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:17.877598 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d544b-80ef-4898-a1e8-9720a36be892 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:17.880494 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d544b-80ef-4898-a1e8-9720a36be892 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:17.881023 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3146ec5-f908-447b-9c11-206c33b468a0 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:17.891232 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e33e7-192e-4d7c-936b-7a461d04a6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:17.893557 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e33e7-192e-4d7c-936b-7a461d04a6f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:17.894040 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e33e7-192e-4d7c-936b-7a461d04a6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:17.894534 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e33e7-192e-4d7c-936b-7a461d04a6f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:17.897418 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e33e7-192e-4d7c-936b-7a461d04a6f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:22:17.897418 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e33e7-192e-4d7c-936b-7a461d04a6f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:17.903140 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1028/2052] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:17.903304 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e33e7-192e-4d7c-936b-7a461d04a6f4 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:17.903460 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d544b-80ef-4898-a1e8-9720a36be892 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:17.906793 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:17.913634 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d544b-80ef-4898-a1e8-9720a36be892 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:17.922014 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a89a5d-3cde-4273-813f-ccb7a46fbb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:17.923932 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a89a5d-3cde-4273-813f-ccb7a46fbb20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:17.924449 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1025/2053] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:22:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:22:17.924998 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a89a5d-3cde-4273-813f-ccb7a46fbb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:17.925487 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a89a5d-3cde-4273-813f-ccb7a46fbb20 admin admin] PATH_INFO: `/v3/projects/80c9ab48f5fb46f083c325cbe1f971a1/users/ee907435b8b64b9192e4bcc1930f1c0a/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:17.925883 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e33e7-192e-4d7c-936b-7a461d04a6f4 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:17.929524 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a89a5d-3cde-4273-813f-ccb7a46fbb20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80c9ab48f5fb46f083c325cbe1f971a1, user_id=ee907435b8b64b9192e4bcc1930f1c0a, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:17.934047 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a89a5d-3cde-4273-813f-ccb7a46fbb20 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:17.944165 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e33e7-192e-4d7c-936b-7a461d04a6f4 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:17.948845 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1029/2054] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:22:17 2022] PUT /identity/v3/projects/80c9ab48f5fb46f083c325cbe1f971a1/users/ee907435b8b64b9192e4bcc1930f1c0a/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:17.949845 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a89a5d-3cde-4273-813f-ccb7a46fbb20 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:17.962239 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-19a89a5d-3cde-4273-813f-ccb7a46fbb20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:17.995826 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:18.042690 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51824387-2546-48d4-b4bc-a332cc1ec105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:18.043712 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51824387-2546-48d4-b4bc-a332cc1ec105 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:18.044062 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51824387-2546-48d4-b4bc-a332cc1ec105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:18.044398 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51824387-2546-48d4-b4bc-a332cc1ec105 admin admin] PATH_INFO: `/v3/projects/a28b81df48bb4a10a2bd9d0b81ee1eec/users/76398f7311be4747a9771eaf3fad2f44/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:18.062408 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51824387-2546-48d4-b4bc-a332cc1ec105 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a28b81df48bb4a10a2bd9d0b81ee1eec, user_id=76398f7311be4747a9771eaf3fad2f44, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:18.066886 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51824387-2546-48d4-b4bc-a332cc1ec105 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:18.079713 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a89a5d-3cde-4273-813f-ccb7a46fbb20 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:18.087017 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1026/2055] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:22:17 2022] PUT /identity/v3/projects/a28b81df48bb4a10a2bd9d0b81ee1eec/users/76398f7311be4747a9771eaf3fad2f44/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:18.088070 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51824387-2546-48d4-b4bc-a332cc1ec105 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:18.154477 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492a46c-2282-4115-8540-a0265739e9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:18.155382 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492a46c-2282-4115-8540-a0265739e9d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:18.155670 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492a46c-2282-4115-8540-a0265739e9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:18.155975 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492a46c-2282-4115-8540-a0265739e9d2 admin admin] PATH_INFO: `/v3/users/283328bb73fa4a658530d0f24579cd6e` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:18.157297 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d492a46c-2282-4115-8540-a0265739e9d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=283328bb73fa4a658530d0f24579cd6e)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:18.159379 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d492a46c-2282-4115-8540-a0265739e9d2 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:18.170462 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51824387-2546-48d4-b4bc-a332cc1ec105 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:18.175705 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8010c44b-8f3e-4953-827a-8a286f00e029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:18.176523 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010c44b-8f3e-4953-827a-8a286f00e029 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:18.177007 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010c44b-8f3e-4953-827a-8a286f00e029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:18.177531 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010c44b-8f3e-4953-827a-8a286f00e029 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:18.178396 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8010c44b-8f3e-4953-827a-8a286f00e029 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:18.181081 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8010c44b-8f3e-4953-827a-8a286f00e029 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:18.223630 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1027/2056] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:22:18 2022] POST /identity/v3/projects => generated 373 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:18.223630 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13baaaaf-4a2c-4cba-beff-49bbc1ab591d None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:18.223630 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13baaaaf-4a2c-4cba-beff-49bbc1ab591d None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:18.223630 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13baaaaf-4a2c-4cba-beff-49bbc1ab591d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:18.233027 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d492a46c-2282-4115-8540-a0265739e9d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '283328bb73fa4a658530d0f24579cd6e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:18.234802 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d492a46c-2282-4115-8540-a0265739e9d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '283328bb73fa4a658530d0f24579cd6e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:18.235152 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d492a46c-2282-4115-8540-a0265739e9d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '283328bb73fa4a658530d0f24579cd6e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:18.255457 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d492a46c-2282-4115-8540-a0265739e9d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '283328bb73fa4a658530d0f24579cd6e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:18.266006 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-13baaaaf-4a2c-4cba-beff-49bbc1ab591d None None] MFA Rules not processed for user `ee907435b8b64b9192e4bcc1930f1c0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:18.268161 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-13baaaaf-4a2c-4cba-beff-49bbc1ab591d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:18.272712 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d492a46c-2282-4115-8540-a0265739e9d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '283328bb73fa4a658530d0f24579cd6e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:18.294602 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1030/2057] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:22:17 2022] DELETE /identity/v3/users/283328bb73fa4a658530d0f24579cd6e => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:18.295895 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492a46c-2282-4115-8540-a0265739e9d2 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:18.299319 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d492a46c-2282-4115-8540-a0265739e9d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:18.322997 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:18.377090 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1028/2058] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:18 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:18.378584 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0fb8eb-2140-4efe-b476-f27c304f4a54 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:18.378992 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0fb8eb-2140-4efe-b476-f27c304f4a54 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:18.379372 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0fb8eb-2140-4efe-b476-f27c304f4a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:18.403143 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492a46c-2282-4115-8540-a0265739e9d2 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:18.409243 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c1147e-6fa1-4a1a-acf3-603973359753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:18.410174 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1147e-6fa1-4a1a-acf3-603973359753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:18.410451 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1147e-6fa1-4a1a-acf3-603973359753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:18.410724 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1147e-6fa1-4a1a-acf3-603973359753 admin admin] PATH_INFO: `/v3/projects/49c9977d02a54f27bf8b3a689573821b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:18.412189 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c1147e-6fa1-4a1a-acf3-603973359753 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49c9977d02a54f27bf8b3a689573821b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:18.415508 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c1147e-6fa1-4a1a-acf3-603973359753 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:18.417610 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-ec0fb8eb-2140-4efe-b476-f27c304f4a54 None None] MFA Rules not processed for user `76398f7311be4747a9771eaf3fad2f44`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:18.418966 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ec0fb8eb-2140-4efe-b476-f27c304f4a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:18.438730 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:18.487970 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-70c1147e-6fa1-4a1a-acf3-603973359753 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49c9977d02a54f27bf8b3a689573821b', 'request_id': 'req-70c1147e-6fa1-4a1a-acf3-603973359753'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:18.496392 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-70c1147e-6fa1-4a1a-acf3-603973359753 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49c9977d02a54f27bf8b3a689573821b', 'request_id': 'req-70c1147e-6fa1-4a1a-acf3-603973359753'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:18.512156 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-70c1147e-6fa1-4a1a-acf3-603973359753 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49c9977d02a54f27bf8b3a689573821b', 'request_id': 'req-70c1147e-6fa1-4a1a-acf3-603973359753'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:18.517492 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1029/2059] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:18.523778 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0fb8eb-2140-4efe-b476-f27c304f4a54 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:18.523778 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ec0fb8eb-2140-4efe-b476-f27c304f4a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:18.540127 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0fb8eb-2140-4efe-b476-f27c304f4a54 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:18.541627 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-70c1147e-6fa1-4a1a-acf3-603973359753 admin admin] The token cache is being invalidate because project 49c9977d02a54f27bf8b3a689573821b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:22:18.543177 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-70c1147e-6fa1-4a1a-acf3-603973359753 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:18.544172 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-70c1147e-6fa1-4a1a-acf3-603973359753 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:18.546810 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1031/2060] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:22:18 2022] DELETE /identity/v3/projects/49c9977d02a54f27bf8b3a689573821b => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:18.548718 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d723a-935a-4936-b062-5f471f569148 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:18.548882 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d723a-935a-4936-b062-5f471f569148 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:18.549161 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d723a-935a-4936-b062-5f471f569148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:18.570973 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-9e2d723a-935a-4936-b062-5f471f569148 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:18.572284 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9e2d723a-935a-4936-b062-5f471f569148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:18.653577 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f257f71-72a7-4c7a-96e8-9383e08251a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:18.654619 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f257f71-72a7-4c7a-96e8-9383e08251a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:18.655034 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f257f71-72a7-4c7a-96e8-9383e08251a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:18.655628 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f257f71-72a7-4c7a-96e8-9383e08251a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:18.656391 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f257f71-72a7-4c7a-96e8-9383e08251a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:18.659155 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f257f71-72a7-4c7a-96e8-9383e08251a3 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:18.675838 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1032/2061] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:18.678084 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d723a-935a-4936-b062-5f471f569148 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:18.683864 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9e2d723a-935a-4936-b062-5f471f569148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:18.711409 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1030/2062] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:22:18 2022] POST /identity/v3/users => generated 287 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:18.711409 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f257f71-72a7-4c7a-96e8-9383e08251a3 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:18.711409 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-7f257f71-72a7-4c7a-96e8-9383e08251a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:18.734976 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f257f71-72a7-4c7a-96e8-9383e08251a3 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:18.743274 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada32f50-8abc-4088-a001-e990135eb4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:18.744463 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada32f50-8abc-4088-a001-e990135eb4af admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:18.744662 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada32f50-8abc-4088-a001-e990135eb4af admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:18.745177 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada32f50-8abc-4088-a001-e990135eb4af admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:18.746273 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada32f50-8abc-4088-a001-e990135eb4af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:18.750259 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada32f50-8abc-4088-a001-e990135eb4af admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:18.798377 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1031/2063] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:22:18 2022] POST /identity/v3/projects => generated 387 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:18.799914 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207509c-1ba8-4d27-bdd0-1a22a721dcf4 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:18.800294 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207509c-1ba8-4d27-bdd0-1a22a721dcf4 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:18.800591 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207509c-1ba8-4d27-bdd0-1a22a721dcf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:18.803554 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:18.820099 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d723a-935a-4936-b062-5f471f569148 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:18.829254 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-6207509c-1ba8-4d27-bdd0-1a22a721dcf4 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:18.831382 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-6207509c-1ba8-4d27-bdd0-1a22a721dcf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:18.911312 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8064011-b069-48e9-af60-a383c98aa776 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:18.912641 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8064011-b069-48e9-af60-a383c98aa776 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:18.913422 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8064011-b069-48e9-af60-a383c98aa776 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:18.913856 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8064011-b069-48e9-af60-a383c98aa776 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:18.918161 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e8064011-b069-48e9-af60-a383c98aa776 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:18.947691 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1032/2064] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:18.949003 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207509c-1ba8-4d27-bdd0-1a22a721dcf4 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:18.960749 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-6207509c-1ba8-4d27-bdd0-1a22a721dcf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:19.009992 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:19.017066 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8064011-b069-48e9-af60-a383c98aa776 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:19.019614 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8064011-b069-48e9-af60-a383c98aa776 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:19.054765 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1033/2065] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:22:19.056723 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8064011-b069-48e9-af60-a383c98aa776 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:19.058852 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e8064011-b069-48e9-af60-a383c98aa776 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:19.066548 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207509c-1ba8-4d27-bdd0-1a22a721dcf4 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:19.071751 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33262a87-8721-4584-8314-d908b6169f76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:19.072045 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33262a87-8721-4584-8314-d908b6169f76 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:19.072328 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33262a87-8721-4584-8314-d908b6169f76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:19.072605 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33262a87-8721-4584-8314-d908b6169f76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:19.089897 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33262a87-8721-4584-8314-d908b6169f76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:19.093104 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8064011-b069-48e9-af60-a383c98aa776 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:19.093348 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33262a87-8721-4584-8314-d908b6169f76 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:19.098778 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cda839-7cb0-4a0a-9624-3aed1644712b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:19.100435 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cda839-7cb0-4a0a-9624-3aed1644712b admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:19.100857 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cda839-7cb0-4a0a-9624-3aed1644712b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:19.101230 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cda839-7cb0-4a0a-9624-3aed1644712b admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:19.102139 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cda839-7cb0-4a0a-9624-3aed1644712b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:19.104336 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cda839-7cb0-4a0a-9624-3aed1644712b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:19.116127 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1033/2066] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:22:19.117623 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33262a87-8721-4584-8314-d908b6169f76 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:19.133505 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33262a87-8721-4584-8314-d908b6169f76 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:19.136057 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1034/2067] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:19.143055 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8978d1-1d58-41c2-92f8-f3ffba2381fb None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:19.145866 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8978d1-1d58-41c2-92f8-f3ffba2381fb None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:19.147360 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8978d1-1d58-41c2-92f8-f3ffba2381fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:19.147519 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f05f739-ffe7-4bae-81aa-bcd3b0bea04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:19.148561 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05f739-ffe7-4bae-81aa-bcd3b0bea04e admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:19.149033 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05f739-ffe7-4bae-81aa-bcd3b0bea04e admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:19.149585 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05f739-ffe7-4bae-81aa-bcd3b0bea04e admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:19.150684 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f05f739-ffe7-4bae-81aa-bcd3b0bea04e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:19.154889 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f05f739-ffe7-4bae-81aa-bcd3b0bea04e admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:19.192369 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1034/2068] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:22:19 2022] POST /identity/v3/users => generated 300 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:19.194011 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f05f739-ffe7-4bae-81aa-bcd3b0bea04e admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:19.200057 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-da8978d1-1d58-41c2-92f8-f3ffba2381fb None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:19.203729 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-da8978d1-1d58-41c2-92f8-f3ffba2381fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:19.218912 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f05f739-ffe7-4bae-81aa-bcd3b0bea04e admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:19.228884 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1035/2069] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:19.230105 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8978d1-1d58-41c2-92f8-f3ffba2381fb None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:19.238809 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f65319-d278-4531-9635-9e151324f890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:19.242434 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f65319-d278-4531-9635-9e151324f890 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:19.242886 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f65319-d278-4531-9635-9e151324f890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:19.243714 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f65319-d278-4531-9635-9e151324f890 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:19.246698 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f65319-d278-4531-9635-9e151324f890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:19.249220 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8978d1-1d58-41c2-92f8-f3ffba2381fb None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:19.252280 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f65319-d278-4531-9635-9e151324f890 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:19.265242 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c182c1d-be53-433c-a19b-9d4b2e8574f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:19.267146 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c182c1d-be53-433c-a19b-9d4b2e8574f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:19.268940 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c182c1d-be53-433c-a19b-9d4b2e8574f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:19.269533 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c182c1d-be53-433c-a19b-9d4b2e8574f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:19.270596 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c182c1d-be53-433c-a19b-9d4b2e8574f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:19.274685 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c182c1d-be53-433c-a19b-9d4b2e8574f4 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:19.282650 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1035/2070] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:19.286558 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f65319-d278-4531-9635-9e151324f890 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:19.306748 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1036/2071] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:19.308355 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c182c1d-be53-433c-a19b-9d4b2e8574f4 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:19.321420 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c182c1d-be53-433c-a19b-9d4b2e8574f4 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:19.326558 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f65319-d278-4531-9635-9e151324f890 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:19.327223 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f850216-ee92-475d-8fde-7c8bb164789f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:19.328908 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f850216-ee92-475d-8fde-7c8bb164789f admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:19.329323 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f850216-ee92-475d-8fde-7c8bb164789f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:19.329722 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f850216-ee92-475d-8fde-7c8bb164789f admin admin] PATH_INFO: `/v3/projects/a9050e4aef3f4054a8261568bf3e2a05/users/673917b0145c4cedacdc5fbba2c465e5/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:19.341378 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25441478-e95b-4bd4-8fa7-343832ad7b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:19.345786 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25441478-e95b-4bd4-8fa7-343832ad7b73 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:19.350801 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25441478-e95b-4bd4-8fa7-343832ad7b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:19.351556 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25441478-e95b-4bd4-8fa7-343832ad7b73 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:19.354331 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25441478-e95b-4bd4-8fa7-343832ad7b73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:22:19.354331 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25441478-e95b-4bd4-8fa7-343832ad7b73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:19.356807 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25441478-e95b-4bd4-8fa7-343832ad7b73 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:19.376561 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f850216-ee92-475d-8fde-7c8bb164789f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9050e4aef3f4054a8261568bf3e2a05, user_id=673917b0145c4cedacdc5fbba2c465e5, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:19.388455 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1036/2072] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:22:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:22:19.389461 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f850216-ee92-475d-8fde-7c8bb164789f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:19.389637 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25441478-e95b-4bd4-8fa7-343832ad7b73 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:19.442943 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1037/2073] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:22:19 2022] PUT /identity/v3/projects/a9050e4aef3f4054a8261568bf3e2a05/users/673917b0145c4cedacdc5fbba2c465e5/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:19.444558 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f850216-ee92-475d-8fde-7c8bb164789f admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:19.459865 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25441478-e95b-4bd4-8fa7-343832ad7b73 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:19.605076 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f850216-ee92-475d-8fde-7c8bb164789f admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:19.614992 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80910ee-66f3-4953-846a-8d3c0e1b1ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:19.616259 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80910ee-66f3-4953-846a-8d3c0e1b1ea8 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:19.616760 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80910ee-66f3-4953-846a-8d3c0e1b1ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:19.617261 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80910ee-66f3-4953-846a-8d3c0e1b1ea8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:19.619048 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80910ee-66f3-4953-846a-8d3c0e1b1ea8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:19.623018 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80910ee-66f3-4953-846a-8d3c0e1b1ea8 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:19.652080 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:19.697018 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1344b0f-9cb2-43b7-bb5e-86d016447555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:19.698763 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1344b0f-9cb2-43b7-bb5e-86d016447555 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:19.699248 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1344b0f-9cb2-43b7-bb5e-86d016447555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:19.699808 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1344b0f-9cb2-43b7-bb5e-86d016447555 admin admin] PATH_INFO: `/v3/projects/f9b2f6c95b82432188c8b801bd329ec7/users/85dc0c8f24b04c87a0f46be88e235d73/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:19.713825 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1038/2074] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:22:19 2022] POST /identity/v3/projects => generated 407 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:19.717687 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019236a-a592-48fd-b1ea-81796a2ee368 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:19.718619 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019236a-a592-48fd-b1ea-81796a2ee368 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:19.719389 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019236a-a592-48fd-b1ea-81796a2ee368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:19.731592 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1344b0f-9cb2-43b7-bb5e-86d016447555 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9b2f6c95b82432188c8b801bd329ec7, user_id=85dc0c8f24b04c87a0f46be88e235d73, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:19.737932 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1344b0f-9cb2-43b7-bb5e-86d016447555 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:19.772642 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1037/2075] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:22:19 2022] PUT /identity/v3/projects/f9b2f6c95b82432188c8b801bd329ec7/users/85dc0c8f24b04c87a0f46be88e235d73/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:19.772642 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1344b0f-9cb2-43b7-bb5e-86d016447555 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:19.850891 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-5019236a-a592-48fd-b1ea-81796a2ee368 None None] MFA Rules not processed for user `673917b0145c4cedacdc5fbba2c465e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:19.853448 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5019236a-a592-48fd-b1ea-81796a2ee368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:19.934637 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1344b0f-9cb2-43b7-bb5e-86d016447555 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:19.953732 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1fb304-4436-4d49-b774-3dd4833f1597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:19.955201 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1fb304-4436-4d49-b774-3dd4833f1597 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:19.956332 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1fb304-4436-4d49-b774-3dd4833f1597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:19.957094 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1fb304-4436-4d49-b774-3dd4833f1597 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:19.958925 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1fb304-4436-4d49-b774-3dd4833f1597 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:19.967145 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1fb304-4436-4d49-b774-3dd4833f1597 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:20.001426 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:20.019748 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1038/2076] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:22:19 2022] POST /identity/v3/users => generated 304 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:20.020533 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1fb304-4436-4d49-b774-3dd4833f1597 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:20.049797 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1fb304-4436-4d49-b774-3dd4833f1597 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:20.052474 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1039/2077] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:20.054294 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5019236a-a592-48fd-b1ea-81796a2ee368 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:20.069624 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5019236a-a592-48fd-b1ea-81796a2ee368 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:20.075896 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1695051-6ad7-4481-9d9f-82f121ebceaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:20.076693 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1695051-6ad7-4481-9d9f-82f121ebceaa admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:20.076928 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32bdc1b-1a66-40af-ae6d-322dad98d967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:20.077061 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1695051-6ad7-4481-9d9f-82f121ebceaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:20.077310 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1695051-6ad7-4481-9d9f-82f121ebceaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:20.077669 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bdc1b-1a66-40af-ae6d-322dad98d967 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:20.077970 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bdc1b-1a66-40af-ae6d-322dad98d967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:20.078150 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1695051-6ad7-4481-9d9f-82f121ebceaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:20.078286 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bdc1b-1a66-40af-ae6d-322dad98d967 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:20.079074 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32bdc1b-1a66-40af-ae6d-322dad98d967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:20.079779 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1695051-6ad7-4481-9d9f-82f121ebceaa admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:20.080763 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32bdc1b-1a66-40af-ae6d-322dad98d967 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:20.092140 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1040/2078] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:20.096385 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1695051-6ad7-4481-9d9f-82f121ebceaa admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:20.107604 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1039/2079] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:20.108869 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32bdc1b-1a66-40af-ae6d-322dad98d967 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:20.132460 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32bdc1b-1a66-40af-ae6d-322dad98d967 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:20.145156 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8e4f7-3183-45ae-9a20-c283060a0600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:20.146295 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8e4f7-3183-45ae-9a20-c283060a0600 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:20.146891 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8e4f7-3183-45ae-9a20-c283060a0600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:20.148165 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8e4f7-3183-45ae-9a20-c283060a0600 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:20.151669 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc8e4f7-3183-45ae-9a20-c283060a0600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:20.154909 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc8e4f7-3183-45ae-9a20-c283060a0600 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:20.193530 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1040/2080] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:20.194693 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8e4f7-3183-45ae-9a20-c283060a0600 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:20.214791 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8e4f7-3183-45ae-9a20-c283060a0600 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:20.224031 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421bab0a-a109-40c5-bc19-4222d495b1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:20.225598 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bab0a-a109-40c5-bc19-4222d495b1ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:20.226100 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bab0a-a109-40c5-bc19-4222d495b1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:20.226592 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bab0a-a109-40c5-bc19-4222d495b1ed admin admin] PATH_INFO: `/v3/projects/f9b2f6c95b82432188c8b801bd329ec7/users/85dc0c8f24b04c87a0f46be88e235d73/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:20.229410 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1695051-6ad7-4481-9d9f-82f121ebceaa admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:20.230334 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421bab0a-a109-40c5-bc19-4222d495b1ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9b2f6c95b82432188c8b801bd329ec7, user_id=85dc0c8f24b04c87a0f46be88e235d73, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:20.235960 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421bab0a-a109-40c5-bc19-4222d495b1ed admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:20.237045 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034194f-e337-4d33-9851-57954b77cd20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:20.239917 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034194f-e337-4d33-9851-57954b77cd20 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:20.240591 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034194f-e337-4d33-9851-57954b77cd20 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:20.241378 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034194f-e337-4d33-9851-57954b77cd20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:20.256587 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d034194f-e337-4d33-9851-57954b77cd20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:20.257991 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1041/2081] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:22:20 2022] PUT /identity/v3/projects/f9b2f6c95b82432188c8b801bd329ec7/users/85dc0c8f24b04c87a0f46be88e235d73/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:20.258356 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d034194f-e337-4d33-9851-57954b77cd20 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:20.258968 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421bab0a-a109-40c5-bc19-4222d495b1ed admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:20.261589 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-421bab0a-a109-40c5-bc19-4222d495b1ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:20.272451 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1041/2082] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:22:20.273533 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034194f-e337-4d33-9851-57954b77cd20 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:20.289973 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034194f-e337-4d33-9851-57954b77cd20 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:20.397067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44799b4-678e-48ad-a2dd-ebb20b525138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:20.399390 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44799b4-678e-48ad-a2dd-ebb20b525138 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:20.400597 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44799b4-678e-48ad-a2dd-ebb20b525138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:20.400902 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44799b4-678e-48ad-a2dd-ebb20b525138 admin admin] PATH_INFO: `/v3/projects/bb9e171732904139816e631460cbabff/users/d159c0fd15684a1a9f3b85de98b3a409/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:20.426126 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421bab0a-a109-40c5-bc19-4222d495b1ed admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:20.444560 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3616790b-b2df-4ac3-806a-7e427822d020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:20.445652 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616790b-b2df-4ac3-806a-7e427822d020 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:20.445969 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616790b-b2df-4ac3-806a-7e427822d020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:20.446241 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616790b-b2df-4ac3-806a-7e427822d020 admin admin] PATH_INFO: `/v3/projects/dc9f9df47ba643078bdac3c1d2d1b1d1` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:20.448156 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3616790b-b2df-4ac3-806a-7e427822d020 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc9f9df47ba643078bdac3c1d2d1b1d1)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:20.450287 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3616790b-b2df-4ac3-806a-7e427822d020 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:20.453581 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44799b4-678e-48ad-a2dd-ebb20b525138 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb9e171732904139816e631460cbabff, user_id=d159c0fd15684a1a9f3b85de98b3a409, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:20.467344 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44799b4-678e-48ad-a2dd-ebb20b525138 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:20.470987 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:20.495124 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1042/2083] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:22:20 2022] PUT /identity/v3/projects/bb9e171732904139816e631460cbabff/users/d159c0fd15684a1a9f3b85de98b3a409/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:20.497124 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2ccf1-4498-4b85-8aed-16aa20861f2a None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:20.497743 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2ccf1-4498-4b85-8aed-16aa20861f2a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:20.498238 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2ccf1-4498-4b85-8aed-16aa20861f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:20.559846 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-9cb2ccf1-4498-4b85-8aed-16aa20861f2a None None] MFA Rules not processed for user `85dc0c8f24b04c87a0f46be88e235d73`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:20.560202 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3616790b-b2df-4ac3-806a-7e427822d020 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc9f9df47ba643078bdac3c1d2d1b1d1', 'request_id': 'req-3616790b-b2df-4ac3-806a-7e427822d020'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:20.562597 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9cb2ccf1-4498-4b85-8aed-16aa20861f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:20.568879 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3616790b-b2df-4ac3-806a-7e427822d020 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc9f9df47ba643078bdac3c1d2d1b1d1', 'request_id': 'req-3616790b-b2df-4ac3-806a-7e427822d020'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:20.581655 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3616790b-b2df-4ac3-806a-7e427822d020 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc9f9df47ba643078bdac3c1d2d1b1d1', 'request_id': 'req-3616790b-b2df-4ac3-806a-7e427822d020'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:20.596597 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3616790b-b2df-4ac3-806a-7e427822d020 admin admin] The token cache is being invalidate because project dc9f9df47ba643078bdac3c1d2d1b1d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:22:20.597161 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3616790b-b2df-4ac3-806a-7e427822d020 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:20.598374 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3616790b-b2df-4ac3-806a-7e427822d020 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:20.604030 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1042/2084] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:22:20 2022] DELETE /identity/v3/projects/dc9f9df47ba643078bdac3c1d2d1b1d1 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:20.605985 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd372e9a-5893-4f38-931e-f8b8cb65b00d None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:20.606285 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd372e9a-5893-4f38-931e-f8b8cb65b00d None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:20.607277 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd372e9a-5893-4f38-931e-f8b8cb65b00d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:20.642447 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-bd372e9a-5893-4f38-931e-f8b8cb65b00d None None] MFA Rules not processed for user `d159c0fd15684a1a9f3b85de98b3a409`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:20.643765 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-bd372e9a-5893-4f38-931e-f8b8cb65b00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:20.732264 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:20.781271 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1043/2085] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:20 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:20.782846 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2ccf1-4498-4b85-8aed-16aa20861f2a None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:20.785079 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9cb2ccf1-4498-4b85-8aed-16aa20861f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:20.813832 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1043/2086] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:20 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:20.813832 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd372e9a-5893-4f38-931e-f8b8cb65b00d None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:20.814596 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-bd372e9a-5893-4f38-931e-f8b8cb65b00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:20.923626 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2ccf1-4498-4b85-8aed-16aa20861f2a None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:20.926613 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd372e9a-5893-4f38-931e-f8b8cb65b00d None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:20.936702 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abf94f-4bc2-4da5-9863-6279ba9c6a7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:20.937489 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abf94f-4bc2-4da5-9863-6279ba9c6a7d service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:20.937839 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abf94f-4bc2-4da5-9863-6279ba9c6a7d service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:20.938656 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abf94f-4bc2-4da5-9863-6279ba9c6a7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:20.954549 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4abf94f-4bc2-4da5-9863-6279ba9c6a7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:20.957992 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4abf94f-4bc2-4da5-9863-6279ba9c6a7d service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:20.972544 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8699a1f-0dc6-4fdc-8d03-bc54f1c00db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:20.974966 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8699a1f-0dc6-4fdc-8d03-bc54f1c00db8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:20.975351 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8699a1f-0dc6-4fdc-8d03-bc54f1c00db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:20.975738 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8699a1f-0dc6-4fdc-8d03-bc54f1c00db8 admin admin] PATH_INFO: `/v3/users/5502cff34b1c46788024497e3cfe5972` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:20.978504 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1044/2087] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:20 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:22:20.979463 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abf94f-4bc2-4da5-9863-6279ba9c6a7d service cinder] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:20.979875 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8699a1f-0dc6-4fdc-8d03-bc54f1c00db8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5502cff34b1c46788024497e3cfe5972)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:20.983183 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8699a1f-0dc6-4fdc-8d03-bc54f1c00db8 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:20.996382 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a4abf94f-4bc2-4da5-9863-6279ba9c6a7d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:21.038279 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abf94f-4bc2-4da5-9863-6279ba9c6a7d service cinder] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:21.054805 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481fdfa4-2d12-4dde-be7d-05ed0841d1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:21.056616 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481fdfa4-2d12-4dde-be7d-05ed0841d1de admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:21.056616 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481fdfa4-2d12-4dde-be7d-05ed0841d1de admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:21.057829 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481fdfa4-2d12-4dde-be7d-05ed0841d1de admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:21.061585 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481fdfa4-2d12-4dde-be7d-05ed0841d1de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:21.069984 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481fdfa4-2d12-4dde-be7d-05ed0841d1de admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:21.144931 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b8699a1f-0dc6-4fdc-8d03-bc54f1c00db8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5502cff34b1c46788024497e3cfe5972'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:21.147175 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b8699a1f-0dc6-4fdc-8d03-bc54f1c00db8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5502cff34b1c46788024497e3cfe5972'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:21.148459 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b8699a1f-0dc6-4fdc-8d03-bc54f1c00db8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5502cff34b1c46788024497e3cfe5972'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:21.164617 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1045/2088] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:22:20 2022] POST /identity/v3/projects => generated 407 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:21.169991 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481fdfa4-2d12-4dde-be7d-05ed0841d1de admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:21.172162 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-481fdfa4-2d12-4dde-be7d-05ed0841d1de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:21.192148 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b8699a1f-0dc6-4fdc-8d03-bc54f1c00db8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5502cff34b1c46788024497e3cfe5972'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:21.215440 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b8699a1f-0dc6-4fdc-8d03-bc54f1c00db8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5502cff34b1c46788024497e3cfe5972'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:21.233630 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:21.252124 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1044/2089] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:22:20 2022] DELETE /identity/v3/users/5502cff34b1c46788024497e3cfe5972 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:21.337446 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481fdfa4-2d12-4dde-be7d-05ed0841d1de admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:21.416538 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8699a1f-0dc6-4fdc-8d03-bc54f1c00db8 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:21.418739 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b8699a1f-0dc6-4fdc-8d03-bc54f1c00db8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:21.448972 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870e7efd-7bea-42f8-a4cc-1bb385929946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:21.450741 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e7efd-7bea-42f8-a4cc-1bb385929946 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:21.451246 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e7efd-7bea-42f8-a4cc-1bb385929946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:21.451592 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e7efd-7bea-42f8-a4cc-1bb385929946 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:21.452553 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870e7efd-7bea-42f8-a4cc-1bb385929946 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:21.454993 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870e7efd-7bea-42f8-a4cc-1bb385929946 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:21.487809 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1046/2090] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:22:21 2022] POST /identity/v3/users => generated 310 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:21.492629 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870e7efd-7bea-42f8-a4cc-1bb385929946 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:21.500398 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:21.509639 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870e7efd-7bea-42f8-a4cc-1bb385929946 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:21.518512 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fbd5c3-c86a-4deb-a94e-0b9e6ee86515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:21.519262 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fbd5c3-c86a-4deb-a94e-0b9e6ee86515 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:21.519551 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fbd5c3-c86a-4deb-a94e-0b9e6ee86515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:21.520126 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fbd5c3-c86a-4deb-a94e-0b9e6ee86515 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:21.520981 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8699a1f-0dc6-4fdc-8d03-bc54f1c00db8 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:21.521634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fbd5c3-c86a-4deb-a94e-0b9e6ee86515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:21.523904 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fbd5c3-c86a-4deb-a94e-0b9e6ee86515 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:21.531836 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fddcaa-2f47-4198-aa7b-dbdcd7a2c3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:21.533630 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fddcaa-2f47-4198-aa7b-dbdcd7a2c3a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:21.534566 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fddcaa-2f47-4198-aa7b-dbdcd7a2c3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:21.535022 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fddcaa-2f47-4198-aa7b-dbdcd7a2c3a9 admin admin] PATH_INFO: `/v3/users/76398f7311be4747a9771eaf3fad2f44` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:21.537321 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fddcaa-2f47-4198-aa7b-dbdcd7a2c3a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76398f7311be4747a9771eaf3fad2f44)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:21.541742 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1047/2091] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:21.544811 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fbd5c3-c86a-4deb-a94e-0b9e6ee86515 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:21.545752 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fddcaa-2f47-4198-aa7b-dbdcd7a2c3a9 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:21.561446 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fbd5c3-c86a-4deb-a94e-0b9e6ee86515 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:21.569235 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d48be-adea-436a-a525-3e27ffa98a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:21.570241 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d48be-adea-436a-a525-3e27ffa98a97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:21.570749 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d48be-adea-436a-a525-3e27ffa98a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:21.571288 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d48be-adea-436a-a525-3e27ffa98a97 admin admin] PATH_INFO: `/v3/projects/a44b95e1820544bca995ab93f902c53d/users/79284959d5d54095afb8b1ac26dd4793/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:21.594326 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0d48be-adea-436a-a525-3e27ffa98a97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a44b95e1820544bca995ab93f902c53d, user_id=79284959d5d54095afb8b1ac26dd4793, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:21.598805 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0d48be-adea-436a-a525-3e27ffa98a97 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:21.626361 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1048/2092] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:22:21 2022] PUT /identity/v3/projects/a44b95e1820544bca995ab93f902c53d/users/79284959d5d54095afb8b1ac26dd4793/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:21.628344 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d48be-adea-436a-a525-3e27ffa98a97 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:21.653851 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-49fddcaa-2f47-4198-aa7b-dbdcd7a2c3a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76398f7311be4747a9771eaf3fad2f44'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:21.659758 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-49fddcaa-2f47-4198-aa7b-dbdcd7a2c3a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76398f7311be4747a9771eaf3fad2f44'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:21.660501 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-49fddcaa-2f47-4198-aa7b-dbdcd7a2c3a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76398f7311be4747a9771eaf3fad2f44'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:21.697171 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-49fddcaa-2f47-4198-aa7b-dbdcd7a2c3a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76398f7311be4747a9771eaf3fad2f44'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:21.709893 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-49fddcaa-2f47-4198-aa7b-dbdcd7a2c3a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76398f7311be4747a9771eaf3fad2f44'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:21.746525 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1045/2093] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:22:21 2022] DELETE /identity/v3/users/76398f7311be4747a9771eaf3fad2f44 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:21.753739 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e38b5-9fab-4893-8b49-d97282c0586f None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:21.754583 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e38b5-9fab-4893-8b49-d97282c0586f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:21.755167 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e38b5-9fab-4893-8b49-d97282c0586f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:21.782223 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d48be-adea-436a-a525-3e27ffa98a97 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:21.783573 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-868e38b5-9fab-4893-8b49-d97282c0586f None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:21.784992 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-868e38b5-9fab-4893-8b49-d97282c0586f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:21.891281 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1046/2094] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:21.892801 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e38b5-9fab-4893-8b49-d97282c0586f None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:21.894166 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-868e38b5-9fab-4893-8b49-d97282c0586f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:21.900191 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5078b2-a12d-4092-a7b2-7fd929ca00a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:21.901127 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5078b2-a12d-4092-a7b2-7fd929ca00a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:21.901343 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5078b2-a12d-4092-a7b2-7fd929ca00a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:21.901733 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5078b2-a12d-4092-a7b2-7fd929ca00a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:21.902836 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5078b2-a12d-4092-a7b2-7fd929ca00a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:21.904206 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5078b2-a12d-4092-a7b2-7fd929ca00a2 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:21.907997 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e38b5-9fab-4893-8b49-d97282c0586f None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:21.913855 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313671fe-ee7e-48b6-a970-8e3f9848daef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:21.915115 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313671fe-ee7e-48b6-a970-8e3f9848daef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:21.915243 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313671fe-ee7e-48b6-a970-8e3f9848daef admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:21.915642 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313671fe-ee7e-48b6-a970-8e3f9848daef admin admin] PATH_INFO: `/v3/projects/fcc87990872d47f28c02f684195fce0c` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:21.917204 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313671fe-ee7e-48b6-a970-8e3f9848daef admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcc87990872d47f28c02f684195fce0c)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:21.920430 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313671fe-ee7e-48b6-a970-8e3f9848daef admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:21.925265 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1049/2095] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:21.928284 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5078b2-a12d-4092-a7b2-7fd929ca00a2 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:21.930443 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ef5078b2-a12d-4092-a7b2-7fd929ca00a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:21.944509 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:22.025162 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5078b2-a12d-4092-a7b2-7fd929ca00a2 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:22.041137 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-313671fe-ee7e-48b6-a970-8e3f9848daef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcc87990872d47f28c02f684195fce0c', 'request_id': 'req-313671fe-ee7e-48b6-a970-8e3f9848daef'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:22.056687 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-313671fe-ee7e-48b6-a970-8e3f9848daef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcc87990872d47f28c02f684195fce0c', 'request_id': 'req-313671fe-ee7e-48b6-a970-8e3f9848daef'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:22.070072 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:22.074113 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-313671fe-ee7e-48b6-a970-8e3f9848daef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcc87990872d47f28c02f684195fce0c', 'request_id': 'req-313671fe-ee7e-48b6-a970-8e3f9848daef'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:22.101054 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-313671fe-ee7e-48b6-a970-8e3f9848daef admin admin] The token cache is being invalidate because project fcc87990872d47f28c02f684195fce0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:22:22.101633 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-313671fe-ee7e-48b6-a970-8e3f9848daef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:22.102403 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-313671fe-ee7e-48b6-a970-8e3f9848daef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:22.104270 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1047/2096] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:22:21 2022] DELETE /identity/v3/projects/fcc87990872d47f28c02f684195fce0c => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:22.104979 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313671fe-ee7e-48b6-a970-8e3f9848daef admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:22.110605 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-313671fe-ee7e-48b6-a970-8e3f9848daef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:22.130699 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53c95e2-1903-475d-9669-dac4ecb228de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:22.132320 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c95e2-1903-475d-9669-dac4ecb228de service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:22.133769 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c95e2-1903-475d-9669-dac4ecb228de service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:22.135134 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c95e2-1903-475d-9669-dac4ecb228de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:22.144973 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-b53c95e2-1903-475d-9669-dac4ecb228de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:22.291938 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53c95e2-1903-475d-9669-dac4ecb228de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:22.293409 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53c95e2-1903-475d-9669-dac4ecb228de service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:22.317861 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1050/2097] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:22:22.324271 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32234de1-4e95-42c0-b534-5a25ada178f5 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:22.324562 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32234de1-4e95-42c0-b534-5a25ada178f5 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:22.325001 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32234de1-4e95-42c0-b534-5a25ada178f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:22.331348 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313671fe-ee7e-48b6-a970-8e3f9848daef admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:22.353465 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f1817-66a8-4709-8647-4c4cde5472b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:22.355331 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f1817-66a8-4709-8647-4c4cde5472b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:22.355998 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f1817-66a8-4709-8647-4c4cde5472b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:22.356650 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f1817-66a8-4709-8647-4c4cde5472b8 admin admin] PATH_INFO: `/v3/projects/a44b95e1820544bca995ab93f902c53d/users/79284959d5d54095afb8b1ac26dd4793/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:22.367411 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92f1817-66a8-4709-8647-4c4cde5472b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a44b95e1820544bca995ab93f902c53d, user_id=79284959d5d54095afb8b1ac26dd4793, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:22.368164 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-32234de1-4e95-42c0-b534-5a25ada178f5 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:22.371882 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-32234de1-4e95-42c0-b534-5a25ada178f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:22.372368 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92f1817-66a8-4709-8647-4c4cde5472b8 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:22.398144 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1051/2098] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:22.411245 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f2be2-f0fa-4b50-b9bb-a147e2457eb6 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:22.411869 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f2be2-f0fa-4b50-b9bb-a147e2457eb6 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:22.412233 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f2be2-f0fa-4b50-b9bb-a147e2457eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:22.424192 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1048/2099] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:22:22 2022] PUT /identity/v3/projects/a44b95e1820544bca995ab93f902c53d/users/79284959d5d54095afb8b1ac26dd4793/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:22.435530 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516dabc-763d-47ab-81fa-b11faacbda8f None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:22.435687 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516dabc-763d-47ab-81fa-b11faacbda8f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:22.435969 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516dabc-763d-47ab-81fa-b11faacbda8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:22.486859 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-2c8f2be2-f0fa-4b50-b9bb-a147e2457eb6 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:22.488126 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-2c8f2be2-f0fa-4b50-b9bb-a147e2457eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:22.507499 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-b516dabc-763d-47ab-81fa-b11faacbda8f None None] MFA Rules not processed for user `79284959d5d54095afb8b1ac26dd4793`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:22.511479 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b516dabc-763d-47ab-81fa-b11faacbda8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:22.609232 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1052/2100] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:22.610884 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f2be2-f0fa-4b50-b9bb-a147e2457eb6 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:22.612524 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-2c8f2be2-f0fa-4b50-b9bb-a147e2457eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:22.631819 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f2be2-f0fa-4b50-b9bb-a147e2457eb6 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:22.632717 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1049/2101] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:22 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:22.633629 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516dabc-763d-47ab-81fa-b11faacbda8f None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:22.651270 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077aaf47-c1b2-447f-ab8f-a608b48d6b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:22.651507 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516dabc-763d-47ab-81fa-b11faacbda8f None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:22.652148 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077aaf47-c1b2-447f-ab8f-a608b48d6b0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:22.652428 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077aaf47-c1b2-447f-ab8f-a608b48d6b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:22.652703 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077aaf47-c1b2-447f-ab8f-a608b48d6b0f admin admin] PATH_INFO: `/v3/users/6e86b3c7d5f64006ac041c30ab4c639b` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:22.654396 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077aaf47-c1b2-447f-ab8f-a608b48d6b0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e86b3c7d5f64006ac041c30ab4c639b)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:22.657577 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6447b061-f0b3-40be-bd3a-ca746a79312b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:22.658563 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447b061-f0b3-40be-bd3a-ca746a79312b admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:22.658814 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447b061-f0b3-40be-bd3a-ca746a79312b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:22.659097 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447b061-f0b3-40be-bd3a-ca746a79312b admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:22.659920 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6447b061-f0b3-40be-bd3a-ca746a79312b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:22:22.660232 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6447b061-f0b3-40be-bd3a-ca746a79312b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:22.662458 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6447b061-f0b3-40be-bd3a-ca746a79312b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:22.664222 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077aaf47-c1b2-447f-ab8f-a608b48d6b0f admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:22.703147 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1050/2102] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:22:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:22:22.704496 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6447b061-f0b3-40be-bd3a-ca746a79312b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:22.711825 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6447b061-f0b3-40be-bd3a-ca746a79312b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:22.742109 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:22.793656 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-077aaf47-c1b2-447f-ab8f-a608b48d6b0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e86b3c7d5f64006ac041c30ab4c639b'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:22.811883 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-077aaf47-c1b2-447f-ab8f-a608b48d6b0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e86b3c7d5f64006ac041c30ab4c639b'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:22.813739 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:22.827404 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-077aaf47-c1b2-447f-ab8f-a608b48d6b0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e86b3c7d5f64006ac041c30ab4c639b'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:22.828381 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-077aaf47-c1b2-447f-ab8f-a608b48d6b0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e86b3c7d5f64006ac041c30ab4c639b'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:22.841219 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-077aaf47-c1b2-447f-ab8f-a608b48d6b0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e86b3c7d5f64006ac041c30ab4c639b'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:22.854441 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1053/2103] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:22:22 2022] DELETE /identity/v3/users/6e86b3c7d5f64006ac041c30ab4c639b => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:22.854441 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077aaf47-c1b2-447f-ab8f-a608b48d6b0f admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:22.855199 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-077aaf47-c1b2-447f-ab8f-a608b48d6b0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:22.900794 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6447b061-f0b3-40be-bd3a-ca746a79312b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:23.006352 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077aaf47-c1b2-447f-ab8f-a608b48d6b0f admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:23.020885 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f50f0-3ba6-467b-8b79-eb96fb0f7029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:23.022292 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f50f0-3ba6-467b-8b79-eb96fb0f7029 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:23.022619 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f50f0-3ba6-467b-8b79-eb96fb0f7029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:23.022902 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f50f0-3ba6-467b-8b79-eb96fb0f7029 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:23.023336 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c0ef83-f743-4500-ac73-bf6a3df4bc06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:23.023619 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8f50f0-3ba6-467b-8b79-eb96fb0f7029 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:23.024443 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0ef83-f743-4500-ac73-bf6a3df4bc06 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:23.026085 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0ef83-f743-4500-ac73-bf6a3df4bc06 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:23.026416 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8f50f0-3ba6-467b-8b79-eb96fb0f7029 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:23.028549 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0ef83-f743-4500-ac73-bf6a3df4bc06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:23.033966 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-90c0ef83-f743-4500-ac73-bf6a3df4bc06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:23.083644 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1054/2104] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:22:22 2022] POST /identity/v3/projects => generated 371 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:23.085494 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8047e9a-3566-47e3-9af3-1368343f2dae None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:23.085871 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8047e9a-3566-47e3-9af3-1368343f2dae None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:23.086074 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8047e9a-3566-47e3-9af3-1368343f2dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:23.108514 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-e8047e9a-3566-47e3-9af3-1368343f2dae None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:23.109646 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e8047e9a-3566-47e3-9af3-1368343f2dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:23.166540 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c0ef83-f743-4500-ac73-bf6a3df4bc06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:23.168830 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c0ef83-f743-4500-ac73-bf6a3df4bc06 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:23.184587 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1051/2105] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:22 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:22:23.185921 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c0ef83-f743-4500-ac73-bf6a3df4bc06 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:23.187909 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-90c0ef83-f743-4500-ac73-bf6a3df4bc06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:23.209753 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c0ef83-f743-4500-ac73-bf6a3df4bc06 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:23.234305 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1055/2106] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:23.235464 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8047e9a-3566-47e3-9af3-1368343f2dae None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:23.247298 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8047e9a-3566-47e3-9af3-1368343f2dae None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:23.257910 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709891b-e9f9-4bd8-b101-5dde490bb598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:23.258902 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709891b-e9f9-4bd8-b101-5dde490bb598 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:23.259336 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709891b-e9f9-4bd8-b101-5dde490bb598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:23.259785 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709891b-e9f9-4bd8-b101-5dde490bb598 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:23.260855 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b709891b-e9f9-4bd8-b101-5dde490bb598 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:23.263176 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b709891b-e9f9-4bd8-b101-5dde490bb598 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:23.301591 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1056/2107] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:22:23 2022] POST /identity/v3/users => generated 286 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:23.303509 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709891b-e9f9-4bd8-b101-5dde490bb598 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:23.307103 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-b709891b-e9f9-4bd8-b101-5dde490bb598 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:23.351997 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6fcaff-2a85-487d-92d1-883d987f40ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:23.353533 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6fcaff-2a85-487d-92d1-883d987f40ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:23.353906 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6fcaff-2a85-487d-92d1-883d987f40ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:23.354350 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6fcaff-2a85-487d-92d1-883d987f40ca admin admin] PATH_INFO: `/v3/projects/a28b81df48bb4a10a2bd9d0b81ee1eec` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:23.356557 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6fcaff-2a85-487d-92d1-883d987f40ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=a28b81df48bb4a10a2bd9d0b81ee1eec)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:23.362882 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6fcaff-2a85-487d-92d1-883d987f40ca admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:23.412703 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:23.463372 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709891b-e9f9-4bd8-b101-5dde490bb598 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:23.472395 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:23.484137 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3a6fcaff-2a85-487d-92d1-883d987f40ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a28b81df48bb4a10a2bd9d0b81ee1eec', 'request_id': 'req-3a6fcaff-2a85-487d-92d1-883d987f40ca'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:23.491272 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3a6fcaff-2a85-487d-92d1-883d987f40ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a28b81df48bb4a10a2bd9d0b81ee1eec', 'request_id': 'req-3a6fcaff-2a85-487d-92d1-883d987f40ca'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:23.503710 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3a6fcaff-2a85-487d-92d1-883d987f40ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a28b81df48bb4a10a2bd9d0b81ee1eec', 'request_id': 'req-3a6fcaff-2a85-487d-92d1-883d987f40ca'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:23.533061 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3a6fcaff-2a85-487d-92d1-883d987f40ca admin admin] The token cache is being invalidate because project a28b81df48bb4a10a2bd9d0b81ee1eec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:22:23.533365 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3a6fcaff-2a85-487d-92d1-883d987f40ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:23.536150 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3a6fcaff-2a85-487d-92d1-883d987f40ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:23.546429 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1052/2108] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:22:23 2022] DELETE /identity/v3/projects/a28b81df48bb4a10a2bd9d0b81ee1eec => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:23.547550 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6fcaff-2a85-487d-92d1-883d987f40ca admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:23.549365 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3a6fcaff-2a85-487d-92d1-883d987f40ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:23.581432 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754078e-e8a6-4fea-8130-a1dc693b450f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:23.582329 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754078e-e8a6-4fea-8130-a1dc693b450f service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:23.582775 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754078e-e8a6-4fea-8130-a1dc693b450f service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:23.583058 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754078e-e8a6-4fea-8130-a1dc693b450f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:23.586422 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-8754078e-e8a6-4fea-8130-a1dc693b450f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:23.667407 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6fcaff-2a85-487d-92d1-883d987f40ca admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:23.674130 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f59fced-723b-45e4-a414-e1db135a761e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:23.674867 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59fced-723b-45e4-a414-e1db135a761e admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:23.675097 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59fced-723b-45e4-a414-e1db135a761e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:23.675373 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59fced-723b-45e4-a414-e1db135a761e admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:23.676121 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f59fced-723b-45e4-a414-e1db135a761e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:23.682238 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8754078e-e8a6-4fea-8130-a1dc693b450f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:23.684150 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8754078e-e8a6-4fea-8130-a1dc693b450f service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:23.690078 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f59fced-723b-45e4-a414-e1db135a761e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:23.703529 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1057/2109] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:22:23.704529 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754078e-e8a6-4fea-8130-a1dc693b450f service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:23.705906 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1053/2110] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:23.706283 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-8754078e-e8a6-4fea-8130-a1dc693b450f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:23.710151 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f59fced-723b-45e4-a414-e1db135a761e admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:23.712079 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1f59fced-723b-45e4-a414-e1db135a761e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:23.725218 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754078e-e8a6-4fea-8130-a1dc693b450f service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:23.735179 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ad39a-235c-4f70-b14c-13023f97ddd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:23.736467 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ad39a-235c-4f70-b14c-13023f97ddd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:23.736819 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ad39a-235c-4f70-b14c-13023f97ddd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:23.737159 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ad39a-235c-4f70-b14c-13023f97ddd8 admin admin] PATH_INFO: `/v3/users/85dc0c8f24b04c87a0f46be88e235d73` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:23.740129 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ad39a-235c-4f70-b14c-13023f97ddd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85dc0c8f24b04c87a0f46be88e235d73)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:23.741891 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ad39a-235c-4f70-b14c-13023f97ddd8 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:23.856774 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-988ad39a-235c-4f70-b14c-13023f97ddd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85dc0c8f24b04c87a0f46be88e235d73'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:23.869735 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f59fced-723b-45e4-a414-e1db135a761e admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:23.881663 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a9c7e3-c91e-4f28-bf95-ba39ff9ac988 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:23.884820 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9c7e3-c91e-4f28-bf95-ba39ff9ac988 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:23.886853 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9c7e3-c91e-4f28-bf95-ba39ff9ac988 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:23.887224 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9c7e3-c91e-4f28-bf95-ba39ff9ac988 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:23.892933 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d8a9c7e3-c91e-4f28-bf95-ba39ff9ac988 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:23.896057 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-988ad39a-235c-4f70-b14c-13023f97ddd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85dc0c8f24b04c87a0f46be88e235d73'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:23.916520 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-988ad39a-235c-4f70-b14c-13023f97ddd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85dc0c8f24b04c87a0f46be88e235d73'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:23.919798 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-988ad39a-235c-4f70-b14c-13023f97ddd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85dc0c8f24b04c87a0f46be88e235d73'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:23.941170 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-988ad39a-235c-4f70-b14c-13023f97ddd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85dc0c8f24b04c87a0f46be88e235d73'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:23.960420 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1058/2111] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:22:23 2022] DELETE /identity/v3/users/85dc0c8f24b04c87a0f46be88e235d73 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:23.964971 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ad39a-235c-4f70-b14c-13023f97ddd8 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:23.969168 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-988ad39a-235c-4f70-b14c-13023f97ddd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:24.035247 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:24.075086 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:24.086122 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a9c7e3-c91e-4f28-bf95-ba39ff9ac988 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:24.088448 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a9c7e3-c91e-4f28-bf95-ba39ff9ac988 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:24.110148 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ad39a-235c-4f70-b14c-13023f97ddd8 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:24.128539 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1054/2112] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:23 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:22:24.128745 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacea7e0-dd2a-4ad6-bde0-aa601e345171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:24.131082 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacea7e0-dd2a-4ad6-bde0-aa601e345171 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:24.132386 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacea7e0-dd2a-4ad6-bde0-aa601e345171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:24.134295 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacea7e0-dd2a-4ad6-bde0-aa601e345171 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:24.135682 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacea7e0-dd2a-4ad6-bde0-aa601e345171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:24.140242 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacea7e0-dd2a-4ad6-bde0-aa601e345171 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:24.164943 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1059/2113] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:24.169532 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a9c7e3-c91e-4f28-bf95-ba39ff9ac988 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:24.190644 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a9c7e3-c91e-4f28-bf95-ba39ff9ac988 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:24.202658 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d21a14-259a-4f91-938b-60f4e6607905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:24.203489 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d21a14-259a-4f91-938b-60f4e6607905 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:24.203766 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d21a14-259a-4f91-938b-60f4e6607905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:24.204234 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d21a14-259a-4f91-938b-60f4e6607905 admin admin] PATH_INFO: `/v3/projects/55a9855480964d37b0151df5eb21f414/users/4a8736ee266d48f187f440f5cc69114e/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:24.255686 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d21a14-259a-4f91-938b-60f4e6607905 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55a9855480964d37b0151df5eb21f414, user_id=4a8736ee266d48f187f440f5cc69114e, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:24.259272 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d21a14-259a-4f91-938b-60f4e6607905 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:24.300787 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1055/2114] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:22:24 2022] PUT /identity/v3/projects/55a9855480964d37b0151df5eb21f414/users/4a8736ee266d48f187f440f5cc69114e/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:22:24.305010 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e7e42-f7f7-41c1-9d49-ae45e2e67569 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:24.305326 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e7e42-f7f7-41c1-9d49-ae45e2e67569 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:24.305582 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e7e42-f7f7-41c1-9d49-ae45e2e67569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:24.351916 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-e64e7e42-f7f7-41c1-9d49-ae45e2e67569 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:24.354298 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e64e7e42-f7f7-41c1-9d49-ae45e2e67569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:24.536263 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1060/2115] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:24.562081 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d21a14-259a-4f91-938b-60f4e6607905 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:24.563812 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-62d21a14-259a-4f91-938b-60f4e6607905 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:24.592691 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e7e42-f7f7-41c1-9d49-ae45e2e67569 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:24.595018 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e64e7e42-f7f7-41c1-9d49-ae45e2e67569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:24.624760 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e7e42-f7f7-41c1-9d49-ae45e2e67569 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:24.634631 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070977f-2a38-4f84-9936-36a3bc9000dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:24.636124 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070977f-2a38-4f84-9936-36a3bc9000dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:24.636417 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070977f-2a38-4f84-9936-36a3bc9000dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:24.636667 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070977f-2a38-4f84-9936-36a3bc9000dd admin admin] PATH_INFO: `/v3/users/673917b0145c4cedacdc5fbba2c465e5` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:24.639673 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0070977f-2a38-4f84-9936-36a3bc9000dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=673917b0145c4cedacdc5fbba2c465e5)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:24.640499 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0070977f-2a38-4f84-9936-36a3bc9000dd admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:24.738865 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d21a14-259a-4f91-938b-60f4e6607905 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:24.756871 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f760b13-1b6c-4576-9f68-541e8508c50d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:24.757612 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f760b13-1b6c-4576-9f68-541e8508c50d service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:24.759081 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f760b13-1b6c-4576-9f68-541e8508c50d service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:24.762742 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f760b13-1b6c-4576-9f68-541e8508c50d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:24.777686 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f760b13-1b6c-4576-9f68-541e8508c50d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:24.779678 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f760b13-1b6c-4576-9f68-541e8508c50d service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:24.798408 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-0070977f-2a38-4f84-9936-36a3bc9000dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '673917b0145c4cedacdc5fbba2c465e5'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:24.801945 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1056/2116] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:22:24.803215 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f760b13-1b6c-4576-9f68-541e8508c50d service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:24.805023 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2f760b13-1b6c-4576-9f68-541e8508c50d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:24.824377 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f760b13-1b6c-4576-9f68-541e8508c50d service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:24.831915 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51b53aa-f194-4603-ad1a-ca611f1fc500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:24.834004 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b53aa-f194-4603-ad1a-ca611f1fc500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:24.834484 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b53aa-f194-4603-ad1a-ca611f1fc500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:24.835076 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b53aa-f194-4603-ad1a-ca611f1fc500 admin admin] PATH_INFO: `/v3/users/b83b4edd5b5a43678e3085f403be1c27` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:24.837511 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51b53aa-f194-4603-ad1a-ca611f1fc500 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b83b4edd5b5a43678e3085f403be1c27)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:24.841407 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51b53aa-f194-4603-ad1a-ca611f1fc500 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:24.879388 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-0070977f-2a38-4f84-9936-36a3bc9000dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '673917b0145c4cedacdc5fbba2c465e5'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:24.911287 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-0070977f-2a38-4f84-9936-36a3bc9000dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '673917b0145c4cedacdc5fbba2c465e5'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:24.913961 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-0070977f-2a38-4f84-9936-36a3bc9000dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '673917b0145c4cedacdc5fbba2c465e5'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:24.934416 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-0070977f-2a38-4f84-9936-36a3bc9000dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '673917b0145c4cedacdc5fbba2c465e5'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:24.956906 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1061/2117] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:22:24 2022] DELETE /identity/v3/users/673917b0145c4cedacdc5fbba2c465e5 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:24.964255 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f13cc-98b6-4e80-aa58-3685d3eadf59 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:24.964745 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f13cc-98b6-4e80-aa58-3685d3eadf59 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:24.965450 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f13cc-98b6-4e80-aa58-3685d3eadf59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:25.005716 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e51b53aa-f194-4603-ad1a-ca611f1fc500 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b83b4edd5b5a43678e3085f403be1c27'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:25.007104 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e51b53aa-f194-4603-ad1a-ca611f1fc500 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b83b4edd5b5a43678e3085f403be1c27'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:25.011926 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-7f3f13cc-98b6-4e80-aa58-3685d3eadf59 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:25.012938 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e51b53aa-f194-4603-ad1a-ca611f1fc500 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b83b4edd5b5a43678e3085f403be1c27'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:25.015587 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-7f3f13cc-98b6-4e80-aa58-3685d3eadf59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:25.049448 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e51b53aa-f194-4603-ad1a-ca611f1fc500 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b83b4edd5b5a43678e3085f403be1c27'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:25.071496 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e51b53aa-f194-4603-ad1a-ca611f1fc500 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b83b4edd5b5a43678e3085f403be1c27'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:25.127362 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1057/2118] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:22:24 2022] DELETE /identity/v3/users/b83b4edd5b5a43678e3085f403be1c27 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:25.127362 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51b53aa-f194-4603-ad1a-ca611f1fc500 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:25.127362 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e51b53aa-f194-4603-ad1a-ca611f1fc500 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:25.149267 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:25.253587 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1062/2119] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:25.255935 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f13cc-98b6-4e80-aa58-3685d3eadf59 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:25.269330 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-7f3f13cc-98b6-4e80-aa58-3685d3eadf59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:25.273655 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:25.300599 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f13cc-98b6-4e80-aa58-3685d3eadf59 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:25.334607 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51b53aa-f194-4603-ad1a-ca611f1fc500 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:25.350078 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8bb972-67dd-47b9-b3f0-3094ba9d0654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:25.351813 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8bb972-67dd-47b9-b3f0-3094ba9d0654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:25.352319 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8bb972-67dd-47b9-b3f0-3094ba9d0654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:25.352814 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8bb972-67dd-47b9-b3f0-3094ba9d0654 admin admin] PATH_INFO: `/v3/projects/6b65076e32374bc2b6e18962d77ea8f1` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:25.356236 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8bb972-67dd-47b9-b3f0-3094ba9d0654 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b65076e32374bc2b6e18962d77ea8f1)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:25.359545 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8bb972-67dd-47b9-b3f0-3094ba9d0654 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:25.453407 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f682203f-fec0-4a4e-ba52-e3bea66c75e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:25.454858 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682203f-fec0-4a4e-ba52-e3bea66c75e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:25.455219 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682203f-fec0-4a4e-ba52-e3bea66c75e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:25.455572 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682203f-fec0-4a4e-ba52-e3bea66c75e1 admin admin] PATH_INFO: `/v3/projects/f9b2f6c95b82432188c8b801bd329ec7` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:25.457404 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f682203f-fec0-4a4e-ba52-e3bea66c75e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9b2f6c95b82432188c8b801bd329ec7)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:25.460475 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f682203f-fec0-4a4e-ba52-e3bea66c75e1 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:25.462411 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9b8bb972-67dd-47b9-b3f0-3094ba9d0654 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b65076e32374bc2b6e18962d77ea8f1', 'request_id': 'req-9b8bb972-67dd-47b9-b3f0-3094ba9d0654'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:25.478610 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9b8bb972-67dd-47b9-b3f0-3094ba9d0654 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b65076e32374bc2b6e18962d77ea8f1', 'request_id': 'req-9b8bb972-67dd-47b9-b3f0-3094ba9d0654'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:25.495345 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9b8bb972-67dd-47b9-b3f0-3094ba9d0654 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b65076e32374bc2b6e18962d77ea8f1', 'request_id': 'req-9b8bb972-67dd-47b9-b3f0-3094ba9d0654'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:25.523608 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9b8bb972-67dd-47b9-b3f0-3094ba9d0654 admin admin] The token cache is being invalidate because project 6b65076e32374bc2b6e18962d77ea8f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:22:25.524071 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9b8bb972-67dd-47b9-b3f0-3094ba9d0654 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:25.525296 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9b8bb972-67dd-47b9-b3f0-3094ba9d0654 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:25.531355 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1058/2120] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:22:25 2022] DELETE /identity/v3/projects/6b65076e32374bc2b6e18962d77ea8f1 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:25.531355 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8bb972-67dd-47b9-b3f0-3094ba9d0654 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:25.534801 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9b8bb972-67dd-47b9-b3f0-3094ba9d0654 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:25.560573 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f682203f-fec0-4a4e-ba52-e3bea66c75e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9b2f6c95b82432188c8b801bd329ec7', 'request_id': 'req-f682203f-fec0-4a4e-ba52-e3bea66c75e1'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:25.578046 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f682203f-fec0-4a4e-ba52-e3bea66c75e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9b2f6c95b82432188c8b801bd329ec7', 'request_id': 'req-f682203f-fec0-4a4e-ba52-e3bea66c75e1'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:25.594512 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f682203f-fec0-4a4e-ba52-e3bea66c75e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9b2f6c95b82432188c8b801bd329ec7', 'request_id': 'req-f682203f-fec0-4a4e-ba52-e3bea66c75e1'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:25.629173 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f682203f-fec0-4a4e-ba52-e3bea66c75e1 admin admin] The token cache is being invalidate because project f9b2f6c95b82432188c8b801bd329ec7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:22:25.629504 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f682203f-fec0-4a4e-ba52-e3bea66c75e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:25.638709 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f682203f-fec0-4a4e-ba52-e3bea66c75e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:25.640766 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1063/2121] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:22:25 2022] DELETE /identity/v3/projects/f9b2f6c95b82432188c8b801bd329ec7 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:25.641534 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f682203f-fec0-4a4e-ba52-e3bea66c75e1 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:25.647518 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-f682203f-fec0-4a4e-ba52-e3bea66c75e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:25.659037 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8bb972-67dd-47b9-b3f0-3094ba9d0654 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:25.834344 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f682203f-fec0-4a4e-ba52-e3bea66c75e1 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:25.850841 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c86627-d537-467c-9e6a-9851731177ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:25.851326 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c86627-d537-467c-9e6a-9851731177ae service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:25.851564 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c86627-d537-467c-9e6a-9851731177ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:25.852338 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c86627-d537-467c-9e6a-9851731177ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:25.855242 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-27c86627-d537-467c-9e6a-9851731177ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:25.857208 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ed052-6394-41e0-8162-d3671892f9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:25.859929 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ed052-6394-41e0-8162-d3671892f9b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:25.861420 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ed052-6394-41e0-8162-d3671892f9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:25.862832 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ed052-6394-41e0-8162-d3671892f9b2 admin admin] PATH_INFO: `/v3/users/ee907435b8b64b9192e4bcc1930f1c0a` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:25.865576 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875ed052-6394-41e0-8162-d3671892f9b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee907435b8b64b9192e4bcc1930f1c0a)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:25.870104 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875ed052-6394-41e0-8162-d3671892f9b2 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:25.878456 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c86627-d537-467c-9e6a-9851731177ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:25.884331 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c86627-d537-467c-9e6a-9851731177ae service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:25.909047 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1059/2122] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:22:25.909597 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:25.911847 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bb7d7-cfda-4b57-ba8a-dd164126ea60 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:25.912178 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bb7d7-cfda-4b57-ba8a-dd164126ea60 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:25.912550 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bb7d7-cfda-4b57-ba8a-dd164126ea60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:25.940076 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-db0bb7d7-cfda-4b57-ba8a-dd164126ea60 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:25.941485 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-db0bb7d7-cfda-4b57-ba8a-dd164126ea60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:25.969992 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1060/2123] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:25.971885 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0bb7d7-cfda-4b57-ba8a-dd164126ea60 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:25.974345 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-db0bb7d7-cfda-4b57-ba8a-dd164126ea60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:25.991421 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0bb7d7-cfda-4b57-ba8a-dd164126ea60 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:25.996754 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf78bc-dab1-45a3-88ec-3ed51505a07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:25.997750 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf78bc-dab1-45a3-88ec-3ed51505a07e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:25.998228 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf78bc-dab1-45a3-88ec-3ed51505a07e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:25.998514 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf78bc-dab1-45a3-88ec-3ed51505a07e admin admin] PATH_INFO: `/v3/projects/f3656fbaf50a4b0db834734cd8350a74` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:26.000196 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cf78bc-dab1-45a3-88ec-3ed51505a07e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3656fbaf50a4b0db834734cd8350a74)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:26.002487 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cf78bc-dab1-45a3-88ec-3ed51505a07e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:26.033560 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:26.093780 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-875ed052-6394-41e0-8162-d3671892f9b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee907435b8b64b9192e4bcc1930f1c0a'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:26.099265 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-21cf78bc-dab1-45a3-88ec-3ed51505a07e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3656fbaf50a4b0db834734cd8350a74', 'request_id': 'req-21cf78bc-dab1-45a3-88ec-3ed51505a07e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:26.112129 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-21cf78bc-dab1-45a3-88ec-3ed51505a07e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3656fbaf50a4b0db834734cd8350a74', 'request_id': 'req-21cf78bc-dab1-45a3-88ec-3ed51505a07e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:26.132696 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-21cf78bc-dab1-45a3-88ec-3ed51505a07e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3656fbaf50a4b0db834734cd8350a74', 'request_id': 'req-21cf78bc-dab1-45a3-88ec-3ed51505a07e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:26.139139 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-875ed052-6394-41e0-8162-d3671892f9b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee907435b8b64b9192e4bcc1930f1c0a'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:26.167044 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-875ed052-6394-41e0-8162-d3671892f9b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee907435b8b64b9192e4bcc1930f1c0a'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:26.169224 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-875ed052-6394-41e0-8162-d3671892f9b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee907435b8b64b9192e4bcc1930f1c0a'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:26.172329 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-21cf78bc-dab1-45a3-88ec-3ed51505a07e admin admin] The token cache is being invalidate because project f3656fbaf50a4b0db834734cd8350a74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:22:26.172803 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-21cf78bc-dab1-45a3-88ec-3ed51505a07e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:26.176520 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-21cf78bc-dab1-45a3-88ec-3ed51505a07e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:26.190392 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1061/2124] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:22:25 2022] DELETE /identity/v3/projects/f3656fbaf50a4b0db834734cd8350a74 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:26.193087 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfe502-27fb-4d0b-bd34-126aab32f098 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:26.193805 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfe502-27fb-4d0b-bd34-126aab32f098 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:26.194428 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfe502-27fb-4d0b-bd34-126aab32f098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:26.198926 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-875ed052-6394-41e0-8162-d3671892f9b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee907435b8b64b9192e4bcc1930f1c0a'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:26.215502 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1064/2125] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:22:25 2022] DELETE /identity/v3/users/ee907435b8b64b9192e4bcc1930f1c0a => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:26.221157 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d42c0f-bce9-4f39-8e1e-50f3b6449b9a None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:26.223233 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d42c0f-bce9-4f39-8e1e-50f3b6449b9a None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:26.223586 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d42c0f-bce9-4f39-8e1e-50f3b6449b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:26.248998 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-50bfe502-27fb-4d0b-bd34-126aab32f098 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:26.248998 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-50bfe502-27fb-4d0b-bd34-126aab32f098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:26.302796 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-15d42c0f-bce9-4f39-8e1e-50f3b6449b9a None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:26.304381 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-15d42c0f-bce9-4f39-8e1e-50f3b6449b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:26.365763 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1062/2126] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:26.369195 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bfe502-27fb-4d0b-bd34-126aab32f098 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:26.388211 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bfe502-27fb-4d0b-bd34-126aab32f098 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:26.396434 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33fdf8f-6549-41df-aa1e-9faa31e4ff82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:26.397201 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33fdf8f-6549-41df-aa1e-9faa31e4ff82 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:26.397678 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33fdf8f-6549-41df-aa1e-9faa31e4ff82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:26.398249 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33fdf8f-6549-41df-aa1e-9faa31e4ff82 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:26.399485 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33fdf8f-6549-41df-aa1e-9faa31e4ff82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:22:26.399978 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33fdf8f-6549-41df-aa1e-9faa31e4ff82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:26.403939 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33fdf8f-6549-41df-aa1e-9faa31e4ff82 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:26.425638 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1063/2127] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:22:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:22:26.430990 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33fdf8f-6549-41df-aa1e-9faa31e4ff82 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:26.444606 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33fdf8f-6549-41df-aa1e-9faa31e4ff82 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:26.451663 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f0668-2cfb-4875-b1dd-7f8bac25093f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:26.451956 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f0668-2cfb-4875-b1dd-7f8bac25093f admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:26.452557 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f0668-2cfb-4875-b1dd-7f8bac25093f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:26.452557 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f0668-2cfb-4875-b1dd-7f8bac25093f admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:26.453485 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f0668-2cfb-4875-b1dd-7f8bac25093f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:26.455954 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f0668-2cfb-4875-b1dd-7f8bac25093f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:26.471979 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1065/2128] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:26.488109 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1064/2129] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:22:26 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:22:26.489290 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec40d2-6807-46ae-827e-60f515e91527 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:26.489930 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec40d2-6807-46ae-827e-60f515e91527 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:26.490198 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec40d2-6807-46ae-827e-60f515e91527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:26.493374 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f0668-2cfb-4875-b1dd-7f8bac25093f admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:26.544018 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-93ec40d2-6807-46ae-827e-60f515e91527 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:26.545344 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-93ec40d2-6807-46ae-827e-60f515e91527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:26.681995 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1066/2130] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:26.683522 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04135b2-b0fa-445d-96c9-fc6ff43f993c None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:26.683822 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04135b2-b0fa-445d-96c9-fc6ff43f993c None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:26.684250 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04135b2-b0fa-445d-96c9-fc6ff43f993c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:26.687609 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f0668-2cfb-4875-b1dd-7f8bac25093f admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:26.701717 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3657d7-bcbf-4a05-884e-baaaf0b29f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:26.702809 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3657d7-bcbf-4a05-884e-baaaf0b29f30 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:26.703283 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3657d7-bcbf-4a05-884e-baaaf0b29f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:26.703704 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3657d7-bcbf-4a05-884e-baaaf0b29f30 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:26.705024 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3657d7-bcbf-4a05-884e-baaaf0b29f30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:26.707994 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3657d7-bcbf-4a05-884e-baaaf0b29f30 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:26.723959 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-e04135b2-b0fa-445d-96c9-fc6ff43f993c None None] MFA Rules not processed for user `4a8736ee266d48f187f440f5cc69114e`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:26.726315 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e04135b2-b0fa-445d-96c9-fc6ff43f993c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:26.740012 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1065/2131] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:22:26 2022] POST /identity/v3/users => generated 293 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:26.741530 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3657d7-bcbf-4a05-884e-baaaf0b29f30 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:26.744471 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9c3657d7-bcbf-4a05-884e-baaaf0b29f30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:26.758433 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:26.759690 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:26.766523 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3657d7-bcbf-4a05-884e-baaaf0b29f30 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:26.796144 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e77cf9e-adc2-4c7d-96fe-b5b1b1f128ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:26.797582 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e77cf9e-adc2-4c7d-96fe-b5b1b1f128ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:26.798464 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e77cf9e-adc2-4c7d-96fe-b5b1b1f128ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:26.799142 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e77cf9e-adc2-4c7d-96fe-b5b1b1f128ca admin admin] PATH_INFO: `/v3/projects/a9050e4aef3f4054a8261568bf3e2a05` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:26.804459 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e77cf9e-adc2-4c7d-96fe-b5b1b1f128ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9050e4aef3f4054a8261568bf3e2a05)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:26.808323 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e77cf9e-adc2-4c7d-96fe-b5b1b1f128ca admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:26.854472 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1067/2132] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:26.854472 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04135b2-b0fa-445d-96c9-fc6ff43f993c None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:26.871931 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04135b2-b0fa-445d-96c9-fc6ff43f993c None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:26.879256 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1d7026-c137-4fb9-9b60-9cb39cbbd342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:26.880218 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d7026-c137-4fb9-9b60-9cb39cbbd342 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:26.880611 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d7026-c137-4fb9-9b60-9cb39cbbd342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:26.880886 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d7026-c137-4fb9-9b60-9cb39cbbd342 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:26.881830 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1d7026-c137-4fb9-9b60-9cb39cbbd342 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:22:26.882047 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1d7026-c137-4fb9-9b60-9cb39cbbd342 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:26.884036 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1d7026-c137-4fb9-9b60-9cb39cbbd342 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:26.902527 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1068/2133] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:22:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:22:26.903955 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1d7026-c137-4fb9-9b60-9cb39cbbd342 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:26.916489 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1d7026-c137-4fb9-9b60-9cb39cbbd342 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:26.919785 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5e77cf9e-adc2-4c7d-96fe-b5b1b1f128ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9050e4aef3f4054a8261568bf3e2a05', 'request_id': 'req-5e77cf9e-adc2-4c7d-96fe-b5b1b1f128ca'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:26.928550 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5e77cf9e-adc2-4c7d-96fe-b5b1b1f128ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9050e4aef3f4054a8261568bf3e2a05', 'request_id': 'req-5e77cf9e-adc2-4c7d-96fe-b5b1b1f128ca'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:26.939919 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5e77cf9e-adc2-4c7d-96fe-b5b1b1f128ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9050e4aef3f4054a8261568bf3e2a05', 'request_id': 'req-5e77cf9e-adc2-4c7d-96fe-b5b1b1f128ca'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:26.976040 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5e77cf9e-adc2-4c7d-96fe-b5b1b1f128ca admin admin] The token cache is being invalidate because project a9050e4aef3f4054a8261568bf3e2a05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:22:26.976435 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5e77cf9e-adc2-4c7d-96fe-b5b1b1f128ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:26.977641 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5e77cf9e-adc2-4c7d-96fe-b5b1b1f128ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:26.982174 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1066/2134] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:22:26 2022] DELETE /identity/v3/projects/a9050e4aef3f4054a8261568bf3e2a05 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:26.983927 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e77cf9e-adc2-4c7d-96fe-b5b1b1f128ca admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:26.988012 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5e77cf9e-adc2-4c7d-96fe-b5b1b1f128ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:27.014652 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1352bf-ac86-4cea-8afc-fe61d27f93aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:27.015345 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1352bf-ac86-4cea-8afc-fe61d27f93aa admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:27.015621 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1352bf-ac86-4cea-8afc-fe61d27f93aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:27.015959 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1352bf-ac86-4cea-8afc-fe61d27f93aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:27.017925 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1352bf-ac86-4cea-8afc-fe61d27f93aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:27.019953 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1352bf-ac86-4cea-8afc-fe61d27f93aa admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:27.042627 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1069/2135] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:26 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:27.043569 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1352bf-ac86-4cea-8afc-fe61d27f93aa admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:27.046035 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-6b1352bf-ac86-4cea-8afc-fe61d27f93aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:27.077348 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1352bf-ac86-4cea-8afc-fe61d27f93aa admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:27.103095 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0616a2-ab2d-48d2-b608-514c46fce332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:27.107468 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0616a2-ab2d-48d2-b608-514c46fce332 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:27.108170 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0616a2-ab2d-48d2-b608-514c46fce332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:27.108788 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0616a2-ab2d-48d2-b608-514c46fce332 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:27.114143 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0616a2-ab2d-48d2-b608-514c46fce332 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:27.124977 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0616a2-ab2d-48d2-b608-514c46fce332 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:27.189321 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e77cf9e-adc2-4c7d-96fe-b5b1b1f128ca admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:27.194009 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1070/2136] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:22:27 2022] POST /identity/v3/projects => generated 377 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:27.200179 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72e3dd-c5d0-4a7d-a3e0-4ff0be95201d None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:27.201110 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72e3dd-c5d0-4a7d-a3e0-4ff0be95201d None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:27.202247 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72e3dd-c5d0-4a7d-a3e0-4ff0be95201d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:27.251265 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-ca72e3dd-c5d0-4a7d-a3e0-4ff0be95201d None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:27.252593 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ca72e3dd-c5d0-4a7d-a3e0-4ff0be95201d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:27.300486 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2203732-0050-4151-a5d7-34a0e8fd0d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:27.301190 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2203732-0050-4151-a5d7-34a0e8fd0d11 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:27.301478 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2203732-0050-4151-a5d7-34a0e8fd0d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:27.301793 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2203732-0050-4151-a5d7-34a0e8fd0d11 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:27.302597 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2203732-0050-4151-a5d7-34a0e8fd0d11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:27.307496 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2203732-0050-4151-a5d7-34a0e8fd0d11 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:27.343572 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1071/2137] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:27.345298 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca72e3dd-c5d0-4a7d-a3e0-4ff0be95201d None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:27.347292 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ca72e3dd-c5d0-4a7d-a3e0-4ff0be95201d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:27.364399 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca72e3dd-c5d0-4a7d-a3e0-4ff0be95201d None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:27.372726 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1067/2138] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:22:26 2022] POST /identity/v3/projects => generated 371 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:27.373550 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c53464d-4da7-41a2-af98-1f483ad3bd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:27.373947 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2203732-0050-4151-a5d7-34a0e8fd0d11 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:27.374291 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53464d-4da7-41a2-af98-1f483ad3bd17 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:27.374683 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53464d-4da7-41a2-af98-1f483ad3bd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:27.374956 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53464d-4da7-41a2-af98-1f483ad3bd17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:27.375709 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c53464d-4da7-41a2-af98-1f483ad3bd17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:27.377336 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c53464d-4da7-41a2-af98-1f483ad3bd17 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:27.397872 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1072/2139] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:27 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:27.397872 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c53464d-4da7-41a2-af98-1f483ad3bd17 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:27.397872 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-7c53464d-4da7-41a2-af98-1f483ad3bd17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:27.415139 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c53464d-4da7-41a2-af98-1f483ad3bd17 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:27.417753 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:27.422479 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:27.499653 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2203732-0050-4151-a5d7-34a0e8fd0d11 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:27.505748 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1370f642-e112-4ca6-b31b-e335386f40a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:27.506812 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370f642-e112-4ca6-b31b-e335386f40a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:27.507239 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370f642-e112-4ca6-b31b-e335386f40a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:27.507516 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370f642-e112-4ca6-b31b-e335386f40a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:27.508221 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1370f642-e112-4ca6-b31b-e335386f40a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:27.510227 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1370f642-e112-4ca6-b31b-e335386f40a3 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:27.518727 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d3f08-82d5-4174-9129-e5dc0aa473c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:27.520024 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d3f08-82d5-4174-9129-e5dc0aa473c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:27.520500 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d3f08-82d5-4174-9129-e5dc0aa473c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:27.520810 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d3f08-82d5-4174-9129-e5dc0aa473c2 admin admin] PATH_INFO: `/v3/projects/80c9ab48f5fb46f083c325cbe1f971a1` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:27.522564 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2d3f08-82d5-4174-9129-e5dc0aa473c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80c9ab48f5fb46f083c325cbe1f971a1)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:27.524962 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2d3f08-82d5-4174-9129-e5dc0aa473c2 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:27.542402 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1068/2140] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:22:27 2022] POST /identity/v3/users => generated 289 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:27.544558 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5cebf-a603-484e-8b33-8a6bcaddf7e3 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:27.545930 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5cebf-a603-484e-8b33-8a6bcaddf7e3 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:27.545930 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5cebf-a603-484e-8b33-8a6bcaddf7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:27.575668 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-52b5cebf-a603-484e-8b33-8a6bcaddf7e3 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:27.577842 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-52b5cebf-a603-484e-8b33-8a6bcaddf7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:27.590821 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2e2d3f08-82d5-4174-9129-e5dc0aa473c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80c9ab48f5fb46f083c325cbe1f971a1', 'request_id': 'req-2e2d3f08-82d5-4174-9129-e5dc0aa473c2'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:27.599192 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2e2d3f08-82d5-4174-9129-e5dc0aa473c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80c9ab48f5fb46f083c325cbe1f971a1', 'request_id': 'req-2e2d3f08-82d5-4174-9129-e5dc0aa473c2'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:27.609848 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2e2d3f08-82d5-4174-9129-e5dc0aa473c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80c9ab48f5fb46f083c325cbe1f971a1', 'request_id': 'req-2e2d3f08-82d5-4174-9129-e5dc0aa473c2'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:27.640706 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2e2d3f08-82d5-4174-9129-e5dc0aa473c2 admin admin] The token cache is being invalidate because project 80c9ab48f5fb46f083c325cbe1f971a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:22:27.641126 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2e2d3f08-82d5-4174-9129-e5dc0aa473c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:27.642968 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2e2d3f08-82d5-4174-9129-e5dc0aa473c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:27.645735 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1073/2141] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:22:27 2022] DELETE /identity/v3/projects/80c9ab48f5fb46f083c325cbe1f971a1 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:27.647536 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d3f08-82d5-4174-9129-e5dc0aa473c2 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:27.650760 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-2e2d3f08-82d5-4174-9129-e5dc0aa473c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:27.699237 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1069/2142] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:27.699237 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b5cebf-a603-484e-8b33-8a6bcaddf7e3 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:27.699897 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-52b5cebf-a603-484e-8b33-8a6bcaddf7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:27.717659 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b5cebf-a603-484e-8b33-8a6bcaddf7e3 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:27.725578 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761afd4-5c33-4e72-b116-b1bd57d455b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:27.727378 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761afd4-5c33-4e72-b116-b1bd57d455b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:27.727744 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761afd4-5c33-4e72-b116-b1bd57d455b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:27.728280 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761afd4-5c33-4e72-b116-b1bd57d455b1 admin admin] PATH_INFO: `/v3/projects/1deb75952cab418fb4e5441688f01349/users/1d614607f38c4d85ba6131d340848de6/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:27.756356 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d761afd4-5c33-4e72-b116-b1bd57d455b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1deb75952cab418fb4e5441688f01349, user_id=1d614607f38c4d85ba6131d340848de6, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:27.760390 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d761afd4-5c33-4e72-b116-b1bd57d455b1 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:27.770414 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d3f08-82d5-4174-9129-e5dc0aa473c2 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:27.780006 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e1d3f-4826-4f57-86f9-4b3855a5c60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:27.781061 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e1d3f-4826-4f57-86f9-4b3855a5c60c admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:27.781519 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e1d3f-4826-4f57-86f9-4b3855a5c60c admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:27.782029 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e1d3f-4826-4f57-86f9-4b3855a5c60c admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:27.793242 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1070/2143] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:22:27 2022] PUT /identity/v3/projects/1deb75952cab418fb4e5441688f01349/users/1d614607f38c4d85ba6131d340848de6/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:27.793939 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3e1d3f-4826-4f57-86f9-4b3855a5c60c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:27.794098 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761afd4-5c33-4e72-b116-b1bd57d455b1 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:27.794233 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3e1d3f-4826-4f57-86f9-4b3855a5c60c admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:27.797767 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d761afd4-5c33-4e72-b116-b1bd57d455b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:27.826318 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1074/2144] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:22:27 2022] POST /identity/v3/users => generated 292 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:27.828775 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78debfd9-6e9e-4ca7-8cf1-f596837150af None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:27.829597 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78debfd9-6e9e-4ca7-8cf1-f596837150af None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:27.830062 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78debfd9-6e9e-4ca7-8cf1-f596837150af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:27.865202 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-78debfd9-6e9e-4ca7-8cf1-f596837150af None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:27.869447 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-78debfd9-6e9e-4ca7-8cf1-f596837150af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:27.915306 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:27.923373 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761afd4-5c33-4e72-b116-b1bd57d455b1 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:27.931245 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4819a98b-919e-4f89-b638-752e8e9ad9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:27.931922 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819a98b-919e-4f89-b638-752e8e9ad9f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:27.932212 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819a98b-919e-4f89-b638-752e8e9ad9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:27.932532 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819a98b-919e-4f89-b638-752e8e9ad9f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:27.933235 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4819a98b-919e-4f89-b638-752e8e9ad9f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:27.935154 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4819a98b-919e-4f89-b638-752e8e9ad9f9 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:27.953067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1071/2145] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:27 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:27.955571 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4819a98b-919e-4f89-b638-752e8e9ad9f9 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:27.975953 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4819a98b-919e-4f89-b638-752e8e9ad9f9 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:27.983067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2510019d-f3f3-4fb0-889e-b4082fc30dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:27.983877 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510019d-f3f3-4fb0-889e-b4082fc30dff admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:27.984164 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510019d-f3f3-4fb0-889e-b4082fc30dff admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:27.984621 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510019d-f3f3-4fb0-889e-b4082fc30dff admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:27.985433 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2510019d-f3f3-4fb0-889e-b4082fc30dff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:22:27.985766 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2510019d-f3f3-4fb0-889e-b4082fc30dff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:27.987447 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2510019d-f3f3-4fb0-889e-b4082fc30dff admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:27.990651 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1075/2146] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:27.993478 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db869a-02a8-494f-b727-01f27e264d3e None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:27.994019 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db869a-02a8-494f-b727-01f27e264d3e None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:27.994531 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db869a-02a8-494f-b727-01f27e264d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:28.006313 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1072/2147] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:22:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:22:28.007517 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2510019d-f3f3-4fb0-889e-b4082fc30dff admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:28.024492 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2510019d-f3f3-4fb0-889e-b4082fc30dff admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:28.036945 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48159c1-01fa-4152-a6b2-d854432dabc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:28.038196 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48159c1-01fa-4152-a6b2-d854432dabc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:28.038627 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48159c1-01fa-4152-a6b2-d854432dabc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:28.039035 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48159c1-01fa-4152-a6b2-d854432dabc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:28.040009 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48159c1-01fa-4152-a6b2-d854432dabc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:28.043630 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48159c1-01fa-4152-a6b2-d854432dabc8 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:28.049440 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-c5db869a-02a8-494f-b727-01f27e264d3e None None] MFA Rules not processed for user `1d614607f38c4d85ba6131d340848de6`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:28.053762 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-c5db869a-02a8-494f-b727-01f27e264d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:28.059030 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:28.066553 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1073/2148] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:28.068462 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48159c1-01fa-4152-a6b2-d854432dabc8 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:28.089798 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48159c1-01fa-4152-a6b2-d854432dabc8 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:28.095520 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e4192-d948-4f17-a3a1-9655345aa713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:28.096223 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e4192-d948-4f17-a3a1-9655345aa713 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:28.096507 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e4192-d948-4f17-a3a1-9655345aa713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:28.096783 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e4192-d948-4f17-a3a1-9655345aa713 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:28.097537 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08e4192-d948-4f17-a3a1-9655345aa713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:28.099338 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08e4192-d948-4f17-a3a1-9655345aa713 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:28.117522 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1074/2149] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:28.119131 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428e569-3ba4-45f0-be3d-751cacc899a2 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:28.119670 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428e569-3ba4-45f0-be3d-751cacc899a2 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:28.120013 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428e569-3ba4-45f0-be3d-751cacc899a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:28.149813 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-8428e569-3ba4-45f0-be3d-751cacc899a2 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:28.151426 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8428e569-3ba4-45f0-be3d-751cacc899a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:28.160693 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1075/2150] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:28.161916 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8428e569-3ba4-45f0-be3d-751cacc899a2 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:28.172820 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8428e569-3ba4-45f0-be3d-751cacc899a2 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:28.178264 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd52a84-9f81-4384-804d-8cc9299cb2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:28.179362 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd52a84-9f81-4384-804d-8cc9299cb2b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:28.180507 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd52a84-9f81-4384-804d-8cc9299cb2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:28.180507 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd52a84-9f81-4384-804d-8cc9299cb2b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:28.181535 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd52a84-9f81-4384-804d-8cc9299cb2b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:28.183080 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1076/2151] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:28.185645 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd52a84-9f81-4384-804d-8cc9299cb2b2 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:28.190028 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db869a-02a8-494f-b727-01f27e264d3e None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:28.209614 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db869a-02a8-494f-b727-01f27e264d3e None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:28.219687 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e268f-ae83-4111-84ae-09f8d0b6a088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:28.221255 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e268f-ae83-4111-84ae-09f8d0b6a088 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:28.221737 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e268f-ae83-4111-84ae-09f8d0b6a088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:28.222210 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e268f-ae83-4111-84ae-09f8d0b6a088 admin admin] PATH_INFO: `/v3/projects/0e835c0d14c14d659dd0cdedbeb18445/users/f661819d162c407cb816403c5c4866ec/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:28.237865 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1076/2152] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:22:28 2022] POST /identity/v3/projects => generated 371 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:28.240355 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd52a84-9f81-4384-804d-8cc9299cb2b2 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:28.259790 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e268f-ae83-4111-84ae-09f8d0b6a088 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e835c0d14c14d659dd0cdedbeb18445, user_id=f661819d162c407cb816403c5c4866ec, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:28.264620 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e268f-ae83-4111-84ae-09f8d0b6a088 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:28.291226 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1077/2153] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:22:28 2022] PUT /identity/v3/projects/0e835c0d14c14d659dd0cdedbeb18445/users/f661819d162c407cb816403c5c4866ec/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:28.292836 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e268f-ae83-4111-84ae-09f8d0b6a088 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:28.357070 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd52a84-9f81-4384-804d-8cc9299cb2b2 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:28.399716 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e268f-ae83-4111-84ae-09f8d0b6a088 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:28.407250 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d40cd-5b3f-446f-afc4-2aebb520ad08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:28.408612 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d40cd-5b3f-446f-afc4-2aebb520ad08 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:28.409291 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d40cd-5b3f-446f-afc4-2aebb520ad08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:28.409922 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d40cd-5b3f-446f-afc4-2aebb520ad08 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:28.411110 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d40cd-5b3f-446f-afc4-2aebb520ad08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:22:28.412053 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d40cd-5b3f-446f-afc4-2aebb520ad08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:28.414864 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d40cd-5b3f-446f-afc4-2aebb520ad08 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:28.442602 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1078/2154] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:22:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:22:28.442602 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d40cd-5b3f-446f-afc4-2aebb520ad08 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:28.459773 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d40cd-5b3f-446f-afc4-2aebb520ad08 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:28.462779 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1733a7f-da5b-4757-ac98-bf0a835c5c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:28.463830 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1733a7f-da5b-4757-ac98-bf0a835c5c88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:28.464269 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1733a7f-da5b-4757-ac98-bf0a835c5c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:28.464638 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1733a7f-da5b-4757-ac98-bf0a835c5c88 admin admin] PATH_INFO: `/v3/projects/9a2d788bddf640f38058e215c0f7ac46/users/e876198e863542518f9f932eb61f3403/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:28.466514 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbaeb9c-b140-405a-a0d6-827901ce79e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:28.467206 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbaeb9c-b140-405a-a0d6-827901ce79e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:28.467494 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbaeb9c-b140-405a-a0d6-827901ce79e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:28.467774 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbaeb9c-b140-405a-a0d6-827901ce79e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:28.468522 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbaeb9c-b140-405a-a0d6-827901ce79e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:28.470757 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbaeb9c-b140-405a-a0d6-827901ce79e4 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:28.484974 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1733a7f-da5b-4757-ac98-bf0a835c5c88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a2d788bddf640f38058e215c0f7ac46, user_id=e876198e863542518f9f932eb61f3403, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:28.488352 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1733a7f-da5b-4757-ac98-bf0a835c5c88 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:28.503233 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1079/2155] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:22:28 2022] POST /identity/v3/projects => generated 385 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:28.504112 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbaeb9c-b140-405a-a0d6-827901ce79e4 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:28.508898 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1077/2156] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:22:28 2022] PUT /identity/v3/projects/9a2d788bddf640f38058e215c0f7ac46/users/e876198e863542518f9f932eb61f3403/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:28.510851 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1733a7f-da5b-4757-ac98-bf0a835c5c88 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:28.518378 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:28.567403 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:28.587625 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1733a7f-da5b-4757-ac98-bf0a835c5c88 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:28.594736 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe2080-db1b-41dd-9165-5988d8b07599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:28.595106 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbaeb9c-b140-405a-a0d6-827901ce79e4 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:28.595437 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe2080-db1b-41dd-9165-5988d8b07599 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:28.595725 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe2080-db1b-41dd-9165-5988d8b07599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:28.596005 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe2080-db1b-41dd-9165-5988d8b07599 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:28.596768 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fe2080-db1b-41dd-9165-5988d8b07599 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:28.598509 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fe2080-db1b-41dd-9165-5988d8b07599 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:28.603590 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e783c68-1269-4446-ac37-6ad22bb5232a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:28.604736 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e783c68-1269-4446-ac37-6ad22bb5232a admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:28.605254 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e783c68-1269-4446-ac37-6ad22bb5232a admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:28.605758 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e783c68-1269-4446-ac37-6ad22bb5232a admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:28.607038 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e783c68-1269-4446-ac37-6ad22bb5232a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:28.612908 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1078/2157] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:28.613085 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e783c68-1269-4446-ac37-6ad22bb5232a admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:28.613165 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe2080-db1b-41dd-9165-5988d8b07599 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:28.621684 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe2080-db1b-41dd-9165-5988d8b07599 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:28.627265 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a99bdd9-6421-495f-a9fe-f9b369399f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:28.627934 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a99bdd9-6421-495f-a9fe-f9b369399f9e admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:28.628233 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a99bdd9-6421-495f-a9fe-f9b369399f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:28.628474 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a99bdd9-6421-495f-a9fe-f9b369399f9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:28.629386 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a99bdd9-6421-495f-a9fe-f9b369399f9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:28.632435 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a99bdd9-6421-495f-a9fe-f9b369399f9e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:28.644422 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1080/2158] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:22:28 2022] POST /identity/v3/users => generated 286 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:28.646438 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e783c68-1269-4446-ac37-6ad22bb5232a admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:28.662515 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e783c68-1269-4446-ac37-6ad22bb5232a admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:28.666652 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1079/2159] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:22:28 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:28.668126 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631efec-1fc6-4e42-8dd4-91fc91d5bf66 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:28.668491 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631efec-1fc6-4e42-8dd4-91fc91d5bf66 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:28.668817 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631efec-1fc6-4e42-8dd4-91fc91d5bf66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:28.670902 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255647ac-f1e9-49da-b47d-23d85661f1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:28.672084 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255647ac-f1e9-49da-b47d-23d85661f1e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:28.672566 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255647ac-f1e9-49da-b47d-23d85661f1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:28.673051 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255647ac-f1e9-49da-b47d-23d85661f1e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:28.674518 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255647ac-f1e9-49da-b47d-23d85661f1e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:28.678595 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255647ac-f1e9-49da-b47d-23d85661f1e3 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:28.699562 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-7631efec-1fc6-4e42-8dd4-91fc91d5bf66 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:28.700917 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7631efec-1fc6-4e42-8dd4-91fc91d5bf66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:28.712119 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1081/2160] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:22:28 2022] POST /identity/v3/users => generated 299 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:28.714370 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255647ac-f1e9-49da-b47d-23d85661f1e3 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:28.728522 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255647ac-f1e9-49da-b47d-23d85661f1e3 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:28.796052 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1080/2161] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:28.796052 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7631efec-1fc6-4e42-8dd4-91fc91d5bf66 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:28.808577 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7631efec-1fc6-4e42-8dd4-91fc91d5bf66 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:28.818125 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e029101-6726-4f49-8d08-01bd2621dbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:28.819175 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e029101-6726-4f49-8d08-01bd2621dbf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:28.819596 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e029101-6726-4f49-8d08-01bd2621dbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:28.820018 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e029101-6726-4f49-8d08-01bd2621dbf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:28.821326 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e029101-6726-4f49-8d08-01bd2621dbf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:28.824452 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e029101-6726-4f49-8d08-01bd2621dbf7 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:28.836140 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850cee78-3ed4-459d-81eb-f4f8c3447a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:28.837821 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850cee78-3ed4-459d-81eb-f4f8c3447a4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:28.838339 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850cee78-3ed4-459d-81eb-f4f8c3447a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:28.838844 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850cee78-3ed4-459d-81eb-f4f8c3447a4d admin admin] PATH_INFO: `/v3/projects/0e835c0d14c14d659dd0cdedbeb18445/users/f661819d162c407cb816403c5c4866ec/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:28.842775 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850cee78-3ed4-459d-81eb-f4f8c3447a4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e835c0d14c14d659dd0cdedbeb18445, user_id=f661819d162c407cb816403c5c4866ec, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:28.843970 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1081/2162] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:28.845222 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e029101-6726-4f49-8d08-01bd2621dbf7 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:28.848404 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850cee78-3ed4-459d-81eb-f4f8c3447a4d admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:28.860912 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e029101-6726-4f49-8d08-01bd2621dbf7 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:28.869832 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1082/2163] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:22:28 2022] PUT /identity/v3/projects/0e835c0d14c14d659dd0cdedbeb18445/users/f661819d162c407cb816403c5c4866ec/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:28.871377 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850cee78-3ed4-459d-81eb-f4f8c3447a4d admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:28.971571 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac90289-d4ab-4236-81fc-5dbe88932bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:28.974290 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac90289-d4ab-4236-81fc-5dbe88932bae admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:28.974937 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac90289-d4ab-4236-81fc-5dbe88932bae admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:28.975359 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac90289-d4ab-4236-81fc-5dbe88932bae admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:28.976772 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac90289-d4ab-4236-81fc-5dbe88932bae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:28.981983 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac90289-d4ab-4236-81fc-5dbe88932bae admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:29.019585 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850cee78-3ed4-459d-81eb-f4f8c3447a4d admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:29.029423 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1082/2164] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:22:28 2022] POST /identity/v3/users => generated 287 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:29.034261 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac90289-d4ab-4236-81fc-5dbe88932bae admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:29.037957 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-bac90289-d4ab-4236-81fc-5dbe88932bae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:29.043856 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c43afb-8474-43cd-9e96-5fa4e65cf29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:29.046217 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c43afb-8474-43cd-9e96-5fa4e65cf29a admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:29.046588 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c43afb-8474-43cd-9e96-5fa4e65cf29a admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:29.047170 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c43afb-8474-43cd-9e96-5fa4e65cf29a admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:29.049757 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c43afb-8474-43cd-9e96-5fa4e65cf29a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:29.054045 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c43afb-8474-43cd-9e96-5fa4e65cf29a admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:29.085509 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1083/2165] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:29.086812 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c43afb-8474-43cd-9e96-5fa4e65cf29a admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:29.103384 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c43afb-8474-43cd-9e96-5fa4e65cf29a admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:29.112545 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09013f2-afa6-4c6e-8263-1d7809696a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:29.114266 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09013f2-afa6-4c6e-8263-1d7809696a92 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:29.115235 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09013f2-afa6-4c6e-8263-1d7809696a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:29.117360 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09013f2-afa6-4c6e-8263-1d7809696a92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:29.118434 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09013f2-afa6-4c6e-8263-1d7809696a92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:29.125300 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09013f2-afa6-4c6e-8263-1d7809696a92 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:29.130787 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:29.148919 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1084/2166] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:29.148919 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09013f2-afa6-4c6e-8263-1d7809696a92 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:29.172017 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09013f2-afa6-4c6e-8263-1d7809696a92 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:29.178479 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a466b01a-b8e9-4473-bc01-8152ea1af183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:29.179273 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466b01a-b8e9-4473-bc01-8152ea1af183 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:29.179538 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466b01a-b8e9-4473-bc01-8152ea1af183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:29.179816 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466b01a-b8e9-4473-bc01-8152ea1af183 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:29.180971 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a466b01a-b8e9-4473-bc01-8152ea1af183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:29.182787 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a466b01a-b8e9-4473-bc01-8152ea1af183 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:29.190768 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:29.202385 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1085/2167] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:29.203632 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a466b01a-b8e9-4473-bc01-8152ea1af183 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:29.210369 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac90289-d4ab-4236-81fc-5dbe88932bae admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:29.217606 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09664880-25bb-44b4-82e4-13374ba73375 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:29.218839 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09664880-25bb-44b4-82e4-13374ba73375 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:29.219174 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09664880-25bb-44b4-82e4-13374ba73375 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:29.219316 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a466b01a-b8e9-4473-bc01-8152ea1af183 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:29.219644 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09664880-25bb-44b4-82e4-13374ba73375 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:29.234005 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09664880-25bb-44b4-82e4-13374ba73375 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:29.236612 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09664880-25bb-44b4-82e4-13374ba73375 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:29.253952 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22afb3a4-b9ff-4bff-b96f-d96cd3452372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:29.254967 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afb3a4-b9ff-4bff-b96f-d96cd3452372 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:29.255388 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afb3a4-b9ff-4bff-b96f-d96cd3452372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:29.256301 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afb3a4-b9ff-4bff-b96f-d96cd3452372 admin admin] PATH_INFO: `/v3/projects/d693cd0afe554d569695aac3ba449561/users/1246376ec3134c59b8cc228be03e6904/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:29.269770 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1083/2168] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:22:29.270418 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09664880-25bb-44b4-82e4-13374ba73375 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:29.300414 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22afb3a4-b9ff-4bff-b96f-d96cd3452372 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d693cd0afe554d569695aac3ba449561, user_id=1246376ec3134c59b8cc228be03e6904, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:29.301066 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09664880-25bb-44b4-82e4-13374ba73375 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:29.306578 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22afb3a4-b9ff-4bff-b96f-d96cd3452372 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:29.312129 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a1497d-2880-4ede-9863-ded7f42b56c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:29.314730 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1497d-2880-4ede-9863-ded7f42b56c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:29.315698 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1497d-2880-4ede-9863-ded7f42b56c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:29.316863 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1497d-2880-4ede-9863-ded7f42b56c7 admin admin] PATH_INFO: `/v3/projects/859acc3c2d5e48268667272dc2d850be/users/18392ef8bf1f4679bd28dc870aa74a0d/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:29.346201 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1086/2169] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:22:29 2022] PUT /identity/v3/projects/d693cd0afe554d569695aac3ba449561/users/1246376ec3134c59b8cc228be03e6904/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:29.347390 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a1497d-2880-4ede-9863-ded7f42b56c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=859acc3c2d5e48268667272dc2d850be, user_id=18392ef8bf1f4679bd28dc870aa74a0d, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:29.347590 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22afb3a4-b9ff-4bff-b96f-d96cd3452372 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:29.354251 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a1497d-2880-4ede-9863-ded7f42b56c7 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:29.404214 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1084/2170] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:22:29 2022] PUT /identity/v3/projects/859acc3c2d5e48268667272dc2d850be/users/18392ef8bf1f4679bd28dc870aa74a0d/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:29.407266 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a1497d-2880-4ede-9863-ded7f42b56c7 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:29.466474 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22afb3a4-b9ff-4bff-b96f-d96cd3452372 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:29.606298 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a1497d-2880-4ede-9863-ded7f42b56c7 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:29.614252 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9437b8d3-f0ae-4e3f-b640-4f0aadedecff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:29.615536 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437b8d3-f0ae-4e3f-b640-4f0aadedecff admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:29.616097 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437b8d3-f0ae-4e3f-b640-4f0aadedecff admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:29.616669 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437b8d3-f0ae-4e3f-b640-4f0aadedecff admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:29.618230 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9437b8d3-f0ae-4e3f-b640-4f0aadedecff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:29.621431 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9437b8d3-f0ae-4e3f-b640-4f0aadedecff admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:29.647793 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1085/2171] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:29.658839 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c65cb7-57af-46a4-8586-ba2a88c00a45 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:29.659296 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c65cb7-57af-46a4-8586-ba2a88c00a45 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:29.659729 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c65cb7-57af-46a4-8586-ba2a88c00a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:29.661833 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d97f6b-9ab4-4996-a550-ba65c811cc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:29.662986 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d97f6b-9ab4-4996-a550-ba65c811cc6b admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:29.663482 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d97f6b-9ab4-4996-a550-ba65c811cc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:29.663913 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d97f6b-9ab4-4996-a550-ba65c811cc6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:29.664928 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d97f6b-9ab4-4996-a550-ba65c811cc6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:29.669104 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d97f6b-9ab4-4996-a550-ba65c811cc6b admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:29.687620 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-61c65cb7-57af-46a4-8586-ba2a88c00a45 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:29.687620 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-61c65cb7-57af-46a4-8586-ba2a88c00a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:29.689363 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1087/2172] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:29.691027 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d97f6b-9ab4-4996-a550-ba65c811cc6b admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:29.705819 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d97f6b-9ab4-4996-a550-ba65c811cc6b admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:29.710557 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1086/2173] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:29.721340 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c65cb7-57af-46a4-8586-ba2a88c00a45 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:29.723440 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a4872-ac34-4d75-81d6-a2ab4509e12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:29.726147 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a4872-ac34-4d75-81d6-a2ab4509e12b admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:29.727157 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a4872-ac34-4d75-81d6-a2ab4509e12b admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:29.728242 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a4872-ac34-4d75-81d6-a2ab4509e12b admin admin] PATH_INFO: `/v3/projects/d693cd0afe554d569695aac3ba449561/users/1246376ec3134c59b8cc228be03e6904/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:29.736062 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a4872-ac34-4d75-81d6-a2ab4509e12b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d693cd0afe554d569695aac3ba449561, user_id=1246376ec3134c59b8cc228be03e6904, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:29.744994 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a4872-ac34-4d75-81d6-a2ab4509e12b admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:29.745287 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c65cb7-57af-46a4-8586-ba2a88c00a45 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:29.758225 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60932391-ad43-4f6e-916a-601cb4d71ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:29.759869 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60932391-ad43-4f6e-916a-601cb4d71ea4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:29.760521 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60932391-ad43-4f6e-916a-601cb4d71ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:29.761576 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60932391-ad43-4f6e-916a-601cb4d71ea4 admin admin] PATH_INFO: `/v3/projects/bb5111ab14094d569f910d5546bbec97/users/f4a65ea0b4b2485e80d43b203e6edeb2/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:29.819169 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1088/2174] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:22:29 2022] PUT /identity/v3/projects/d693cd0afe554d569695aac3ba449561/users/1246376ec3134c59b8cc228be03e6904/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:29.821123 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a4872-ac34-4d75-81d6-a2ab4509e12b admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:29.838490 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60932391-ad43-4f6e-916a-601cb4d71ea4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb5111ab14094d569f910d5546bbec97, user_id=f4a65ea0b4b2485e80d43b203e6edeb2, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:29.852350 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60932391-ad43-4f6e-916a-601cb4d71ea4 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:29.920583 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1087/2175] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:22:29 2022] PUT /identity/v3/projects/bb5111ab14094d569f910d5546bbec97/users/f4a65ea0b4b2485e80d43b203e6edeb2/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:29.923411 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff3af8-5f1a-42f8-8c4f-bdc397a4beb5 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:29.923965 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff3af8-5f1a-42f8-8c4f-bdc397a4beb5 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:29.924446 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff3af8-5f1a-42f8-8c4f-bdc397a4beb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:29.983615 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a4872-ac34-4d75-81d6-a2ab4509e12b admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:29.985025 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-41ff3af8-5f1a-42f8-8c4f-bdc397a4beb5 None None] MFA Rules not processed for user `1246376ec3134c59b8cc228be03e6904`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:29.986973 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-41ff3af8-5f1a-42f8-8c4f-bdc397a4beb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:29.995849 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:30.112187 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a166d-350f-4ded-a7d5-d7471f3d15f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:30.113375 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a166d-350f-4ded-a7d5-d7471f3d15f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:30.113926 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a166d-350f-4ded-a7d5-d7471f3d15f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:30.114764 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a166d-350f-4ded-a7d5-d7471f3d15f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:30.130397 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1088/2176] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:29 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:30.133291 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b3ec3-3ca5-4fde-85b2-27bfd67c6a70 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:30.133930 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b3ec3-3ca5-4fde-85b2-27bfd67c6a70 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:30.146317 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b3ec3-3ca5-4fde-85b2-27bfd67c6a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:30.199141 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:30.216367 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f94b3ec3-3ca5-4fde-85b2-27bfd67c6a70 None None] MFA Rules not processed for user `f4a65ea0b4b2485e80d43b203e6edeb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:30.220641 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f94b3ec3-3ca5-4fde-85b2-27bfd67c6a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:30.254236 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a166d-350f-4ded-a7d5-d7471f3d15f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:30.256774 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a166d-350f-4ded-a7d5-d7471f3d15f9 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:30.273326 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1089/2177] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:22:30.275027 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a166d-350f-4ded-a7d5-d7471f3d15f9 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:30.276816 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e90a166d-350f-4ded-a7d5-d7471f3d15f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:30.415318 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1089/2178] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:30.417735 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f54412-cd81-43a2-979f-32361336b020 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:30.418329 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f54412-cd81-43a2-979f-32361336b020 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:30.418893 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f54412-cd81-43a2-979f-32361336b020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:30.447736 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a166d-350f-4ded-a7d5-d7471f3d15f9 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:30.454662 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b89df-0a23-40a6-86f9-4e67ffbc22bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:30.456296 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b89df-0a23-40a6-86f9-4e67ffbc22bb service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:30.456814 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b89df-0a23-40a6-86f9-4e67ffbc22bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:30.458123 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b89df-0a23-40a6-86f9-4e67ffbc22bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:30.478328 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-74f54412-cd81-43a2-979f-32361336b020 None None] MFA Rules not processed for user `f661819d162c407cb816403c5c4866ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:30.482205 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-74f54412-cd81-43a2-979f-32361336b020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:30.611168 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302b89df-0a23-40a6-86f9-4e67ffbc22bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:30.613672 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302b89df-0a23-40a6-86f9-4e67ffbc22bb service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:30.637151 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1090/2179] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:22:30.710283 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02b147-d172-4be2-a1bc-1f0e759db0de None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:30.710591 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02b147-d172-4be2-a1bc-1f0e759db0de None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:30.710862 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02b147-d172-4be2-a1bc-1f0e759db0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:30.719223 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1090/2180] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:30 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:30.737855 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-cc02b147-d172-4be2-a1bc-1f0e759db0de None None] MFA Rules not processed for user `4a8736ee266d48f187f440f5cc69114e`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:30.743705 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-cc02b147-d172-4be2-a1bc-1f0e759db0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:30.767194 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:30.804313 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f54412-cd81-43a2-979f-32361336b020 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:30.807410 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-74f54412-cd81-43a2-979f-32361336b020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:30.860425 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f54412-cd81-43a2-979f-32361336b020 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:30.878594 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac60a51-fe1d-4bf3-80e3-8b2977c40bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:30.882152 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac60a51-fe1d-4bf3-80e3-8b2977c40bcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:30.882685 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac60a51-fe1d-4bf3-80e3-8b2977c40bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:30.883133 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac60a51-fe1d-4bf3-80e3-8b2977c40bcb admin admin] PATH_INFO: `/v3/users/d159c0fd15684a1a9f3b85de98b3a409` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:30.887056 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac60a51-fe1d-4bf3-80e3-8b2977c40bcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d159c0fd15684a1a9f3b85de98b3a409)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:30.918129 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac60a51-fe1d-4bf3-80e3-8b2977c40bcb admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:30.918663 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1091/2181] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:30.920629 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc02b147-d172-4be2-a1bc-1f0e759db0de None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:30.925655 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-cc02b147-d172-4be2-a1bc-1f0e759db0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:30.943518 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc02b147-d172-4be2-a1bc-1f0e759db0de None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:30.948401 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03020507-324d-4a05-8a47-b258de64046f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:30.949351 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03020507-324d-4a05-8a47-b258de64046f service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:30.949526 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03020507-324d-4a05-8a47-b258de64046f service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:30.950297 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03020507-324d-4a05-8a47-b258de64046f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:30.965144 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03020507-324d-4a05-8a47-b258de64046f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:30.970079 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03020507-324d-4a05-8a47-b258de64046f service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:30.997639 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1092/2182] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:22:31.000829 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03020507-324d-4a05-8a47-b258de64046f service cinder] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:31.003224 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-03020507-324d-4a05-8a47-b258de64046f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:31.071257 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-cac60a51-fe1d-4bf3-80e3-8b2977c40bcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd159c0fd15684a1a9f3b85de98b3a409'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:31.073972 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-cac60a51-fe1d-4bf3-80e3-8b2977c40bcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd159c0fd15684a1a9f3b85de98b3a409'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:31.075190 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-cac60a51-fe1d-4bf3-80e3-8b2977c40bcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd159c0fd15684a1a9f3b85de98b3a409'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:31.121305 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-cac60a51-fe1d-4bf3-80e3-8b2977c40bcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd159c0fd15684a1a9f3b85de98b3a409'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:31.142094 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-cac60a51-fe1d-4bf3-80e3-8b2977c40bcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd159c0fd15684a1a9f3b85de98b3a409'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:31.163355 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:31.178468 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1091/2183] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:22:30 2022] DELETE /identity/v3/users/d159c0fd15684a1a9f3b85de98b3a409 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:31.183267 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac60a51-fe1d-4bf3-80e3-8b2977c40bcb admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:31.185625 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-cac60a51-fe1d-4bf3-80e3-8b2977c40bcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:31.227231 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03020507-324d-4a05-8a47-b258de64046f service cinder] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:31.382953 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac60a51-fe1d-4bf3-80e3-8b2977c40bcb admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:31.394931 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4193a028-9fe5-4b97-af8b-dee35549a17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:31.398945 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193a028-9fe5-4b97-af8b-dee35549a17e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:31.399449 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193a028-9fe5-4b97-af8b-dee35549a17e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:31.399820 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193a028-9fe5-4b97-af8b-dee35549a17e admin admin] PATH_INFO: `/v3/users/f4a65ea0b4b2485e80d43b203e6edeb2` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:31.417361 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4193a028-9fe5-4b97-af8b-dee35549a17e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4a65ea0b4b2485e80d43b203e6edeb2)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:31.424744 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4193a028-9fe5-4b97-af8b-dee35549a17e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:31.479753 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6937c190-e787-401a-8716-445dc0858809 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7adaa2ef440941aa8214f2b2fd49b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:31.480072 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6937c190-e787-401a-8716-445dc0858809 service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:31.480768 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6937c190-e787-401a-8716-445dc0858809 service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:31.480768 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6937c190-e787-401a-8716-445dc0858809 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:31.485602 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-6937c190-e787-401a-8716-445dc0858809 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:31.589346 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-4193a028-9fe5-4b97-af8b-dee35549a17e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4a65ea0b4b2485e80d43b203e6edeb2'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:31.590540 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-4193a028-9fe5-4b97-af8b-dee35549a17e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4a65ea0b4b2485e80d43b203e6edeb2'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:31.593159 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-4193a028-9fe5-4b97-af8b-dee35549a17e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4a65ea0b4b2485e80d43b203e6edeb2'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:31.610743 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:31.638810 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-4193a028-9fe5-4b97-af8b-dee35549a17e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4a65ea0b4b2485e80d43b203e6edeb2'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:31.649384 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6937c190-e787-401a-8716-445dc0858809 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:31.653118 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6937c190-e787-401a-8716-445dc0858809 service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:31.653913 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-4193a028-9fe5-4b97-af8b-dee35549a17e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4a65ea0b4b2485e80d43b203e6edeb2'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:31.679857 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1092/2184] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:22:31 2022] DELETE /identity/v3/users/f4a65ea0b4b2485e80d43b203e6edeb2 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:31.680619 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1093/2185] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 682 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:22:31.681431 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e081396-42e3-4af9-af6a-928622c42143 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:31.681937 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e081396-42e3-4af9-af6a-928622c42143 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:31.682203 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e081396-42e3-4af9-af6a-928622c42143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:31.686125 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0079a-4c83-4339-b2cb-6d33ee42f7eb None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:31.687213 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0079a-4c83-4339-b2cb-6d33ee42f7eb None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:31.687510 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0079a-4c83-4339-b2cb-6d33ee42f7eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:31.750189 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-7ef0079a-4c83-4339-b2cb-6d33ee42f7eb None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:31.752818 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-7ef0079a-4c83-4339-b2cb-6d33ee42f7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:31.766923 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-1e081396-42e3-4af9-af6a-928622c42143 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:31.775553 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1e081396-42e3-4af9-af6a-928622c42143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:31.935938 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1093/2186] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:31.958821 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1094/2187] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:22:31.960878 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e081396-42e3-4af9-af6a-928622c42143 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:31.962544 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1e081396-42e3-4af9-af6a-928622c42143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:32.003240 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef0079a-4c83-4339-b2cb-6d33ee42f7eb None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:32.010219 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-7ef0079a-4c83-4339-b2cb-6d33ee42f7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:32.034695 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:32.162473 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e081396-42e3-4af9-af6a-928622c42143 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:32.169455 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee39721-219b-4a55-95a5-a241db930c53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:32.170320 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee39721-219b-4a55-95a5-a241db930c53 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:32.170947 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee39721-219b-4a55-95a5-a241db930c53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:32.171813 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee39721-219b-4a55-95a5-a241db930c53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:32.187351 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee39721-219b-4a55-95a5-a241db930c53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:32.189249 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee39721-219b-4a55-95a5-a241db930c53 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:32.199851 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef0079a-4c83-4339-b2cb-6d33ee42f7eb None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:32.203983 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1094/2188] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:22:32.205351 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd8585-794e-47cb-aefc-b04171b9515c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:32.206119 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c9b2c-5caf-4562-893f-26a0d889640a None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:32.206570 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c9b2c-5caf-4562-893f-26a0d889640a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:32.207131 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c9b2c-5caf-4562-893f-26a0d889640a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:32.207537 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd8585-794e-47cb-aefc-b04171b9515c service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:32.208062 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd8585-794e-47cb-aefc-b04171b9515c service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:32.208722 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd8585-794e-47cb-aefc-b04171b9515c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:32.223474 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dd8585-794e-47cb-aefc-b04171b9515c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:32.227097 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dd8585-794e-47cb-aefc-b04171b9515c service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:32.243594 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1095/2189] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:22:32.253592 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-545c9b2c-5caf-4562-893f-26a0d889640a None None] MFA Rules not processed for user `18392ef8bf1f4679bd28dc870aa74a0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:32.256317 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-545c9b2c-5caf-4562-893f-26a0d889640a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:32.395802 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1095/2190] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:32.408137 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd8585-794e-47cb-aefc-b04171b9515c service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:32.411004 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-58dd8585-794e-47cb-aefc-b04171b9515c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:32.522267 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd8585-794e-47cb-aefc-b04171b9515c service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:32.535419 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab59827-e285-4bab-8076-bd7ddc91f80e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:32.539622 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab59827-e285-4bab-8076-bd7ddc91f80e service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:32.539622 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab59827-e285-4bab-8076-bd7ddc91f80e service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:32.539920 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab59827-e285-4bab-8076-bd7ddc91f80e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:32.577842 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab59827-e285-4bab-8076-bd7ddc91f80e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:32.582658 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab59827-e285-4bab-8076-bd7ddc91f80e service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:32.611757 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1096/2191] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:22:33.147407 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c9b2c-5caf-4562-893f-26a0d889640a None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:33.149990 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-545c9b2c-5caf-4562-893f-26a0d889640a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:33.273349 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab59827-e285-4bab-8076-bd7ddc91f80e service cinder] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:33.274437 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c9b2c-5caf-4562-893f-26a0d889640a None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:33.277237 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-8ab59827-e285-4bab-8076-bd7ddc91f80e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:33.288743 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8aa04e-d339-4ab1-a517-7770a8b9b510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:33.291438 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8aa04e-d339-4ab1-a517-7770a8b9b510 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:33.292084 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8aa04e-d339-4ab1-a517-7770a8b9b510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:33.292735 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8aa04e-d339-4ab1-a517-7770a8b9b510 admin admin] PATH_INFO: `/v3/projects/bb5111ab14094d569f910d5546bbec97` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:33.299008 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8aa04e-d339-4ab1-a517-7770a8b9b510 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb5111ab14094d569f910d5546bbec97)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:33.311664 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8aa04e-d339-4ab1-a517-7770a8b9b510 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:33.326922 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab59827-e285-4bab-8076-bd7ddc91f80e service cinder] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:33.341164 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee2553f-5963-41e3-a9f0-6f1139aa0532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:33.343897 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2553f-5963-41e3-a9f0-6f1139aa0532 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:33.345009 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2553f-5963-41e3-a9f0-6f1139aa0532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:33.346431 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2553f-5963-41e3-a9f0-6f1139aa0532 admin admin] PATH_INFO: `/v3/projects/bb9e171732904139816e631460cbabff` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:33.352031 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee2553f-5963-41e3-a9f0-6f1139aa0532 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb9e171732904139816e631460cbabff)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:33.360497 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee2553f-5963-41e3-a9f0-6f1139aa0532 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:33.439216 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9d8aa04e-d339-4ab1-a517-7770a8b9b510 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb5111ab14094d569f910d5546bbec97', 'request_id': 'req-9d8aa04e-d339-4ab1-a517-7770a8b9b510'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:33.476256 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9d8aa04e-d339-4ab1-a517-7770a8b9b510 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb5111ab14094d569f910d5546bbec97', 'request_id': 'req-9d8aa04e-d339-4ab1-a517-7770a8b9b510'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:33.477176 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:33.489969 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9d8aa04e-d339-4ab1-a517-7770a8b9b510 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb5111ab14094d569f910d5546bbec97', 'request_id': 'req-9d8aa04e-d339-4ab1-a517-7770a8b9b510'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:33.527212 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9d8aa04e-d339-4ab1-a517-7770a8b9b510 admin admin] The token cache is being invalidate because project bb5111ab14094d569f910d5546bbec97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:22:33.528309 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9d8aa04e-d339-4ab1-a517-7770a8b9b510 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:33.548254 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9d8aa04e-d339-4ab1-a517-7770a8b9b510 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:33.562775 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1096/2192] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:22:33 2022] DELETE /identity/v3/projects/bb5111ab14094d569f910d5546bbec97 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:33.564966 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfefdfef-5e44-4c4b-a2d5-fa58e2db3c9d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:33.565504 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfefdfef-5e44-4c4b-a2d5-fa58e2db3c9d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:33.565912 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfefdfef-5e44-4c4b-a2d5-fa58e2db3c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:33.585914 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2ee2553f-5963-41e3-a9f0-6f1139aa0532 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb9e171732904139816e631460cbabff', 'request_id': 'req-2ee2553f-5963-41e3-a9f0-6f1139aa0532'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:33.615187 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2ee2553f-5963-41e3-a9f0-6f1139aa0532 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb9e171732904139816e631460cbabff', 'request_id': 'req-2ee2553f-5963-41e3-a9f0-6f1139aa0532'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:33.636084 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-cfefdfef-5e44-4c4b-a2d5-fa58e2db3c9d None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:33.639985 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-cfefdfef-5e44-4c4b-a2d5-fa58e2db3c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:33.655009 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2ee2553f-5963-41e3-a9f0-6f1139aa0532 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb9e171732904139816e631460cbabff', 'request_id': 'req-2ee2553f-5963-41e3-a9f0-6f1139aa0532'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:33.709316 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2ee2553f-5963-41e3-a9f0-6f1139aa0532 admin admin] The token cache is being invalidate because project bb9e171732904139816e631460cbabff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:22:33.709826 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2ee2553f-5963-41e3-a9f0-6f1139aa0532 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:33.713348 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2ee2553f-5963-41e3-a9f0-6f1139aa0532 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:33.720856 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1097/2193] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:22:33 2022] DELETE /identity/v3/projects/bb9e171732904139816e631460cbabff => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:33.737292 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee2553f-5963-41e3-a9f0-6f1139aa0532 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:33.755695 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-2ee2553f-5963-41e3-a9f0-6f1139aa0532 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:33.809346 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:33.895817 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1097/2194] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:33.909239 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b08dda-c935-44a9-8c15-07e6b8951c60 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:33.909746 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b08dda-c935-44a9-8c15-07e6b8951c60 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:33.909887 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b08dda-c935-44a9-8c15-07e6b8951c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:33.984755 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-d6b08dda-c935-44a9-8c15-07e6b8951c60 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:33.986355 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d6b08dda-c935-44a9-8c15-07e6b8951c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:33.996432 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1098/2195] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:22:34.003931 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b08dda-c935-44a9-8c15-07e6b8951c60 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:34.044326 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b08dda-c935-44a9-8c15-07e6b8951c60 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:34.067735 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a67ddd-5b6f-426c-93fc-da8df1a51084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:34.068512 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a67ddd-5b6f-426c-93fc-da8df1a51084 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:34.069037 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a67ddd-5b6f-426c-93fc-da8df1a51084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:34.069405 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a67ddd-5b6f-426c-93fc-da8df1a51084 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:34.073477 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a67ddd-5b6f-426c-93fc-da8df1a51084 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:22:34.074115 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a67ddd-5b6f-426c-93fc-da8df1a51084 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:34.075977 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a67ddd-5b6f-426c-93fc-da8df1a51084 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:34.089055 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee2553f-5963-41e3-a9f0-6f1139aa0532 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:34.105961 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d85ef-a064-4cfa-80c7-1f6f7aba2b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:34.108660 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d85ef-a064-4cfa-80c7-1f6f7aba2b52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:34.109259 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d85ef-a064-4cfa-80c7-1f6f7aba2b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:34.109427 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d85ef-a064-4cfa-80c7-1f6f7aba2b52 admin admin] PATH_INFO: `/v3/users/79284959d5d54095afb8b1ac26dd4793` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:34.111109 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321d85ef-a064-4cfa-80c7-1f6f7aba2b52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79284959d5d54095afb8b1ac26dd4793)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:34.114064 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321d85ef-a064-4cfa-80c7-1f6f7aba2b52 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:34.121672 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1099/2196] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:22:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:22:34.146953 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a67ddd-5b6f-426c-93fc-da8df1a51084 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:34.180415 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a67ddd-5b6f-426c-93fc-da8df1a51084 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:34.205047 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61b8763-ed7d-4233-8b7f-ece85309834f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:34.206464 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b8763-ed7d-4233-8b7f-ece85309834f admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:34.207077 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b8763-ed7d-4233-8b7f-ece85309834f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:34.208324 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b8763-ed7d-4233-8b7f-ece85309834f admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:34.212061 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61b8763-ed7d-4233-8b7f-ece85309834f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:34.217118 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61b8763-ed7d-4233-8b7f-ece85309834f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:34.263675 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-321d85ef-a064-4cfa-80c7-1f6f7aba2b52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79284959d5d54095afb8b1ac26dd4793'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:34.302974 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1100/2197] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:22:34 2022] POST /identity/v3/projects => generated 391 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:34.303486 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-321d85ef-a064-4cfa-80c7-1f6f7aba2b52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79284959d5d54095afb8b1ac26dd4793'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:34.310437 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61b8763-ed7d-4233-8b7f-ece85309834f admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:34.339242 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-321d85ef-a064-4cfa-80c7-1f6f7aba2b52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79284959d5d54095afb8b1ac26dd4793'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:34.341821 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-321d85ef-a064-4cfa-80c7-1f6f7aba2b52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79284959d5d54095afb8b1ac26dd4793'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:34.361428 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-321d85ef-a064-4cfa-80c7-1f6f7aba2b52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79284959d5d54095afb8b1ac26dd4793'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:34.384382 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1098/2198] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:22:33 2022] DELETE /identity/v3/users/79284959d5d54095afb8b1ac26dd4793 => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:34.421232 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e697f1e-4967-4684-b514-f18360690baf None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:34.421897 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e697f1e-4967-4684-b514-f18360690baf None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:34.422418 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e697f1e-4967-4684-b514-f18360690baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:34.469995 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-1e697f1e-4967-4684-b514-f18360690baf None None] MFA Rules not processed for user `18392ef8bf1f4679bd28dc870aa74a0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:34.473013 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-1e697f1e-4967-4684-b514-f18360690baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:34.514467 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61b8763-ed7d-4233-8b7f-ece85309834f admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:34.540787 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:34.731016 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1099/2199] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:22:34.797121 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b86af7-6ca7-4f11-829f-a53817a1cb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:34.803297 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b86af7-6ca7-4f11-829f-a53817a1cb5a admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:34.806744 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b86af7-6ca7-4f11-829f-a53817a1cb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:34.807342 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b86af7-6ca7-4f11-829f-a53817a1cb5a admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:34.808128 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b86af7-6ca7-4f11-829f-a53817a1cb5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:34.810895 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b86af7-6ca7-4f11-829f-a53817a1cb5a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:34.868155 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1101/2200] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:22:34 2022] POST /identity/v3/users => generated 296 bytes in 563 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:34.874633 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e697f1e-4967-4684-b514-f18360690baf None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:34.877188 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-1e697f1e-4967-4684-b514-f18360690baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:34.916934 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e697f1e-4967-4684-b514-f18360690baf None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:34.946015 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af8dedf-a883-45f2-9f9c-b3ae6ea498bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:34.947374 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8dedf-a883-45f2-9f9c-b3ae6ea498bf admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:34.950552 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8dedf-a883-45f2-9f9c-b3ae6ea498bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:34.951102 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8dedf-a883-45f2-9f9c-b3ae6ea498bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:34.955896 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af8dedf-a883-45f2-9f9c-b3ae6ea498bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:34.959979 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af8dedf-a883-45f2-9f9c-b3ae6ea498bf admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:35.038194 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1100/2201] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:35.043483 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b86af7-6ca7-4f11-829f-a53817a1cb5a admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:35.079223 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b86af7-6ca7-4f11-829f-a53817a1cb5a admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:35.094780 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c52b39e-b0dd-4682-b85a-59b1c32ca130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:35.101126 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52b39e-b0dd-4682-b85a-59b1c32ca130 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:35.101599 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52b39e-b0dd-4682-b85a-59b1c32ca130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:35.106469 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52b39e-b0dd-4682-b85a-59b1c32ca130 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:35.108210 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c52b39e-b0dd-4682-b85a-59b1c32ca130 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:35.111360 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c52b39e-b0dd-4682-b85a-59b1c32ca130 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:35.159628 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1102/2202] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:35.160614 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af8dedf-a883-45f2-9f9c-b3ae6ea498bf admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:35.174807 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af8dedf-a883-45f2-9f9c-b3ae6ea498bf admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:35.186346 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06586c8-7d53-48d1-b792-49d450744fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:35.190803 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06586c8-7d53-48d1-b792-49d450744fd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:35.191333 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06586c8-7d53-48d1-b792-49d450744fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:35.191757 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06586c8-7d53-48d1-b792-49d450744fd4 admin admin] PATH_INFO: `/v3/projects/5df52cc76f4c42f6b92c22dfac87078a/users/4f926aaad43e46adafb1e378a6df8a3d/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:35.236454 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06586c8-7d53-48d1-b792-49d450744fd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5df52cc76f4c42f6b92c22dfac87078a, user_id=4f926aaad43e46adafb1e378a6df8a3d, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:35.255744 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06586c8-7d53-48d1-b792-49d450744fd4 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:35.310076 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1101/2203] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:22:35 2022] PUT /identity/v3/projects/5df52cc76f4c42f6b92c22dfac87078a/users/4f926aaad43e46adafb1e378a6df8a3d/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:35.322280 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8559acb-b86b-4192-affe-710ec4cbea5d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:35.322833 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8559acb-b86b-4192-affe-710ec4cbea5d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:35.322923 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8559acb-b86b-4192-affe-710ec4cbea5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:35.393953 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-a8559acb-b86b-4192-affe-710ec4cbea5d None None] MFA Rules not processed for user `4f926aaad43e46adafb1e378a6df8a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:35.395894 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a8559acb-b86b-4192-affe-710ec4cbea5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:35.407698 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:35.624193 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1103/2204] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:35.639340 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06586c8-7d53-48d1-b792-49d450744fd4 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:35.642587 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-d06586c8-7d53-48d1-b792-49d450744fd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:35.879065 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06586c8-7d53-48d1-b792-49d450744fd4 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:35.886908 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e3fa7e-51b8-4a64-9cf9-869fb678426c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:35.888529 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3fa7e-51b8-4a64-9cf9-869fb678426c service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:35.889058 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3fa7e-51b8-4a64-9cf9-869fb678426c service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:35.889537 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3fa7e-51b8-4a64-9cf9-869fb678426c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:35.908961 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e3fa7e-51b8-4a64-9cf9-869fb678426c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:35.912748 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e3fa7e-51b8-4a64-9cf9-869fb678426c service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:35.946912 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1102/2205] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:35 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:22:36.740169 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8559acb-b86b-4192-affe-710ec4cbea5d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:36.744132 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a8559acb-b86b-4192-affe-710ec4cbea5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:37.058799 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8559acb-b86b-4192-affe-710ec4cbea5d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:37.080897 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94259a93-0970-4d70-b540-dfb0df5918de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:37.082628 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94259a93-0970-4d70-b540-dfb0df5918de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:37.083148 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94259a93-0970-4d70-b540-dfb0df5918de admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:37.083823 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94259a93-0970-4d70-b540-dfb0df5918de admin admin] PATH_INFO: `/v3/projects/a44b95e1820544bca995ab93f902c53d` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:37.087966 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94259a93-0970-4d70-b540-dfb0df5918de admin admin] RBAC: Authorizing `identity:delete_project(project_id=a44b95e1820544bca995ab93f902c53d)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:37.096268 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94259a93-0970-4d70-b540-dfb0df5918de admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:37.251184 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e3fa7e-51b8-4a64-9cf9-869fb678426c service cinder] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:37.253037 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-94259a93-0970-4d70-b540-dfb0df5918de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a44b95e1820544bca995ab93f902c53d', 'request_id': 'req-94259a93-0970-4d70-b540-dfb0df5918de'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:37.280909 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e3fa7e-51b8-4a64-9cf9-869fb678426c service cinder] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:37.282636 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-94259a93-0970-4d70-b540-dfb0df5918de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a44b95e1820544bca995ab93f902c53d', 'request_id': 'req-94259a93-0970-4d70-b540-dfb0df5918de'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:37.305207 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-94259a93-0970-4d70-b540-dfb0df5918de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a44b95e1820544bca995ab93f902c53d', 'request_id': 'req-94259a93-0970-4d70-b540-dfb0df5918de'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:37.346365 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-94259a93-0970-4d70-b540-dfb0df5918de admin admin] The token cache is being invalidate because project a44b95e1820544bca995ab93f902c53d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:22:37.347356 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-94259a93-0970-4d70-b540-dfb0df5918de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:37.348093 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-94259a93-0970-4d70-b540-dfb0df5918de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:37.354834 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1104/2206] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:22:36 2022] DELETE /identity/v3/projects/a44b95e1820544bca995ab93f902c53d => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:37.362546 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b489d0-48c0-4532-a6af-c344ed53a175 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:37.362546 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b489d0-48c0-4532-a6af-c344ed53a175 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:37.362546 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b489d0-48c0-4532-a6af-c344ed53a175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:37.423519 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-48b489d0-48c0-4532-a6af-c344ed53a175 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:37.425714 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-48b489d0-48c0-4532-a6af-c344ed53a175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:37.502393 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:37.516070 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b70b61-2459-48e3-a922-38907943cc83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:37.517275 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b70b61-2459-48e3-a922-38907943cc83 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:37.517837 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b70b61-2459-48e3-a922-38907943cc83 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:37.518170 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b70b61-2459-48e3-a922-38907943cc83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:37.521434 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-14b70b61-2459-48e3-a922-38907943cc83 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:37.575823 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1105/2207] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:37.590416 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542812c-533a-4f6a-8906-144c3d98ef75 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:37.591166 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542812c-533a-4f6a-8906-144c3d98ef75 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:37.591980 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542812c-533a-4f6a-8906-144c3d98ef75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:37.658639 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-5542812c-533a-4f6a-8906-144c3d98ef75 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:37.660610 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5542812c-533a-4f6a-8906-144c3d98ef75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:37.661590 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:37.676190 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1106/2208] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:37.681897 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542812c-533a-4f6a-8906-144c3d98ef75 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:37.691208 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b70b61-2459-48e3-a922-38907943cc83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:37.692851 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b70b61-2459-48e3-a922-38907943cc83 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:37.708342 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1103/2209] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:37 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:22:37.714213 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542812c-533a-4f6a-8906-144c3d98ef75 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:37.732032 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db1eac-1b18-45e4-8435-824ec5ecdb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:37.733108 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db1eac-1b18-45e4-8435-824ec5ecdb30 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:37.733438 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db1eac-1b18-45e4-8435-824ec5ecdb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:37.733955 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db1eac-1b18-45e4-8435-824ec5ecdb30 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:37.736854 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db1eac-1b18-45e4-8435-824ec5ecdb30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:22:37.737409 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db1eac-1b18-45e4-8435-824ec5ecdb30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:37.740392 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db1eac-1b18-45e4-8435-824ec5ecdb30 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:37.765762 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1107/2210] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:22:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:22:37.767406 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b70b61-2459-48e3-a922-38907943cc83 service cinder] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:37.813276 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b70b61-2459-48e3-a922-38907943cc83 service cinder] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:37.826673 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab0a4ff-af80-42c3-8544-cb183042cf29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:37.827563 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab0a4ff-af80-42c3-8544-cb183042cf29 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:37.829157 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab0a4ff-af80-42c3-8544-cb183042cf29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:37.829569 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab0a4ff-af80-42c3-8544-cb183042cf29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:37.830358 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab0a4ff-af80-42c3-8544-cb183042cf29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:37.832547 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab0a4ff-af80-42c3-8544-cb183042cf29 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:37.921733 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db1eac-1b18-45e4-8435-824ec5ecdb30 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:37.933051 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1104/2211] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:22:37 2022] POST /identity/v3/projects => generated 375 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:37.937477 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db1eac-1b18-45e4-8435-824ec5ecdb30 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:38.182485 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45bd833-df90-407d-b88c-d739f18174ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:38.183481 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45bd833-df90-407d-b88c-d739f18174ef admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:38.183647 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45bd833-df90-407d-b88c-d739f18174ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:38.183909 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45bd833-df90-407d-b88c-d739f18174ef admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:38.184696 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45bd833-df90-407d-b88c-d739f18174ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:38.186888 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45bd833-df90-407d-b88c-d739f18174ef admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:38.252677 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1108/2212] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:22:37 2022] POST /identity/v3/users => generated 288 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:22:38.258746 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab0a4ff-af80-42c3-8544-cb183042cf29 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:38.284523 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab0a4ff-af80-42c3-8544-cb183042cf29 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:38.303912 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc3857c-44b8-4af9-ad31-474f1354c8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:38.304915 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3857c-44b8-4af9-ad31-474f1354c8c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:38.305331 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3857c-44b8-4af9-ad31-474f1354c8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:38.305751 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3857c-44b8-4af9-ad31-474f1354c8c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:38.310158 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc3857c-44b8-4af9-ad31-474f1354c8c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:38.312352 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc3857c-44b8-4af9-ad31-474f1354c8c5 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:38.348954 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1105/2213] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:38.358716 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45bd833-df90-407d-b88c-d739f18174ef admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:38.426865 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45bd833-df90-407d-b88c-d739f18174ef admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:38.460138 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b693581-9239-4305-a759-a01dc85d3ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:38.464388 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b693581-9239-4305-a759-a01dc85d3ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:38.464388 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b693581-9239-4305-a759-a01dc85d3ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:38.464818 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b693581-9239-4305-a759-a01dc85d3ec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:38.469832 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b693581-9239-4305-a759-a01dc85d3ec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:38.478560 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b693581-9239-4305-a759-a01dc85d3ec7 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:38.510192 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1109/2214] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:38.512547 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc3857c-44b8-4af9-ad31-474f1354c8c5 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:38.568793 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc3857c-44b8-4af9-ad31-474f1354c8c5 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:38.595278 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e065b95-c5b1-4e3c-93d8-fec98cff26db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:38.602623 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e065b95-c5b1-4e3c-93d8-fec98cff26db admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:38.603314 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e065b95-c5b1-4e3c-93d8-fec98cff26db admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:38.603975 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e065b95-c5b1-4e3c-93d8-fec98cff26db admin admin] PATH_INFO: `/v3/projects/67fe7ff4899a40c3b7dd80e36f06c1b0/users/a30ee4122298431d8a318a7f59c74c85/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:38.667071 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e065b95-c5b1-4e3c-93d8-fec98cff26db admin admin] RBAC: Authorizing `identity:create_grant(project_id=67fe7ff4899a40c3b7dd80e36f06c1b0, user_id=a30ee4122298431d8a318a7f59c74c85, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:38.683498 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e065b95-c5b1-4e3c-93d8-fec98cff26db admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:38.730374 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1106/2215] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:22:38 2022] PUT /identity/v3/projects/67fe7ff4899a40c3b7dd80e36f06c1b0/users/a30ee4122298431d8a318a7f59c74c85/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:38.744235 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee0309-9620-4bed-8ae0-ec079ed59d4c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:38.748468 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee0309-9620-4bed-8ae0-ec079ed59d4c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:38.750080 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee0309-9620-4bed-8ae0-ec079ed59d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:38.931717 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-2fee0309-9620-4bed-8ae0-ec079ed59d4c None None] MFA Rules not processed for user `a30ee4122298431d8a318a7f59c74c85`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:38.936164 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2fee0309-9620-4bed-8ae0-ec079ed59d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:39.169936 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1110/2216] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 428 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:39.175831 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e065b95-c5b1-4e3c-93d8-fec98cff26db admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:39.343358 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e065b95-c5b1-4e3c-93d8-fec98cff26db admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:39.354394 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef82a7-dcc4-4dd4-94fd-d0b0e920d32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:39.354801 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef82a7-dcc4-4dd4-94fd-d0b0e920d32c admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:39.355092 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef82a7-dcc4-4dd4-94fd-d0b0e920d32c admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:39.355371 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef82a7-dcc4-4dd4-94fd-d0b0e920d32c admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:39.356845 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef82a7-dcc4-4dd4-94fd-d0b0e920d32c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:39.364822 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef82a7-dcc4-4dd4-94fd-d0b0e920d32c admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:39.441018 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1107/2217] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:22:39 2022] POST /identity/v3/projects => generated 377 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:22:39.446816 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee0309-9620-4bed-8ae0-ec079ed59d4c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:39.468454 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee0309-9620-4bed-8ae0-ec079ed59d4c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:39.533038 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:39.654168 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f140da-9fe4-4893-824c-f1b031c3a5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:39.655668 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f140da-9fe4-4893-824c-f1b031c3a5f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:39.656148 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f140da-9fe4-4893-824c-f1b031c3a5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:39.657492 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f140da-9fe4-4893-824c-f1b031c3a5f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:39.659109 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f140da-9fe4-4893-824c-f1b031c3a5f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:39.664166 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f140da-9fe4-4893-824c-f1b031c3a5f6 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:39.722251 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef82a7-dcc4-4dd4-94fd-d0b0e920d32c admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:39.725387 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1111/2218] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:22:39 2022] POST /identity/v3/users => generated 289 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:22:39.740765 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef82a7-dcc4-4dd4-94fd-d0b0e920d32c admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:39.760900 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0d11f-3c00-4ab2-8a48-7cd13da55f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:39.762519 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0d11f-3c00-4ab2-8a48-7cd13da55f15 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:39.766329 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0d11f-3c00-4ab2-8a48-7cd13da55f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:39.768287 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0d11f-3c00-4ab2-8a48-7cd13da55f15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:39.772811 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e0d11f-3c00-4ab2-8a48-7cd13da55f15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:39.783452 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e0d11f-3c00-4ab2-8a48-7cd13da55f15 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:39.858782 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f140da-9fe4-4893-824c-f1b031c3a5f6 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:39.859315 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1108/2219] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:22:39.883118 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f140da-9fe4-4893-824c-f1b031c3a5f6 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:39.904527 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d56861-679c-4c3e-abcf-0b289849ee60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:39.911917 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d56861-679c-4c3e-abcf-0b289849ee60 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:39.912704 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d56861-679c-4c3e-abcf-0b289849ee60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:39.913083 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d56861-679c-4c3e-abcf-0b289849ee60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:39.914350 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d56861-679c-4c3e-abcf-0b289849ee60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:39.920945 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d56861-679c-4c3e-abcf-0b289849ee60 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:39.948836 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1112/2220] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:39.950840 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0d11f-3c00-4ab2-8a48-7cd13da55f15 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:39.965584 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0d11f-3c00-4ab2-8a48-7cd13da55f15 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:39.989497 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b42371-7b47-4b6d-b222-917999e0af51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:39.992375 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b42371-7b47-4b6d-b222-917999e0af51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:39.992885 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b42371-7b47-4b6d-b222-917999e0af51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:39.993455 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b42371-7b47-4b6d-b222-917999e0af51 admin admin] PATH_INFO: `/v3/projects/b717f5606d384e15bdfc0b34b6328d09/users/b2301f089da44259b32f5d54cd14ea5f/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:40.053832 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b42371-7b47-4b6d-b222-917999e0af51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b717f5606d384e15bdfc0b34b6328d09, user_id=b2301f089da44259b32f5d54cd14ea5f, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:40.064723 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b42371-7b47-4b6d-b222-917999e0af51 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:40.117425 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1109/2221] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:22:39 2022] PUT /identity/v3/projects/b717f5606d384e15bdfc0b34b6328d09/users/b2301f089da44259b32f5d54cd14ea5f/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:40.143175 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545d2d9-f079-4b79-9525-121dfe75df38 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:40.143874 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545d2d9-f079-4b79-9525-121dfe75df38 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:40.144603 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545d2d9-f079-4b79-9525-121dfe75df38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:40.264902 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-a545d2d9-f079-4b79-9525-121dfe75df38 None None] MFA Rules not processed for user `b2301f089da44259b32f5d54cd14ea5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:40.276172 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a545d2d9-f079-4b79-9525-121dfe75df38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:40.631395 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1113/2222] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 492 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:40.633230 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b42371-7b47-4b6d-b222-917999e0af51 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:40.989845 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:41.111309 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b42371-7b47-4b6d-b222-917999e0af51 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:41.141820 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c9288-5c54-4534-a4db-50baee2fc72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:41.143021 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c9288-5c54-4534-a4db-50baee2fc72f admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:41.143382 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c9288-5c54-4534-a4db-50baee2fc72f admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:41.143842 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c9288-5c54-4534-a4db-50baee2fc72f admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:41.156328 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46c9288-5c54-4534-a4db-50baee2fc72f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:41.166331 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46c9288-5c54-4534-a4db-50baee2fc72f admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:41.255682 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1110/2223] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:22:40 2022] POST /identity/v3/projects => generated 377 bytes in 623 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:41.261337 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a545d2d9-f079-4b79-9525-121dfe75df38 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:41.320038 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a545d2d9-f079-4b79-9525-121dfe75df38 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:41.561495 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba754af3-3182-4b89-ac62-e4c5565ed2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:41.563337 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba754af3-3182-4b89-ac62-e4c5565ed2cf admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:41.566460 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba754af3-3182-4b89-ac62-e4c5565ed2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:41.574549 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba754af3-3182-4b89-ac62-e4c5565ed2cf admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:41.576191 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba754af3-3182-4b89-ac62-e4c5565ed2cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:41.580317 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba754af3-3182-4b89-ac62-e4c5565ed2cf admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:41.656680 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1114/2224] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:22:41 2022] POST /identity/v3/users => generated 295 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:41.664542 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c9288-5c54-4534-a4db-50baee2fc72f admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:41.702471 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c9288-5c54-4534-a4db-50baee2fc72f admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:41.713082 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c36de-43db-4e8a-9deb-e0eae1201cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:41.714321 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c36de-43db-4e8a-9deb-e0eae1201cdd admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:41.714784 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c36de-43db-4e8a-9deb-e0eae1201cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:41.715378 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c36de-43db-4e8a-9deb-e0eae1201cdd admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:41.717459 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947c36de-43db-4e8a-9deb-e0eae1201cdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:41.719675 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947c36de-43db-4e8a-9deb-e0eae1201cdd admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:41.742332 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1111/2225] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:22:41.749268 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba754af3-3182-4b89-ac62-e4c5565ed2cf admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:41.765069 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba754af3-3182-4b89-ac62-e4c5565ed2cf admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:41.774215 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cc9d93-17bf-4998-916c-229aa876ea49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:41.775255 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc9d93-17bf-4998-916c-229aa876ea49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:41.775780 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc9d93-17bf-4998-916c-229aa876ea49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:41.776146 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc9d93-17bf-4998-916c-229aa876ea49 admin admin] PATH_INFO: `/v3/projects/0f98c1c049894b6aa72a6e6b9b24f255/users/a1d007779d334a32af633bffc28b9d88/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:41.813196 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cc9d93-17bf-4998-916c-229aa876ea49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f98c1c049894b6aa72a6e6b9b24f255, user_id=a1d007779d334a32af633bffc28b9d88, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:41.816734 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cc9d93-17bf-4998-916c-229aa876ea49 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:41.831530 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:41.839467 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1115/2226] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:22:41 2022] PUT /identity/v3/projects/0f98c1c049894b6aa72a6e6b9b24f255/users/a1d007779d334a32af633bffc28b9d88/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:41.844582 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c36de-43db-4e8a-9deb-e0eae1201cdd admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:41.860740 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c36de-43db-4e8a-9deb-e0eae1201cdd admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:42.005117 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa87996-fd40-442c-84d5-96fe1c3d53ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:42.006520 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa87996-fd40-442c-84d5-96fe1c3d53ef admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:42.007047 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa87996-fd40-442c-84d5-96fe1c3d53ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:42.007765 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa87996-fd40-442c-84d5-96fe1c3d53ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:42.008939 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa87996-fd40-442c-84d5-96fe1c3d53ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:42.010960 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa87996-fd40-442c-84d5-96fe1c3d53ef admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:42.026469 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1112/2227] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:22:42.031378 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cc9d93-17bf-4998-916c-229aa876ea49 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:42.067431 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cc9d93-17bf-4998-916c-229aa876ea49 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:42.106531 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa4ebb5-7338-49ac-be77-6b19e69b325c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:42.111634 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4ebb5-7338-49ac-be77-6b19e69b325c admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:42.112226 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4ebb5-7338-49ac-be77-6b19e69b325c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:42.114874 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4ebb5-7338-49ac-be77-6b19e69b325c admin admin] PATH_INFO: `/v3/projects/0f98c1c049894b6aa72a6e6b9b24f255/users/a1d007779d334a32af633bffc28b9d88/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:42.125907 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa4ebb5-7338-49ac-be77-6b19e69b325c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f98c1c049894b6aa72a6e6b9b24f255, user_id=a1d007779d334a32af633bffc28b9d88, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:42.129338 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa4ebb5-7338-49ac-be77-6b19e69b325c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:42.149477 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1116/2228] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:22:42 2022] PUT /identity/v3/projects/0f98c1c049894b6aa72a6e6b9b24f255/users/a1d007779d334a32af633bffc28b9d88/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:42.174983 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fed609-14ed-4e55-8263-96b3cf58e588 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:42.175941 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fed609-14ed-4e55-8263-96b3cf58e588 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:42.176375 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fed609-14ed-4e55-8263-96b3cf58e588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:42.284377 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-57fed609-14ed-4e55-8263-96b3cf58e588 None None] MFA Rules not processed for user `a1d007779d334a32af633bffc28b9d88`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:42.287133 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-57fed609-14ed-4e55-8263-96b3cf58e588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:42.581011 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1113/2229] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:42 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:42.604692 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa4ebb5-7338-49ac-be77-6b19e69b325c admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:42.608485 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3fa4ebb5-7338-49ac-be77-6b19e69b325c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:42.822952 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa4ebb5-7338-49ac-be77-6b19e69b325c admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:42.845680 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c021766-f611-4776-a11a-d8d3e9d68589 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:42.848456 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c021766-f611-4776-a11a-d8d3e9d68589 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:42.849494 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c021766-f611-4776-a11a-d8d3e9d68589 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:42.849494 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c021766-f611-4776-a11a-d8d3e9d68589 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:43.057748 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c021766-f611-4776-a11a-d8d3e9d68589 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:43.061404 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c021766-f611-4776-a11a-d8d3e9d68589 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:43.111200 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1117/2230] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:22:43.175697 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4eec8-18ca-4292-8568-980a3b6edf14 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:43.177438 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4eec8-18ca-4292-8568-980a3b6edf14 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:43.178399 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4eec8-18ca-4292-8568-980a3b6edf14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:43.250972 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-9cf4eec8-18ca-4292-8568-980a3b6edf14 None None] MFA Rules not processed for user `e876198e863542518f9f932eb61f3403`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:43.257961 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-9cf4eec8-18ca-4292-8568-980a3b6edf14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:43.339851 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:43.389233 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1114/2231] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:22:43.407602 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c021766-f611-4776-a11a-d8d3e9d68589 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:43.413187 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8c021766-f611-4776-a11a-d8d3e9d68589 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:43.620965 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c021766-f611-4776-a11a-d8d3e9d68589 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:43.629050 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e68934-584e-4219-8b05-80fe79d18f7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7adaa2ef440941aa8214f2b2fd49b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:43.630046 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e68934-584e-4219-8b05-80fe79d18f7c service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:43.630277 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e68934-584e-4219-8b05-80fe79d18f7c service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:43.631073 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e68934-584e-4219-8b05-80fe79d18f7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:43.653274 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e68934-584e-4219-8b05-80fe79d18f7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:43.657925 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e68934-584e-4219-8b05-80fe79d18f7c service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:43.672724 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1118/2232] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:43 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:22:45.073143 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf4eec8-18ca-4292-8568-980a3b6edf14 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:45.075635 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-9cf4eec8-18ca-4292-8568-980a3b6edf14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:45.278050 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf4eec8-18ca-4292-8568-980a3b6edf14 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:45.278050 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ded99-02b2-4506-a142-3a7fedac0598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:45.278050 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ded99-02b2-4506-a142-3a7fedac0598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:45.278050 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ded99-02b2-4506-a142-3a7fedac0598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:45.278624 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ded99-02b2-4506-a142-3a7fedac0598 admin admin] PATH_INFO: `/v3/users/1d614607f38c4d85ba6131d340848de6` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:45.278883 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ded99-02b2-4506-a142-3a7fedac0598 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d614607f38c4d85ba6131d340848de6)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:45.281296 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ded99-02b2-4506-a142-3a7fedac0598 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:45.369493 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-471ded99-02b2-4506-a142-3a7fedac0598 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d614607f38c4d85ba6131d340848de6'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:45.410532 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-471ded99-02b2-4506-a142-3a7fedac0598 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d614607f38c4d85ba6131d340848de6'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:45.446660 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-471ded99-02b2-4506-a142-3a7fedac0598 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d614607f38c4d85ba6131d340848de6'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:45.453815 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-471ded99-02b2-4506-a142-3a7fedac0598 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d614607f38c4d85ba6131d340848de6'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:45.479259 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-471ded99-02b2-4506-a142-3a7fedac0598 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d614607f38c4d85ba6131d340848de6'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:45.498262 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1115/2233] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:22:45 2022] DELETE /identity/v3/users/1d614607f38c4d85ba6131d340848de6 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:45.504515 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656b7b1-0a8e-41eb-ba12-c5af454a1b10 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:45.506174 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656b7b1-0a8e-41eb-ba12-c5af454a1b10 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:45.506960 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656b7b1-0a8e-41eb-ba12-c5af454a1b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:45.533298 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e656b7b1-0a8e-41eb-ba12-c5af454a1b10 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:45.534802 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e656b7b1-0a8e-41eb-ba12-c5af454a1b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:45.573043 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:45.670984 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ded99-02b2-4506-a142-3a7fedac0598 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:45.673725 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-471ded99-02b2-4506-a142-3a7fedac0598 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:45.721001 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1119/2234] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:22:45.729493 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e656b7b1-0a8e-41eb-ba12-c5af454a1b10 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:45.732247 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e656b7b1-0a8e-41eb-ba12-c5af454a1b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:45.850903 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:45.862585 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ded99-02b2-4506-a142-3a7fedac0598 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:45.872909 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68da484-e890-4a82-ac8a-6fe4e4a28902 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:45.873608 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68da484-e890-4a82-ac8a-6fe4e4a28902 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:45.873938 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68da484-e890-4a82-ac8a-6fe4e4a28902 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:45.874380 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68da484-e890-4a82-ac8a-6fe4e4a28902 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:45.881040 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e68da484-e890-4a82-ac8a-6fe4e4a28902 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:45.992696 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e656b7b1-0a8e-41eb-ba12-c5af454a1b10 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:46.020106 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdf3a52-940b-4a90-b7f3-902791dc35f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:46.021193 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf3a52-940b-4a90-b7f3-902791dc35f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:46.021490 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf3a52-940b-4a90-b7f3-902791dc35f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:46.021858 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf3a52-940b-4a90-b7f3-902791dc35f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:46.074913 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdf3a52-940b-4a90-b7f3-902791dc35f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:46.082263 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdf3a52-940b-4a90-b7f3-902791dc35f3 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:46.146075 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68da484-e890-4a82-ac8a-6fe4e4a28902 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:46.146924 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1120/2235] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:22:46.148061 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68da484-e890-4a82-ac8a-6fe4e4a28902 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:46.161159 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1116/2236] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:22:47.209004 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdf3a52-940b-4a90-b7f3-902791dc35f3 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:47.212320 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1fdf3a52-940b-4a90-b7f3-902791dc35f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:47.290633 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdf3a52-940b-4a90-b7f3-902791dc35f3 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:47.314056 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df79e3-eb8f-4daf-be88-ccd6d28eaa6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:47.316695 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df79e3-eb8f-4daf-be88-ccd6d28eaa6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:47.317108 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df79e3-eb8f-4daf-be88-ccd6d28eaa6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:47.321288 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df79e3-eb8f-4daf-be88-ccd6d28eaa6a admin admin] PATH_INFO: `/v3/projects/1deb75952cab418fb4e5441688f01349` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:47.327348 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29df79e3-eb8f-4daf-be88-ccd6d28eaa6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1deb75952cab418fb4e5441688f01349)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:47.342779 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29df79e3-eb8f-4daf-be88-ccd6d28eaa6a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:47.420588 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68da484-e890-4a82-ac8a-6fe4e4a28902 service cinder] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:47.438291 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68da484-e890-4a82-ac8a-6fe4e4a28902 service cinder] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:47.458494 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1374de-2889-404a-875b-e6feebbbad01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:47.460795 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1374de-2889-404a-875b-e6feebbbad01 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:47.462998 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1374de-2889-404a-875b-e6feebbbad01 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:47.463568 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1374de-2889-404a-875b-e6feebbbad01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:47.477426 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-2d1374de-2889-404a-875b-e6feebbbad01 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:47.594466 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-29df79e3-eb8f-4daf-be88-ccd6d28eaa6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1deb75952cab418fb4e5441688f01349', 'request_id': 'req-29df79e3-eb8f-4daf-be88-ccd6d28eaa6a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:47.621136 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-29df79e3-eb8f-4daf-be88-ccd6d28eaa6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1deb75952cab418fb4e5441688f01349', 'request_id': 'req-29df79e3-eb8f-4daf-be88-ccd6d28eaa6a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:47.649725 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-29df79e3-eb8f-4daf-be88-ccd6d28eaa6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1deb75952cab418fb4e5441688f01349', 'request_id': 'req-29df79e3-eb8f-4daf-be88-ccd6d28eaa6a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:47.726306 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-29df79e3-eb8f-4daf-be88-ccd6d28eaa6a admin admin] The token cache is being invalidate because project 1deb75952cab418fb4e5441688f01349 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:22:47.726573 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-29df79e3-eb8f-4daf-be88-ccd6d28eaa6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:47.730838 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-29df79e3-eb8f-4daf-be88-ccd6d28eaa6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:47.735979 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1121/2237] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:22:47 2022] DELETE /identity/v3/projects/1deb75952cab418fb4e5441688f01349 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:47.745847 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df79e3-eb8f-4daf-be88-ccd6d28eaa6a admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:47.755214 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-29df79e3-eb8f-4daf-be88-ccd6d28eaa6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:47.848626 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1374de-2889-404a-875b-e6feebbbad01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:47.857935 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1374de-2889-404a-875b-e6feebbbad01 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:47.891865 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1117/2238] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:47 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:22:47.954268 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:48.016957 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df79e3-eb8f-4daf-be88-ccd6d28eaa6a admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:48.096161 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05667e6c-531a-44f1-aed6-8bbe6f7927af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:48.099684 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05667e6c-531a-44f1-aed6-8bbe6f7927af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:48.106657 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05667e6c-531a-44f1-aed6-8bbe6f7927af admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:48.107284 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05667e6c-531a-44f1-aed6-8bbe6f7927af admin admin] PATH_INFO: `/v3/users/1246376ec3134c59b8cc228be03e6904` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:48.117349 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05667e6c-531a-44f1-aed6-8bbe6f7927af admin admin] RBAC: Authorizing `identity:delete_user(user_id=1246376ec3134c59b8cc228be03e6904)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:48.125475 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05667e6c-531a-44f1-aed6-8bbe6f7927af admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:48.307137 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-05667e6c-531a-44f1-aed6-8bbe6f7927af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1246376ec3134c59b8cc228be03e6904'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:48.309153 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-05667e6c-531a-44f1-aed6-8bbe6f7927af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1246376ec3134c59b8cc228be03e6904'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:48.310941 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-05667e6c-531a-44f1-aed6-8bbe6f7927af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1246376ec3134c59b8cc228be03e6904'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:48.401682 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-05667e6c-531a-44f1-aed6-8bbe6f7927af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1246376ec3134c59b8cc228be03e6904'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:48.428859 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-05667e6c-531a-44f1-aed6-8bbe6f7927af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1246376ec3134c59b8cc228be03e6904'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:48.476992 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1122/2239] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:22:47 2022] DELETE /identity/v3/users/1246376ec3134c59b8cc228be03e6904 => generated 0 bytes in 735 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:50.590758 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1374de-2889-404a-875b-e6feebbbad01 service cinder] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:50.593962 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-2d1374de-2889-404a-875b-e6feebbbad01 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:50.662628 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1374de-2889-404a-875b-e6feebbbad01 service cinder] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:50.665890 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9367ea5-ba70-4c94-86c4-f9d2766273f7 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:50.666637 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9367ea5-ba70-4c94-86c4-f9d2766273f7 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:50.667129 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9367ea5-ba70-4c94-86c4-f9d2766273f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:50.720468 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-b9367ea5-ba70-4c94-86c4-f9d2766273f7 None None] MFA Rules not processed for user `e876198e863542518f9f932eb61f3403`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:50.722337 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b9367ea5-ba70-4c94-86c4-f9d2766273f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:50.808794 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb58e0-d37c-46f6-bdc6-2d9665ebbb0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:50.810273 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb58e0-d37c-46f6-bdc6-2d9665ebbb0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:50.811149 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb58e0-d37c-46f6-bdc6-2d9665ebbb0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:50.811733 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb58e0-d37c-46f6-bdc6-2d9665ebbb0c admin admin] PATH_INFO: `/v3/users/4f926aaad43e46adafb1e378a6df8a3d` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:50.813916 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cb58e0-d37c-46f6-bdc6-2d9665ebbb0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f926aaad43e46adafb1e378a6df8a3d)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:50.815962 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cb58e0-d37c-46f6-bdc6-2d9665ebbb0c admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:50.878166 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1123/2240] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:50.880038 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9367ea5-ba70-4c94-86c4-f9d2766273f7 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:50.882794 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b9367ea5-ba70-4c94-86c4-f9d2766273f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:50.912216 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:50.938039 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b4cb58e0-d37c-46f6-bdc6-2d9665ebbb0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f926aaad43e46adafb1e378a6df8a3d'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:50.947343 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9367ea5-ba70-4c94-86c4-f9d2766273f7 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:50.959759 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c3dfe-db08-4580-a069-2bbfdfdb5653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:50.961529 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c3dfe-db08-4580-a069-2bbfdfdb5653 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:50.962142 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c3dfe-db08-4580-a069-2bbfdfdb5653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:50.962633 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c3dfe-db08-4580-a069-2bbfdfdb5653 admin admin] PATH_INFO: `/v3/projects/d693cd0afe554d569695aac3ba449561` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:50.965885 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2c3dfe-db08-4580-a069-2bbfdfdb5653 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d693cd0afe554d569695aac3ba449561)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:50.968915 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2c3dfe-db08-4580-a069-2bbfdfdb5653 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:50.970237 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b4cb58e0-d37c-46f6-bdc6-2d9665ebbb0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f926aaad43e46adafb1e378a6df8a3d'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:50.980344 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b4cb58e0-d37c-46f6-bdc6-2d9665ebbb0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f926aaad43e46adafb1e378a6df8a3d'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:50.981134 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b4cb58e0-d37c-46f6-bdc6-2d9665ebbb0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f926aaad43e46adafb1e378a6df8a3d'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:50.994869 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b4cb58e0-d37c-46f6-bdc6-2d9665ebbb0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f926aaad43e46adafb1e378a6df8a3d'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:51.009827 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1118/2241] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:22:50 2022] DELETE /identity/v3/users/4f926aaad43e46adafb1e378a6df8a3d => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:51.014269 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855451e-b0a1-4f95-be54-f022a3008dbf None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:51.014995 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855451e-b0a1-4f95-be54-f022a3008dbf None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:51.015469 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855451e-b0a1-4f95-be54-f022a3008dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:51.070112 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-d855451e-b0a1-4f95-be54-f022a3008dbf None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:51.074271 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-d855451e-b0a1-4f95-be54-f022a3008dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:51.143133 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-cb2c3dfe-db08-4580-a069-2bbfdfdb5653 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd693cd0afe554d569695aac3ba449561', 'request_id': 'req-cb2c3dfe-db08-4580-a069-2bbfdfdb5653'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:51.155686 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-cb2c3dfe-db08-4580-a069-2bbfdfdb5653 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd693cd0afe554d569695aac3ba449561', 'request_id': 'req-cb2c3dfe-db08-4580-a069-2bbfdfdb5653'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:51.171639 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-cb2c3dfe-db08-4580-a069-2bbfdfdb5653 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd693cd0afe554d569695aac3ba449561', 'request_id': 'req-cb2c3dfe-db08-4580-a069-2bbfdfdb5653'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:51.198710 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:51.209558 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-cb2c3dfe-db08-4580-a069-2bbfdfdb5653 admin admin] The token cache is being invalidate because project d693cd0afe554d569695aac3ba449561 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:22:51.213474 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-cb2c3dfe-db08-4580-a069-2bbfdfdb5653 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:51.215590 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-cb2c3dfe-db08-4580-a069-2bbfdfdb5653 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:51.225003 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1124/2242] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:22:50 2022] DELETE /identity/v3/projects/d693cd0afe554d569695aac3ba449561 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:51.232499 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14713b12-2161-4d87-a800-c989228fa92c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:51.232977 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14713b12-2161-4d87-a800-c989228fa92c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:51.233468 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14713b12-2161-4d87-a800-c989228fa92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:51.265455 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1119/2243] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:51.285359 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d855451e-b0a1-4f95-be54-f022a3008dbf None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:51.289807 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-d855451e-b0a1-4f95-be54-f022a3008dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:51.293101 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-14713b12-2161-4d87-a800-c989228fa92c None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:51.295341 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-14713b12-2161-4d87-a800-c989228fa92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:51.460370 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1125/2244] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:51.473159 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb2cd3-075c-4d04-abb3-413db07f04df None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:51.473768 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb2cd3-075c-4d04-abb3-413db07f04df None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:51.474527 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb2cd3-075c-4d04-abb3-413db07f04df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:51.517408 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d855451e-b0a1-4f95-be54-f022a3008dbf None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:51.530912 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-0ceb2cd3-075c-4d04-abb3-413db07f04df None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:51.537126 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0ceb2cd3-075c-4d04-abb3-413db07f04df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:51.575049 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1126/2245] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:22:51.581983 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceb2cd3-075c-4d04-abb3-413db07f04df None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:51.615806 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceb2cd3-075c-4d04-abb3-413db07f04df None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:51.627184 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98392181-b07d-42bd-a209-9a1263b1e334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:51.630541 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98392181-b07d-42bd-a209-9a1263b1e334 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:51.631002 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98392181-b07d-42bd-a209-9a1263b1e334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:51.631464 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98392181-b07d-42bd-a209-9a1263b1e334 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:51.632816 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98392181-b07d-42bd-a209-9a1263b1e334 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:22:51.633548 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98392181-b07d-42bd-a209-9a1263b1e334 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:51.636628 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98392181-b07d-42bd-a209-9a1263b1e334 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:51.660248 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1127/2246] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:22:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:22:51.665622 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98392181-b07d-42bd-a209-9a1263b1e334 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:51.685956 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98392181-b07d-42bd-a209-9a1263b1e334 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:51.699773 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c77c9-4f11-4541-8c89-4c65abd4a013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:51.702695 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c77c9-4f11-4541-8c89-4c65abd4a013 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:51.704700 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab7c378-19e0-4cbe-9534-2372e24fd733 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:51.705686 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c77c9-4f11-4541-8c89-4c65abd4a013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:51.706378 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c77c9-4f11-4541-8c89-4c65abd4a013 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:51.707516 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7c378-19e0-4cbe-9534-2372e24fd733 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:51.709072 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c77c9-4f11-4541-8c89-4c65abd4a013 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:51.709661 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7c378-19e0-4cbe-9534-2372e24fd733 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:51.710734 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7c378-19e0-4cbe-9534-2372e24fd733 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:51.716750 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c77c9-4f11-4541-8c89-4c65abd4a013 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:51.751090 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab7c378-19e0-4cbe-9534-2372e24fd733 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:51.754294 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab7c378-19e0-4cbe-9534-2372e24fd733 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:51.776600 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1120/2247] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:22:51.821621 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1128/2248] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:22:51 2022] POST /identity/v3/projects => generated 373 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:22:51.824775 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab7c378-19e0-4cbe-9534-2372e24fd733 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:51.860783 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab7c378-19e0-4cbe-9534-2372e24fd733 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:51.899606 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:52.001515 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0fbdce-41fc-4e2a-9765-442f53368bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:52.002627 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0fbdce-41fc-4e2a-9765-442f53368bcc admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:52.003092 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0fbdce-41fc-4e2a-9765-442f53368bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:52.003613 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0fbdce-41fc-4e2a-9765-442f53368bcc admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:52.004708 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0fbdce-41fc-4e2a-9765-442f53368bcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:52.007601 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0fbdce-41fc-4e2a-9765-442f53368bcc admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:52.051657 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1121/2249] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:22:51 2022] POST /identity/v3/users => generated 287 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:22:52.056914 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c77c9-4f11-4541-8c89-4c65abd4a013 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:52.068968 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c77c9-4f11-4541-8c89-4c65abd4a013 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:52.074360 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fabc17-fbb4-4159-8272-5bd3a66a537b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:52.075617 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fabc17-fbb4-4159-8272-5bd3a66a537b admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:52.075617 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fabc17-fbb4-4159-8272-5bd3a66a537b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:52.075944 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fabc17-fbb4-4159-8272-5bd3a66a537b admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:52.076656 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fabc17-fbb4-4159-8272-5bd3a66a537b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:52.078465 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fabc17-fbb4-4159-8272-5bd3a66a537b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:52.096903 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1129/2250] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:52.099377 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0fbdce-41fc-4e2a-9765-442f53368bcc admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:52.117408 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0fbdce-41fc-4e2a-9765-442f53368bcc admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:52.127509 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36bbb6a-f23f-4aea-9bb7-d72df1ce5809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:52.144324 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36bbb6a-f23f-4aea-9bb7-d72df1ce5809 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:52.144324 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36bbb6a-f23f-4aea-9bb7-d72df1ce5809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:52.144324 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36bbb6a-f23f-4aea-9bb7-d72df1ce5809 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:52.146827 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36bbb6a-f23f-4aea-9bb7-d72df1ce5809 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:52.157277 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36bbb6a-f23f-4aea-9bb7-d72df1ce5809 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:52.185336 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1122/2251] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:22:52.187861 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fabc17-fbb4-4159-8272-5bd3a66a537b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:52.206936 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fabc17-fbb4-4159-8272-5bd3a66a537b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:52.215877 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23ea1f-8c24-4273-b90f-07bb60d6f024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:52.217470 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23ea1f-8c24-4273-b90f-07bb60d6f024 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:52.218027 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23ea1f-8c24-4273-b90f-07bb60d6f024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:52.218527 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23ea1f-8c24-4273-b90f-07bb60d6f024 admin admin] PATH_INFO: `/v3/projects/c9c6f2e54e4d42c38b3efb389525be0b/users/8e4a49dc4b704b63ae630a571d50c8ee/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:52.296653 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae23ea1f-8c24-4273-b90f-07bb60d6f024 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9c6f2e54e4d42c38b3efb389525be0b, user_id=8e4a49dc4b704b63ae630a571d50c8ee, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:52.303173 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae23ea1f-8c24-4273-b90f-07bb60d6f024 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:52.357669 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1130/2252] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:22:52 2022] PUT /identity/v3/projects/c9c6f2e54e4d42c38b3efb389525be0b/users/8e4a49dc4b704b63ae630a571d50c8ee/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:52.365217 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36bbb6a-f23f-4aea-9bb7-d72df1ce5809 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:52.370351 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a36bbb6a-f23f-4aea-9bb7-d72df1ce5809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:52.376748 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622362b-9e4d-44b7-a221-3d1c05ef2f23 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:52.377615 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622362b-9e4d-44b7-a221-3d1c05ef2f23 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:52.378438 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622362b-9e4d-44b7-a221-3d1c05ef2f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:52.396514 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36bbb6a-f23f-4aea-9bb7-d72df1ce5809 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:52.438243 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-8622362b-9e4d-44b7-a221-3d1c05ef2f23 None None] MFA Rules not processed for user `8e4a49dc4b704b63ae630a571d50c8ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:52.441366 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8622362b-9e4d-44b7-a221-3d1c05ef2f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:52.522271 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6f1bce-c360-4851-a7fa-847b1961d71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:52.523105 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f1bce-c360-4851-a7fa-847b1961d71e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:52.523384 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f1bce-c360-4851-a7fa-847b1961d71e admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:52.523657 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f1bce-c360-4851-a7fa-847b1961d71e admin admin] PATH_INFO: `/v3/users/a30ee4122298431d8a318a7f59c74c85` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:52.525090 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6f1bce-c360-4851-a7fa-847b1961d71e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a30ee4122298431d8a318a7f59c74c85)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:52.529408 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6f1bce-c360-4851-a7fa-847b1961d71e admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:52.593286 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1131/2253] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:22:52.613445 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8622362b-9e4d-44b7-a221-3d1c05ef2f23 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:52.616713 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8622362b-9e4d-44b7-a221-3d1c05ef2f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:52.634615 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7f6f1bce-c360-4851-a7fa-847b1961d71e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a30ee4122298431d8a318a7f59c74c85'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:52.640070 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:52.686214 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7f6f1bce-c360-4851-a7fa-847b1961d71e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a30ee4122298431d8a318a7f59c74c85'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:52.712341 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7f6f1bce-c360-4851-a7fa-847b1961d71e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a30ee4122298431d8a318a7f59c74c85'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:52.714007 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7f6f1bce-c360-4851-a7fa-847b1961d71e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a30ee4122298431d8a318a7f59c74c85'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:52.733941 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7f6f1bce-c360-4851-a7fa-847b1961d71e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a30ee4122298431d8a318a7f59c74c85'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:52.756000 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1123/2254] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:22:52 2022] DELETE /identity/v3/users/a30ee4122298431d8a318a7f59c74c85 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:52.758067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8622362b-9e4d-44b7-a221-3d1c05ef2f23 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:52.776580 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d0e28-b6f1-4949-ac6c-d3a3ac1a28e8 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:52.778207 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d0e28-b6f1-4949-ac6c-d3a3ac1a28e8 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:52.778901 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d0e28-b6f1-4949-ac6c-d3a3ac1a28e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:52.861860 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-671d0e28-b6f1-4949-ac6c-d3a3ac1a28e8 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:52.868663 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-671d0e28-b6f1-4949-ac6c-d3a3ac1a28e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:52.910370 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:52.950101 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f07437-e431-4f86-b1eb-f347077c52b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:52.955303 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f07437-e431-4f86-b1eb-f347077c52b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:52.955845 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f07437-e431-4f86-b1eb-f347077c52b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:52.956350 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f07437-e431-4f86-b1eb-f347077c52b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:52.977113 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-04f07437-e431-4f86-b1eb-f347077c52b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:53.179943 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1124/2255] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:22:53.184138 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d0e28-b6f1-4949-ac6c-d3a3ac1a28e8 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:53.186558 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-671d0e28-b6f1-4949-ac6c-d3a3ac1a28e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:53.207010 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d0e28-b6f1-4949-ac6c-d3a3ac1a28e8 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:53.214026 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e541fc3-a03a-450d-a41f-8334f26e371a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:53.216388 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e541fc3-a03a-450d-a41f-8334f26e371a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:53.217581 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e541fc3-a03a-450d-a41f-8334f26e371a admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:53.218653 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e541fc3-a03a-450d-a41f-8334f26e371a admin admin] PATH_INFO: `/v3/projects/5df52cc76f4c42f6b92c22dfac87078a` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:53.220363 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e541fc3-a03a-450d-a41f-8334f26e371a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5df52cc76f4c42f6b92c22dfac87078a)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:53.224300 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e541fc3-a03a-450d-a41f-8334f26e371a admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:53.259290 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f07437-e431-4f86-b1eb-f347077c52b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:53.265180 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f07437-e431-4f86-b1eb-f347077c52b2 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:53.308217 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1132/2256] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 697 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:22:53.309635 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f07437-e431-4f86-b1eb-f347077c52b2 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:53.312093 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-04f07437-e431-4f86-b1eb-f347077c52b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:53.434046 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f07437-e431-4f86-b1eb-f347077c52b2 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:53.438227 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-8e541fc3-a03a-450d-a41f-8334f26e371a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5df52cc76f4c42f6b92c22dfac87078a', 'request_id': 'req-8e541fc3-a03a-450d-a41f-8334f26e371a'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:53.460161 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-8e541fc3-a03a-450d-a41f-8334f26e371a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5df52cc76f4c42f6b92c22dfac87078a', 'request_id': 'req-8e541fc3-a03a-450d-a41f-8334f26e371a'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:53.488337 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-8e541fc3-a03a-450d-a41f-8334f26e371a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5df52cc76f4c42f6b92c22dfac87078a', 'request_id': 'req-8e541fc3-a03a-450d-a41f-8334f26e371a'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:53.531107 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-8e541fc3-a03a-450d-a41f-8334f26e371a admin admin] The token cache is being invalidate because project 5df52cc76f4c42f6b92c22dfac87078a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:22:53.531454 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-8e541fc3-a03a-450d-a41f-8334f26e371a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:53.539405 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-8e541fc3-a03a-450d-a41f-8334f26e371a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:53.542508 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1125/2257] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:22:53 2022] DELETE /identity/v3/projects/5df52cc76f4c42f6b92c22dfac87078a => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:53.617808 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:53.688115 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a5fcf-b240-4246-bff4-2a3b64f60b21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:53.689850 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a5fcf-b240-4246-bff4-2a3b64f60b21 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:53.690370 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a5fcf-b240-4246-bff4-2a3b64f60b21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:53.690919 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a5fcf-b240-4246-bff4-2a3b64f60b21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:53.696643 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-543a5fcf-b240-4246-bff4-2a3b64f60b21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:53.904836 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a5fcf-b240-4246-bff4-2a3b64f60b21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:53.908582 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a5fcf-b240-4246-bff4-2a3b64f60b21 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:53.924127 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1133/2258] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 615 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:22:54.943199 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e541fc3-a03a-450d-a41f-8334f26e371a admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:54.946420 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-8e541fc3-a03a-450d-a41f-8334f26e371a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:54.989372 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e541fc3-a03a-450d-a41f-8334f26e371a admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:55.003259 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82ac40f-83c4-4c37-b178-4522b2ece4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:55.014018 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ac40f-83c4-4c37-b178-4522b2ece4e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:55.016237 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ac40f-83c4-4c37-b178-4522b2ece4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:55.016237 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ac40f-83c4-4c37-b178-4522b2ece4e0 admin admin] PATH_INFO: `/v3/projects/67fe7ff4899a40c3b7dd80e36f06c1b0` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:55.018267 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82ac40f-83c4-4c37-b178-4522b2ece4e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67fe7ff4899a40c3b7dd80e36f06c1b0)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:55.021440 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82ac40f-83c4-4c37-b178-4522b2ece4e0 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:55.199139 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-e82ac40f-83c4-4c37-b178-4522b2ece4e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67fe7ff4899a40c3b7dd80e36f06c1b0', 'request_id': 'req-e82ac40f-83c4-4c37-b178-4522b2ece4e0'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:55.223654 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-e82ac40f-83c4-4c37-b178-4522b2ece4e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67fe7ff4899a40c3b7dd80e36f06c1b0', 'request_id': 'req-e82ac40f-83c4-4c37-b178-4522b2ece4e0'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:55.246286 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-e82ac40f-83c4-4c37-b178-4522b2ece4e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67fe7ff4899a40c3b7dd80e36f06c1b0', 'request_id': 'req-e82ac40f-83c4-4c37-b178-4522b2ece4e0'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:55.290954 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-e82ac40f-83c4-4c37-b178-4522b2ece4e0 admin admin] The token cache is being invalidate because project 67fe7ff4899a40c3b7dd80e36f06c1b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:22:55.291335 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-e82ac40f-83c4-4c37-b178-4522b2ece4e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:55.293608 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-e82ac40f-83c4-4c37-b178-4522b2ece4e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:55.300240 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1126/2259] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:22:54 2022] DELETE /identity/v3/projects/67fe7ff4899a40c3b7dd80e36f06c1b0 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:55.302769 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a5fcf-b240-4246-bff4-2a3b64f60b21 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:55.318921 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a5fcf-b240-4246-bff4-2a3b64f60b21 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:55.474454 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c81cb-58a9-487f-bcfb-fc903ff7588d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:55.475607 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c81cb-58a9-487f-bcfb-fc903ff7588d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:55.477125 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c81cb-58a9-487f-bcfb-fc903ff7588d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:55.477515 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c81cb-58a9-487f-bcfb-fc903ff7588d admin admin] PATH_INFO: `/v3/users/b2301f089da44259b32f5d54cd14ea5f` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:55.482431 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34c81cb-58a9-487f-bcfb-fc903ff7588d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2301f089da44259b32f5d54cd14ea5f)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:55.485324 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34c81cb-58a9-487f-bcfb-fc903ff7588d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:55.668429 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a34c81cb-58a9-487f-bcfb-fc903ff7588d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2301f089da44259b32f5d54cd14ea5f'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:55.669539 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a34c81cb-58a9-487f-bcfb-fc903ff7588d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2301f089da44259b32f5d54cd14ea5f'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:55.670572 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a34c81cb-58a9-487f-bcfb-fc903ff7588d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2301f089da44259b32f5d54cd14ea5f'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:55.721186 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a34c81cb-58a9-487f-bcfb-fc903ff7588d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2301f089da44259b32f5d54cd14ea5f'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:55.739515 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a34c81cb-58a9-487f-bcfb-fc903ff7588d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2301f089da44259b32f5d54cd14ea5f'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:55.800834 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1134/2260] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:22:55 2022] DELETE /identity/v3/users/b2301f089da44259b32f5d54cd14ea5f => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:56.944322 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82ac40f-83c4-4c37-b178-4522b2ece4e0 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:56.946842 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e82ac40f-83c4-4c37-b178-4522b2ece4e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:56.972454 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82ac40f-83c4-4c37-b178-4522b2ece4e0 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:57.007767 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:57.146397 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84181a5-993e-43be-9b1e-1f9ed2a2a133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:57.147327 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84181a5-993e-43be-9b1e-1f9ed2a2a133 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:57.147613 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84181a5-993e-43be-9b1e-1f9ed2a2a133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:57.147884 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84181a5-993e-43be-9b1e-1f9ed2a2a133 admin admin] PATH_INFO: `/v3/projects/b717f5606d384e15bdfc0b34b6328d09` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:57.149632 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84181a5-993e-43be-9b1e-1f9ed2a2a133 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b717f5606d384e15bdfc0b34b6328d09)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:57.152154 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84181a5-993e-43be-9b1e-1f9ed2a2a133 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:57.296769 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-e84181a5-993e-43be-9b1e-1f9ed2a2a133 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b717f5606d384e15bdfc0b34b6328d09', 'request_id': 'req-e84181a5-993e-43be-9b1e-1f9ed2a2a133'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:57.311322 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-e84181a5-993e-43be-9b1e-1f9ed2a2a133 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b717f5606d384e15bdfc0b34b6328d09', 'request_id': 'req-e84181a5-993e-43be-9b1e-1f9ed2a2a133'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:57.329048 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-e84181a5-993e-43be-9b1e-1f9ed2a2a133 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b717f5606d384e15bdfc0b34b6328d09', 'request_id': 'req-e84181a5-993e-43be-9b1e-1f9ed2a2a133'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:57.401801 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-e84181a5-993e-43be-9b1e-1f9ed2a2a133 admin admin] The token cache is being invalidate because project b717f5606d384e15bdfc0b34b6328d09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:22:57.401801 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-e84181a5-993e-43be-9b1e-1f9ed2a2a133 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:57.401801 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-e84181a5-993e-43be-9b1e-1f9ed2a2a133 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:57.401801 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1127/2261] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:22:56 2022] DELETE /identity/v3/projects/b717f5606d384e15bdfc0b34b6328d09 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:57.409059 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c81cb-58a9-487f-bcfb-fc903ff7588d admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:57.411784 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a34c81cb-58a9-487f-bcfb-fc903ff7588d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:57.443701 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c81cb-58a9-487f-bcfb-fc903ff7588d admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:57.487916 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:57.488461 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8fd1be-6e72-443b-a4c8-73be0faed42f None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:57.489204 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8fd1be-6e72-443b-a4c8-73be0faed42f None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:57.489204 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8fd1be-6e72-443b-a4c8-73be0faed42f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:57.542149 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-2d8fd1be-6e72-443b-a4c8-73be0faed42f None None] MFA Rules not processed for user `f2f7f01eb34a486aa78320673c7f1c0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:22:57.549790 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-2d8fd1be-6e72-443b-a4c8-73be0faed42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:57.627740 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b929bb5-7f80-42cb-a3cd-58019473c33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:57.628353 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b929bb5-7f80-42cb-a3cd-58019473c33e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:57.628625 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b929bb5-7f80-42cb-a3cd-58019473c33e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:57.628900 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b929bb5-7f80-42cb-a3cd-58019473c33e admin admin] PATH_INFO: `/v3/users/a1d007779d334a32af633bffc28b9d88` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:57.634755 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b929bb5-7f80-42cb-a3cd-58019473c33e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1d007779d334a32af633bffc28b9d88)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:57.638362 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b929bb5-7f80-42cb-a3cd-58019473c33e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:57.731646 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0b929bb5-7f80-42cb-a3cd-58019473c33e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1d007779d334a32af633bffc28b9d88'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:57.735731 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0b929bb5-7f80-42cb-a3cd-58019473c33e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1d007779d334a32af633bffc28b9d88'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:57.747229 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0b929bb5-7f80-42cb-a3cd-58019473c33e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1d007779d334a32af633bffc28b9d88'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:57.782279 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0b929bb5-7f80-42cb-a3cd-58019473c33e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1d007779d334a32af633bffc28b9d88'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:57.795742 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1128/2262] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:22:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:22:57.798229 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8fd1be-6e72-443b-a4c8-73be0faed42f None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:57.802139 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-2d8fd1be-6e72-443b-a4c8-73be0faed42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:57.805834 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0b929bb5-7f80-42cb-a3cd-58019473c33e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1d007779d334a32af633bffc28b9d88'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:57.836241 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1135/2263] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:22:57 2022] DELETE /identity/v3/users/a1d007779d334a32af633bffc28b9d88 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:22:57.920217 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8fd1be-6e72-443b-a4c8-73be0faed42f None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:57.938762 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:58.123076 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87bdbda-2884-4b19-a3ce-ee3972ae394c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:58.125098 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87bdbda-2884-4b19-a3ce-ee3972ae394c service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:58.125730 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87bdbda-2884-4b19-a3ce-ee3972ae394c service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:58.126447 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87bdbda-2884-4b19-a3ce-ee3972ae394c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:58.131699 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a87bdbda-2884-4b19-a3ce-ee3972ae394c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:58.388499 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87bdbda-2884-4b19-a3ce-ee3972ae394c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:58.390813 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87bdbda-2884-4b19-a3ce-ee3972ae394c service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:58.444616 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1129/2264] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:22:57 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 642 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:22:59.030330 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b929bb5-7f80-42cb-a3cd-58019473c33e admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:22:59.035790 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0b929bb5-7f80-42cb-a3cd-58019473c33e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:22:59.371749 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b929bb5-7f80-42cb-a3cd-58019473c33e admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:22:59.381127 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d7ec91-42af-4b36-88f7-dda52c06bbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:22:59.383242 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7ec91-42af-4b36-88f7-dda52c06bbca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:22:59.383913 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7ec91-42af-4b36-88f7-dda52c06bbca admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:22:59.385389 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7ec91-42af-4b36-88f7-dda52c06bbca admin admin] PATH_INFO: `/v3/projects/0f98c1c049894b6aa72a6e6b9b24f255` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:22:59.391059 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d7ec91-42af-4b36-88f7-dda52c06bbca admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f98c1c049894b6aa72a6e6b9b24f255)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:22:59.396705 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d7ec91-42af-4b36-88f7-dda52c06bbca admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:22:59.507690 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:22:59.544709 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e7d7ec91-42af-4b36-88f7-dda52c06bbca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f98c1c049894b6aa72a6e6b9b24f255', 'request_id': 'req-e7d7ec91-42af-4b36-88f7-dda52c06bbca'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:59.560982 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e7d7ec91-42af-4b36-88f7-dda52c06bbca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f98c1c049894b6aa72a6e6b9b24f255', 'request_id': 'req-e7d7ec91-42af-4b36-88f7-dda52c06bbca'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:59.578192 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e7d7ec91-42af-4b36-88f7-dda52c06bbca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f98c1c049894b6aa72a6e6b9b24f255', 'request_id': 'req-e7d7ec91-42af-4b36-88f7-dda52c06bbca'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:59.611691 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e7d7ec91-42af-4b36-88f7-dda52c06bbca admin admin] The token cache is being invalidate because project 0f98c1c049894b6aa72a6e6b9b24f255 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:22:59.612301 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e7d7ec91-42af-4b36-88f7-dda52c06bbca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:59.614374 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e7d7ec91-42af-4b36-88f7-dda52c06bbca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:22:59.617740 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1136/2265] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:22:59 2022] DELETE /identity/v3/projects/0f98c1c049894b6aa72a6e6b9b24f255 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:23:07.696484 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87bdbda-2884-4b19-a3ce-ee3972ae394c service cinder] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:23:07.699443 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a87bdbda-2884-4b19-a3ce-ee3972ae394c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:23:07.736305 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87bdbda-2884-4b19-a3ce-ee3972ae394c service cinder] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:23:07.840226 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8499be6-aea0-4495-9700-89b81c9c65ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:23:07.841398 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8499be6-aea0-4495-9700-89b81c9c65ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:07.841788 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8499be6-aea0-4495-9700-89b81c9c65ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:07.842281 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8499be6-aea0-4495-9700-89b81c9c65ca admin admin] PATH_INFO: `/v3/users/8e4a49dc4b704b63ae630a571d50c8ee` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:07.844619 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8499be6-aea0-4495-9700-89b81c9c65ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e4a49dc4b704b63ae630a571d50c8ee)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:23:07.848904 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8499be6-aea0-4495-9700-89b81c9c65ca admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:23:07.945796 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a8499be6-aea0-4495-9700-89b81c9c65ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e4a49dc4b704b63ae630a571d50c8ee'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:07.969569 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:23:07.972179 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a8499be6-aea0-4495-9700-89b81c9c65ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e4a49dc4b704b63ae630a571d50c8ee'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:07.987248 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a8499be6-aea0-4495-9700-89b81c9c65ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e4a49dc4b704b63ae630a571d50c8ee'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:07.988763 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a8499be6-aea0-4495-9700-89b81c9c65ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e4a49dc4b704b63ae630a571d50c8ee'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:08.001512 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a8499be6-aea0-4495-9700-89b81c9c65ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e4a49dc4b704b63ae630a571d50c8ee'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:08.011677 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1130/2266] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:23:07 2022] DELETE /identity/v3/users/8e4a49dc4b704b63ae630a571d50c8ee => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:23:08.017492 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440fb71-72a7-4a06-9c03-1c0d86b4c556 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:08.018381 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440fb71-72a7-4a06-9c03-1c0d86b4c556 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:08.018843 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440fb71-72a7-4a06-9c03-1c0d86b4c556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:08.058291 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-1440fb71-72a7-4a06-9c03-1c0d86b4c556 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:23:08.059768 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1440fb71-72a7-4a06-9c03-1c0d86b4c556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:23:08.216781 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1137/2267] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:23:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:23:08.267699 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8499be6-aea0-4495-9700-89b81c9c65ca admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:23:08.271680 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a8499be6-aea0-4495-9700-89b81c9c65ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:23:08.372206 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8499be6-aea0-4495-9700-89b81c9c65ca admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:23:08.380673 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce14ff-bfe5-409a-ad17-64d9e18933bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:23:08.381829 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce14ff-bfe5-409a-ad17-64d9e18933bc service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:08.382258 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce14ff-bfe5-409a-ad17-64d9e18933bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:08.382708 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce14ff-bfe5-409a-ad17-64d9e18933bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:08.399447 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce14ff-bfe5-409a-ad17-64d9e18933bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:23:08.401478 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce14ff-bfe5-409a-ad17-64d9e18933bc service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:23:08.423081 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1131/2268] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:23:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:23:08.491068 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735aef82-8ed2-4453-8788-8f2c44a410ab None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:08.491728 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735aef82-8ed2-4453-8788-8f2c44a410ab None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:08.492084 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735aef82-8ed2-4453-8788-8f2c44a410ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:08.529299 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-735aef82-8ed2-4453-8788-8f2c44a410ab None None] MFA Rules not processed for user `18392ef8bf1f4679bd28dc870aa74a0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:23:08.531636 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-735aef82-8ed2-4453-8788-8f2c44a410ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:23:08.706573 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1138/2269] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:23:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:23:09.318778 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce14ff-bfe5-409a-ad17-64d9e18933bc service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:23:09.321195 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-c4ce14ff-bfe5-409a-ad17-64d9e18933bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:23:09.359949 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce14ff-bfe5-409a-ad17-64d9e18933bc service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:23:09.372928 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcdbd89-f2da-41b0-a6ef-13514f626510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:23:09.375483 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcdbd89-f2da-41b0-a6ef-13514f626510 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:09.376328 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcdbd89-f2da-41b0-a6ef-13514f626510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:09.377073 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcdbd89-f2da-41b0-a6ef-13514f626510 admin admin] PATH_INFO: `/v3/projects/c9c6f2e54e4d42c38b3efb389525be0b` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:09.380493 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcdbd89-f2da-41b0-a6ef-13514f626510 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9c6f2e54e4d42c38b3efb389525be0b)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:23:09.388656 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcdbd89-f2da-41b0-a6ef-13514f626510 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:23:09.530278 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9bcdbd89-f2da-41b0-a6ef-13514f626510 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9c6f2e54e4d42c38b3efb389525be0b', 'request_id': 'req-9bcdbd89-f2da-41b0-a6ef-13514f626510'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:09.558916 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9bcdbd89-f2da-41b0-a6ef-13514f626510 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9c6f2e54e4d42c38b3efb389525be0b', 'request_id': 'req-9bcdbd89-f2da-41b0-a6ef-13514f626510'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:09.578505 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9bcdbd89-f2da-41b0-a6ef-13514f626510 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9c6f2e54e4d42c38b3efb389525be0b', 'request_id': 'req-9bcdbd89-f2da-41b0-a6ef-13514f626510'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:09.605787 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9bcdbd89-f2da-41b0-a6ef-13514f626510 admin admin] The token cache is being invalidate because project c9c6f2e54e4d42c38b3efb389525be0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:23:09.606177 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9bcdbd89-f2da-41b0-a6ef-13514f626510 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:09.607101 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9bcdbd89-f2da-41b0-a6ef-13514f626510 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:09.614857 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1132/2270] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:23:09 2022] DELETE /identity/v3/projects/c9c6f2e54e4d42c38b3efb389525be0b => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:23:09.624220 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181b3fb-e404-4d66-bef5-c44d63f3c8d4 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:09.625753 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181b3fb-e404-4d66-bef5-c44d63f3c8d4 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:09.626273 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181b3fb-e404-4d66-bef5-c44d63f3c8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:09.697914 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e181b3fb-e404-4d66-bef5-c44d63f3c8d4 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:23:09.697914 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e181b3fb-e404-4d66-bef5-c44d63f3c8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:23:09.918318 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1139/2271] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:23:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:23:09.936520 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b9894-be50-4be9-8b81-d80e0c0f6ed6 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:09.937322 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b9894-be50-4be9-8b81-d80e0c0f6ed6 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:09.938097 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b9894-be50-4be9-8b81-d80e0c0f6ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:09.991583 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-640b9894-be50-4be9-8b81-d80e0c0f6ed6 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:23:09.992845 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-640b9894-be50-4be9-8b81-d80e0c0f6ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:23:10.032024 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1133/2272] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:23:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:23:10.038709 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e181b3fb-e404-4d66-bef5-c44d63f3c8d4 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:23:10.058898 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:23:10.087710 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e181b3fb-e404-4d66-bef5-c44d63f3c8d4 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:23:10.111962 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc1cbcf-e918-4b73-a37e-291b6ac76541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:23:10.112679 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1cbcf-e918-4b73-a37e-291b6ac76541 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:10.112962 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1cbcf-e918-4b73-a37e-291b6ac76541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:10.113243 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1cbcf-e918-4b73-a37e-291b6ac76541 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:10.116734 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc1cbcf-e918-4b73-a37e-291b6ac76541 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:23:10.117072 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc1cbcf-e918-4b73-a37e-291b6ac76541 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:23:10.118863 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc1cbcf-e918-4b73-a37e-291b6ac76541 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:23:10.142425 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1140/2273] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:23:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:23:10.149340 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640b9894-be50-4be9-8b81-d80e0c0f6ed6 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:23:10.177015 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640b9894-be50-4be9-8b81-d80e0c0f6ed6 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:23:10.198171 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ab666-4093-42f4-807a-c106a0b511d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:23:10.198879 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ab666-4093-42f4-807a-c106a0b511d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:10.199163 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ab666-4093-42f4-807a-c106a0b511d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:10.199435 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ab666-4093-42f4-807a-c106a0b511d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:10.200207 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3ab666-4093-42f4-807a-c106a0b511d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:23:10.202337 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3ab666-4093-42f4-807a-c106a0b511d6 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:23:10.237444 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1134/2274] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:23:10 2022] POST /identity/v3/projects => generated 383 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:23:10.244396 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc1cbcf-e918-4b73-a37e-291b6ac76541 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:23:10.266998 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc1cbcf-e918-4b73-a37e-291b6ac76541 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:23:10.383453 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5b846-7b33-4eb9-bb29-bd0e3df28fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:23:10.384775 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5b846-7b33-4eb9-bb29-bd0e3df28fcc admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:10.385261 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5b846-7b33-4eb9-bb29-bd0e3df28fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:10.385830 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5b846-7b33-4eb9-bb29-bd0e3df28fcc admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:10.387105 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee5b846-7b33-4eb9-bb29-bd0e3df28fcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:23:10.390775 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee5b846-7b33-4eb9-bb29-bd0e3df28fcc admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:23:10.446539 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1141/2275] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:23:10 2022] POST /identity/v3/users => generated 292 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:23:10.448500 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ab666-4093-42f4-807a-c106a0b511d6 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:23:10.462733 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ab666-4093-42f4-807a-c106a0b511d6 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:23:10.469307 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b470e-1123-4b20-a128-d30d26225d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:23:10.470160 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b470e-1123-4b20-a128-d30d26225d31 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:10.470429 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b470e-1123-4b20-a128-d30d26225d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:10.470889 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b470e-1123-4b20-a128-d30d26225d31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:10.471660 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33b470e-1123-4b20-a128-d30d26225d31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:23:10.473671 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33b470e-1123-4b20-a128-d30d26225d31 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:23:10.495373 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1135/2276] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:23:10.499999 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5b846-7b33-4eb9-bb29-bd0e3df28fcc admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:23:10.521248 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5b846-7b33-4eb9-bb29-bd0e3df28fcc admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:23:10.544396 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c43fdb-deb3-4d52-bce7-4d27a6316cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:23:10.545751 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c43fdb-deb3-4d52-bce7-4d27a6316cfe admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:10.546421 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c43fdb-deb3-4d52-bce7-4d27a6316cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:10.547943 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c43fdb-deb3-4d52-bce7-4d27a6316cfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:10.548885 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c43fdb-deb3-4d52-bce7-4d27a6316cfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:23:10.552163 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c43fdb-deb3-4d52-bce7-4d27a6316cfe admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:23:10.573484 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1142/2277] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:23:10.580205 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b470e-1123-4b20-a128-d30d26225d31 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:23:10.598161 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b470e-1123-4b20-a128-d30d26225d31 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:23:10.610138 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fdfc6d-2543-4b1d-9471-18ee1267bd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:23:10.611652 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fdfc6d-2543-4b1d-9471-18ee1267bd80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:10.612049 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fdfc6d-2543-4b1d-9471-18ee1267bd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:10.612523 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fdfc6d-2543-4b1d-9471-18ee1267bd80 admin admin] PATH_INFO: `/v3/projects/e7ed996b379b4d14bb3474526d538934/users/66d93db01b9441b7b51e90019d482fbe/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:10.643459 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fdfc6d-2543-4b1d-9471-18ee1267bd80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7ed996b379b4d14bb3474526d538934, user_id=66d93db01b9441b7b51e90019d482fbe, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:23:10.649753 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fdfc6d-2543-4b1d-9471-18ee1267bd80 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:23:10.674891 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1136/2278] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:23:10 2022] PUT /identity/v3/projects/e7ed996b379b4d14bb3474526d538934/users/66d93db01b9441b7b51e90019d482fbe/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:23:10.684093 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55b494-bd1b-4b6b-ad9e-de57c568783d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:10.685185 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55b494-bd1b-4b6b-ad9e-de57c568783d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:10.685185 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55b494-bd1b-4b6b-ad9e-de57c568783d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:10.728077 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-2a55b494-bd1b-4b6b-ad9e-de57c568783d None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:23:10.731831 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2a55b494-bd1b-4b6b-ad9e-de57c568783d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:23:10.850897 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1143/2279] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:23:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:23:10.906771 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fdfc6d-2543-4b1d-9471-18ee1267bd80 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:23:10.910694 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-86fdfc6d-2543-4b1d-9471-18ee1267bd80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:23:10.935990 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:23:11.083580 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fdfc6d-2543-4b1d-9471-18ee1267bd80 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:23:11.087958 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feac413-6e3c-453e-9c43-8e92055a1702 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:23:11.089235 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feac413-6e3c-453e-9c43-8e92055a1702 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:11.089235 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feac413-6e3c-453e-9c43-8e92055a1702 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:11.089536 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feac413-6e3c-453e-9c43-8e92055a1702 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:11.101464 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feac413-6e3c-453e-9c43-8e92055a1702 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:23:11.103917 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feac413-6e3c-453e-9c43-8e92055a1702 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:23:11.121750 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1137/2280] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:23:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:23:13.291988 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def55e95-d771-4755-9ea4-852155c842fd None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:13.292590 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def55e95-d771-4755-9ea4-852155c842fd None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:13.292896 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def55e95-d771-4755-9ea4-852155c842fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:13.341270 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-def55e95-d771-4755-9ea4-852155c842fd None None] MFA Rules not processed for user `66d93db01b9441b7b51e90019d482fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:23:13.343067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-def55e95-d771-4755-9ea4-852155c842fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:23:13.482394 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:23:13.489429 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1144/2281] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:23:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:23:13.502440 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feac413-6e3c-453e-9c43-8e92055a1702 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:23:13.504137 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-5feac413-6e3c-453e-9c43-8e92055a1702 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:23:13.596590 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feac413-6e3c-453e-9c43-8e92055a1702 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:23:13.603736 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c30b3-82a2-47ab-85cf-bd4ef6cc14f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:23:13.604481 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c30b3-82a2-47ab-85cf-bd4ef6cc14f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:13.604798 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c30b3-82a2-47ab-85cf-bd4ef6cc14f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:13.605177 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c30b3-82a2-47ab-85cf-bd4ef6cc14f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:13.621450 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3c30b3-82a2-47ab-85cf-bd4ef6cc14f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:23:13.624054 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3c30b3-82a2-47ab-85cf-bd4ef6cc14f5 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:23:13.640702 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1138/2282] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:23:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:23:15.516856 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe5118-368d-414f-80b6-5af1316796a8 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:15.517466 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe5118-368d-414f-80b6-5af1316796a8 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:15.517466 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe5118-368d-414f-80b6-5af1316796a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:15.540051 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-68fe5118-368d-414f-80b6-5af1316796a8 None None] MFA Rules not processed for user `66d93db01b9441b7b51e90019d482fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:23:15.548996 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-68fe5118-368d-414f-80b6-5af1316796a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:23:15.558791 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1145/2283] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:23:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:23:15.795847 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef635fa-a5fc-4063-8ba7-30e741be3960 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:15.796819 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef635fa-a5fc-4063-8ba7-30e741be3960 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:15.796819 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef635fa-a5fc-4063-8ba7-30e741be3960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:15.829979 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-5ef635fa-a5fc-4063-8ba7-30e741be3960 None None] MFA Rules not processed for user `6ec17bc9af1e497590bf0ac31f29d463`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:23:15.831922 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-5ef635fa-a5fc-4063-8ba7-30e741be3960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:23:15.955128 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1139/2284] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:23:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:23:25.533620 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:23:25.945465 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=76 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:23:27.860502 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe5118-368d-414f-80b6-5af1316796a8 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:23:27.863520 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-68fe5118-368d-414f-80b6-5af1316796a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:23:27.885758 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe5118-368d-414f-80b6-5af1316796a8 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:23:27.891458 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3977c-2c00-4b87-916a-265acdbe4d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:23:27.892376 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3977c-2c00-4b87-916a-265acdbe4d82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:27.892972 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3977c-2c00-4b87-916a-265acdbe4d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:27.892972 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3977c-2c00-4b87-916a-265acdbe4d82 admin admin] PATH_INFO: `/v3/users/4a8736ee266d48f187f440f5cc69114e` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:27.904109 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa3977c-2c00-4b87-916a-265acdbe4d82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a8736ee266d48f187f440f5cc69114e)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:23:27.904109 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa3977c-2c00-4b87-916a-265acdbe4d82 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:23:27.961088 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-4aa3977c-2c00-4b87-916a-265acdbe4d82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a8736ee266d48f187f440f5cc69114e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:27.962073 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-4aa3977c-2c00-4b87-916a-265acdbe4d82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a8736ee266d48f187f440f5cc69114e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:27.962835 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-4aa3977c-2c00-4b87-916a-265acdbe4d82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a8736ee266d48f187f440f5cc69114e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:27.981717 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-4aa3977c-2c00-4b87-916a-265acdbe4d82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a8736ee266d48f187f440f5cc69114e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:27.995928 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-4aa3977c-2c00-4b87-916a-265acdbe4d82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a8736ee266d48f187f440f5cc69114e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:28.010803 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1146/2285] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:23:27 2022] DELETE /identity/v3/users/4a8736ee266d48f187f440f5cc69114e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:23:28.255470 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef635fa-a5fc-4063-8ba7-30e741be3960 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:23:28.277040 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef635fa-a5fc-4063-8ba7-30e741be3960 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:23:28.367239 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c4c5a-6101-41a1-8e4a-35ee64b30e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:23:28.368274 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c4c5a-6101-41a1-8e4a-35ee64b30e8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:28.368558 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c4c5a-6101-41a1-8e4a-35ee64b30e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:28.368832 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c4c5a-6101-41a1-8e4a-35ee64b30e8b admin admin] PATH_INFO: `/v3/projects/55a9855480964d37b0151df5eb21f414` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:28.370693 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c4c5a-6101-41a1-8e4a-35ee64b30e8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=55a9855480964d37b0151df5eb21f414)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:23:28.372199 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c4c5a-6101-41a1-8e4a-35ee64b30e8b admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:23:28.440435 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-768c4c5a-6101-41a1-8e4a-35ee64b30e8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55a9855480964d37b0151df5eb21f414', 'request_id': 'req-768c4c5a-6101-41a1-8e4a-35ee64b30e8b'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:28.448089 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-768c4c5a-6101-41a1-8e4a-35ee64b30e8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55a9855480964d37b0151df5eb21f414', 'request_id': 'req-768c4c5a-6101-41a1-8e4a-35ee64b30e8b'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:28.458689 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-768c4c5a-6101-41a1-8e4a-35ee64b30e8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55a9855480964d37b0151df5eb21f414', 'request_id': 'req-768c4c5a-6101-41a1-8e4a-35ee64b30e8b'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:28.482020 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-768c4c5a-6101-41a1-8e4a-35ee64b30e8b admin admin] The token cache is being invalidate because project 55a9855480964d37b0151df5eb21f414 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:23:28.482422 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-768c4c5a-6101-41a1-8e4a-35ee64b30e8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:28.483266 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-768c4c5a-6101-41a1-8e4a-35ee64b30e8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:28.489905 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1140/2286] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:23:28 2022] DELETE /identity/v3/projects/55a9855480964d37b0151df5eb21f414 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:23:28.499798 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3977c-2c00-4b87-916a-265acdbe4d82 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:23:28.501749 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4aa3977c-2c00-4b87-916a-265acdbe4d82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:23:28.519229 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3977c-2c00-4b87-916a-265acdbe4d82 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:23:28.583554 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b5a8c8-179c-49d3-95ef-fbb1a08b4361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:23:28.584574 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5a8c8-179c-49d3-95ef-fbb1a08b4361 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:28.584866 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5a8c8-179c-49d3-95ef-fbb1a08b4361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:28.585201 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5a8c8-179c-49d3-95ef-fbb1a08b4361 admin admin] PATH_INFO: `/v3/users/f661819d162c407cb816403c5c4866ec` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:28.586615 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b5a8c8-179c-49d3-95ef-fbb1a08b4361 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f661819d162c407cb816403c5c4866ec)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:23:28.588588 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b5a8c8-179c-49d3-95ef-fbb1a08b4361 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:23:28.647570 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c5b5a8c8-179c-49d3-95ef-fbb1a08b4361 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f661819d162c407cb816403c5c4866ec'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:28.648344 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c5b5a8c8-179c-49d3-95ef-fbb1a08b4361 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f661819d162c407cb816403c5c4866ec'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:28.649066 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c5b5a8c8-179c-49d3-95ef-fbb1a08b4361 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f661819d162c407cb816403c5c4866ec'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:28.663328 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c5b5a8c8-179c-49d3-95ef-fbb1a08b4361 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f661819d162c407cb816403c5c4866ec'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:28.671788 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c5b5a8c8-179c-49d3-95ef-fbb1a08b4361 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f661819d162c407cb816403c5c4866ec'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:28.674508 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:23:28.689512 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1147/2287] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:23:28 2022] DELETE /identity/v3/users/f661819d162c407cb816403c5c4866ec => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:23:28.953623 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c4c5a-6101-41a1-8e4a-35ee64b30e8b admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:23:28.955261 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-768c4c5a-6101-41a1-8e4a-35ee64b30e8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:23:29.122549 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c4c5a-6101-41a1-8e4a-35ee64b30e8b admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:23:29.155479 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:23:29.216190 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19adccae-7f88-4016-a2e3-8a7a0ca9ee1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:23:29.217328 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19adccae-7f88-4016-a2e3-8a7a0ca9ee1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:29.217784 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19adccae-7f88-4016-a2e3-8a7a0ca9ee1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:29.218141 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19adccae-7f88-4016-a2e3-8a7a0ca9ee1e admin admin] PATH_INFO: `/v3/projects/0e835c0d14c14d659dd0cdedbeb18445` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:29.219682 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19adccae-7f88-4016-a2e3-8a7a0ca9ee1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e835c0d14c14d659dd0cdedbeb18445)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:23:29.221874 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19adccae-7f88-4016-a2e3-8a7a0ca9ee1e admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:23:29.295187 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-19adccae-7f88-4016-a2e3-8a7a0ca9ee1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e835c0d14c14d659dd0cdedbeb18445', 'request_id': 'req-19adccae-7f88-4016-a2e3-8a7a0ca9ee1e'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:29.306186 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-19adccae-7f88-4016-a2e3-8a7a0ca9ee1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e835c0d14c14d659dd0cdedbeb18445', 'request_id': 'req-19adccae-7f88-4016-a2e3-8a7a0ca9ee1e'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:29.321543 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-19adccae-7f88-4016-a2e3-8a7a0ca9ee1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e835c0d14c14d659dd0cdedbeb18445', 'request_id': 'req-19adccae-7f88-4016-a2e3-8a7a0ca9ee1e'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:29.335705 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-19adccae-7f88-4016-a2e3-8a7a0ca9ee1e admin admin] The token cache is being invalidate because project 0e835c0d14c14d659dd0cdedbeb18445 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:23:29.335999 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-19adccae-7f88-4016-a2e3-8a7a0ca9ee1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:29.336657 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-19adccae-7f88-4016-a2e3-8a7a0ca9ee1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:29.338452 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1141/2288] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:23:28 2022] DELETE /identity/v3/projects/0e835c0d14c14d659dd0cdedbeb18445 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:23:29.343391 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75698acc-6a84-4c11-ba5a-18133e34950b None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:29.343980 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75698acc-6a84-4c11-ba5a-18133e34950b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:29.343980 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75698acc-6a84-4c11-ba5a-18133e34950b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:29.409000 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-75698acc-6a84-4c11-ba5a-18133e34950b None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:23:29.411237 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-75698acc-6a84-4c11-ba5a-18133e34950b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:23:29.483245 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1148/2289] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:23:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:23:29.492486 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f8a8f-963c-42f6-a842-38f068faaca4 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:29.492486 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f8a8f-963c-42f6-a842-38f068faaca4 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:29.492486 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f8a8f-963c-42f6-a842-38f068faaca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:29.513908 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-b70f8a8f-963c-42f6-a842-38f068faaca4 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:23:29.515120 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-b70f8a8f-963c-42f6-a842-38f068faaca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:23:29.524888 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1142/2290] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:23:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:23:29.530678 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75698acc-6a84-4c11-ba5a-18133e34950b None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:23:29.542675 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75698acc-6a84-4c11-ba5a-18133e34950b None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:23:29.548195 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f6519-ebe0-4de7-b85b-53497543723f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:23:29.549084 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f6519-ebe0-4de7-b85b-53497543723f admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:29.549428 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f6519-ebe0-4de7-b85b-53497543723f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:29.549955 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f6519-ebe0-4de7-b85b-53497543723f admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:29.550907 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607f6519-ebe0-4de7-b85b-53497543723f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:23:29.551280 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607f6519-ebe0-4de7-b85b-53497543723f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:23:29.552982 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607f6519-ebe0-4de7-b85b-53497543723f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:23:29.568916 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1149/2291] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:23:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:23:29.572992 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f8a8f-963c-42f6-a842-38f068faaca4 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:23:29.583311 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f8a8f-963c-42f6-a842-38f068faaca4 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:23:29.588372 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9b7f9-2a93-41f4-b76f-8b49988d022d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:23:29.589381 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9b7f9-2a93-41f4-b76f-8b49988d022d admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:29.589381 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9b7f9-2a93-41f4-b76f-8b49988d022d admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:29.589658 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9b7f9-2a93-41f4-b76f-8b49988d022d admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:29.590346 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac9b7f9-2a93-41f4-b76f-8b49988d022d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:23:29.592296 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac9b7f9-2a93-41f4-b76f-8b49988d022d admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:23:29.626969 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1143/2292] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:23:29 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:23:29.630381 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f6519-ebe0-4de7-b85b-53497543723f admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:23:29.642765 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f6519-ebe0-4de7-b85b-53497543723f admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:23:29.725671 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50543db2-7047-4370-9bbb-b7e2fd363446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:23:29.726418 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50543db2-7047-4370-9bbb-b7e2fd363446 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:29.726699 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50543db2-7047-4370-9bbb-b7e2fd363446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:29.726969 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50543db2-7047-4370-9bbb-b7e2fd363446 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:29.727673 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50543db2-7047-4370-9bbb-b7e2fd363446 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:23:29.729625 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50543db2-7047-4370-9bbb-b7e2fd363446 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:23:29.752576 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1150/2293] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:23:29 2022] POST /identity/v3/users => generated 289 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:23:29.757517 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9b7f9-2a93-41f4-b76f-8b49988d022d admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:23:29.770249 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9b7f9-2a93-41f4-b76f-8b49988d022d admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:23:29.777581 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5389a-2a78-43c0-a74d-dc4d46157b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:23:29.778472 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5389a-2a78-43c0-a74d-dc4d46157b68 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:29.785782 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5389a-2a78-43c0-a74d-dc4d46157b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:29.786176 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5389a-2a78-43c0-a74d-dc4d46157b68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:29.786921 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea5389a-2a78-43c0-a74d-dc4d46157b68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:23:29.788627 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea5389a-2a78-43c0-a74d-dc4d46157b68 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:23:29.804523 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1144/2294] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:23:29.809308 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50543db2-7047-4370-9bbb-b7e2fd363446 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:23:29.822162 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50543db2-7047-4370-9bbb-b7e2fd363446 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:23:29.827612 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd22553-1f2b-4b1d-bc4e-bd77ce497996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:23:29.828245 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd22553-1f2b-4b1d-bc4e-bd77ce497996 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:29.828545 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd22553-1f2b-4b1d-bc4e-bd77ce497996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:29.828813 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd22553-1f2b-4b1d-bc4e-bd77ce497996 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:29.829554 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd22553-1f2b-4b1d-bc4e-bd77ce497996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:23:29.831525 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd22553-1f2b-4b1d-bc4e-bd77ce497996 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:23:29.843897 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1151/2295] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:23:29.848716 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5389a-2a78-43c0-a74d-dc4d46157b68 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:23:29.862279 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5389a-2a78-43c0-a74d-dc4d46157b68 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:23:29.867456 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee1484-0c94-44ed-9d97-bf09ff8ed87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:23:29.868358 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee1484-0c94-44ed-9d97-bf09ff8ed87c admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:29.868641 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee1484-0c94-44ed-9d97-bf09ff8ed87c admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:29.868917 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee1484-0c94-44ed-9d97-bf09ff8ed87c admin admin] PATH_INFO: `/v3/projects/8c1889d93f674f1a856482ec11632b12/users/9ad1bd4016e242cca90ade3b8bcc37b5/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:29.885895 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ee1484-0c94-44ed-9d97-bf09ff8ed87c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c1889d93f674f1a856482ec11632b12, user_id=9ad1bd4016e242cca90ade3b8bcc37b5, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:23:29.888631 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ee1484-0c94-44ed-9d97-bf09ff8ed87c admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:23:29.903077 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1145/2296] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:23:29 2022] PUT /identity/v3/projects/8c1889d93f674f1a856482ec11632b12/users/9ad1bd4016e242cca90ade3b8bcc37b5/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:23:29.919553 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4494b0d-c2c2-444e-a041-ab854c998e37 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:29.920190 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4494b0d-c2c2-444e-a041-ab854c998e37 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:29.920540 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4494b0d-c2c2-444e-a041-ab854c998e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:29.953983 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-b4494b0d-c2c2-444e-a041-ab854c998e37 None None] MFA Rules not processed for user `9ad1bd4016e242cca90ade3b8bcc37b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:23:29.955191 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b4494b0d-c2c2-444e-a041-ab854c998e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:23:29.982440 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:23:30.038721 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1152/2297] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:23:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:23:30.052089 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee1484-0c94-44ed-9d97-bf09ff8ed87c admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:23:30.055581 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-37ee1484-0c94-44ed-9d97-bf09ff8ed87c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:23:30.126946 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:23:30.145819 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee1484-0c94-44ed-9d97-bf09ff8ed87c admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:23:30.149611 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10767f1-1fce-484a-9db1-08fc225fe8f0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd865d1b935a54ca2b44beda5b0277336', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:23:30.150289 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10767f1-1fce-484a-9db1-08fc225fe8f0 service glance] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:30.150566 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10767f1-1fce-484a-9db1-08fc225fe8f0 service glance] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:30.150975 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10767f1-1fce-484a-9db1-08fc225fe8f0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:30.160688 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10767f1-1fce-484a-9db1-08fc225fe8f0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:23:30.162487 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10767f1-1fce-484a-9db1-08fc225fe8f0 service glance] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:23:30.173543 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1146/2298] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:23:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:23:40.043917 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=16 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:23:40.169631 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=8 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:23:48.265392 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c5d78-b1e0-4e21-aa39-98204bfc9e3c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:48.266082 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c5d78-b1e0-4e21-aa39-98204bfc9e3c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:48.266082 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c5d78-b1e0-4e21-aa39-98204bfc9e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:48.302839 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-827c5d78-b1e0-4e21-aa39-98204bfc9e3c None None] MFA Rules not processed for user `cad33601754a462c828566fb54c6e100`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:23:48.304014 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-827c5d78-b1e0-4e21-aa39-98204bfc9e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:23:48.364723 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1153/2299] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Jun 29 12:23:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:23:48.413371 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10767f1-1fce-484a-9db1-08fc225fe8f0 service glance] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:23:48.414936 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e10767f1-1fce-484a-9db1-08fc225fe8f0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:23:48.506275 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10767f1-1fce-484a-9db1-08fc225fe8f0 service glance] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:23:48.514402 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da76d0-bd59-4a95-af28-687badfbbf5a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc92f8232bda407c84365eb10ede737f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:23:48.515077 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da76d0-bd59-4a95-af28-687badfbbf5a service swift] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:48.515350 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da76d0-bd59-4a95-af28-687badfbbf5a service swift] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:48.515616 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da76d0-bd59-4a95-af28-687badfbbf5a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:48.524478 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44da76d0-bd59-4a95-af28-687badfbbf5a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:23:48.527029 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44da76d0-bd59-4a95-af28-687badfbbf5a service swift] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:23:48.535238 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1147/2300] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Jun 29 12:23:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 12:23:58.357583 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=29 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:23:58.532184 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=32 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:23:58.842390 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c5d78-b1e0-4e21-aa39-98204bfc9e3c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:23:59.008502 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c5d78-b1e0-4e21-aa39-98204bfc9e3c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:23:59.015307 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a1d3b3-1a70-40b4-9499-5d62094465e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:23:59.017323 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1d3b3-1a70-40b4-9499-5d62094465e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:59.017949 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1d3b3-1a70-40b4-9499-5d62094465e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:59.018417 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1d3b3-1a70-40b4-9499-5d62094465e0 admin admin] PATH_INFO: `/v3/users/9ad1bd4016e242cca90ade3b8bcc37b5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:59.020325 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a1d3b3-1a70-40b4-9499-5d62094465e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ad1bd4016e242cca90ade3b8bcc37b5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:23:59.023021 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a1d3b3-1a70-40b4-9499-5d62094465e0 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:23:59.169547 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b3a1d3b3-1a70-40b4-9499-5d62094465e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ad1bd4016e242cca90ade3b8bcc37b5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:59.170450 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b3a1d3b3-1a70-40b4-9499-5d62094465e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ad1bd4016e242cca90ade3b8bcc37b5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:59.171480 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b3a1d3b3-1a70-40b4-9499-5d62094465e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ad1bd4016e242cca90ade3b8bcc37b5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:59.197320 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b3a1d3b3-1a70-40b4-9499-5d62094465e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ad1bd4016e242cca90ade3b8bcc37b5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:59.219895 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b3a1d3b3-1a70-40b4-9499-5d62094465e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ad1bd4016e242cca90ade3b8bcc37b5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:23:59.271540 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1154/2301] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:23:58 2022] DELETE /identity/v3/users/9ad1bd4016e242cca90ade3b8bcc37b5 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:23:59.276193 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e0643b-7ca9-435b-8aa7-08c7fd9e7eec None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:59.281798 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e0643b-7ca9-435b-8aa7-08c7fd9e7eec None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:59.282683 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e0643b-7ca9-435b-8aa7-08c7fd9e7eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:59.351137 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-56e0643b-7ca9-435b-8aa7-08c7fd9e7eec None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:23:59.354565 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-56e0643b-7ca9-435b-8aa7-08c7fd9e7eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:23:59.522883 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1148/2302] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:23:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:23:59.533499 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a1d3b3-1a70-40b4-9499-5d62094465e0 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:23:59.536963 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b3a1d3b3-1a70-40b4-9499-5d62094465e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:23:59.663923 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a1d3b3-1a70-40b4-9499-5d62094465e0 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:23:59.677153 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272f0592-2e8d-46b6-a2cf-4cfb5d5ff57b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:23:59.678254 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f0592-2e8d-46b6-a2cf-4cfb5d5ff57b service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:23:59.678824 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f0592-2e8d-46b6-a2cf-4cfb5d5ff57b service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:23:59.679524 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f0592-2e8d-46b6-a2cf-4cfb5d5ff57b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:23:59.700155 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272f0592-2e8d-46b6-a2cf-4cfb5d5ff57b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:23:59.702284 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272f0592-2e8d-46b6-a2cf-4cfb5d5ff57b service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:23:59.722163 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1155/2303] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:23:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:24:00.115879 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e0643b-7ca9-435b-8aa7-08c7fd9e7eec None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:00.119686 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-56e0643b-7ca9-435b-8aa7-08c7fd9e7eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:00.142629 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e0643b-7ca9-435b-8aa7-08c7fd9e7eec None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:00.153586 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdae8f54-bb7a-4f12-88d6-4b1e634e3931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:00.154762 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae8f54-bb7a-4f12-88d6-4b1e634e3931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:00.155276 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae8f54-bb7a-4f12-88d6-4b1e634e3931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:00.155565 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae8f54-bb7a-4f12-88d6-4b1e634e3931 admin admin] PATH_INFO: `/v3/projects/8c1889d93f674f1a856482ec11632b12` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:00.158277 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdae8f54-bb7a-4f12-88d6-4b1e634e3931 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c1889d93f674f1a856482ec11632b12)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:00.160229 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdae8f54-bb7a-4f12-88d6-4b1e634e3931 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:00.257479 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-cdae8f54-bb7a-4f12-88d6-4b1e634e3931 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c1889d93f674f1a856482ec11632b12', 'request_id': 'req-cdae8f54-bb7a-4f12-88d6-4b1e634e3931'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:00.282850 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-cdae8f54-bb7a-4f12-88d6-4b1e634e3931 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c1889d93f674f1a856482ec11632b12', 'request_id': 'req-cdae8f54-bb7a-4f12-88d6-4b1e634e3931'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:00.294670 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-cdae8f54-bb7a-4f12-88d6-4b1e634e3931 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c1889d93f674f1a856482ec11632b12', 'request_id': 'req-cdae8f54-bb7a-4f12-88d6-4b1e634e3931'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:00.308395 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-cdae8f54-bb7a-4f12-88d6-4b1e634e3931 admin admin] The token cache is being invalidate because project 8c1889d93f674f1a856482ec11632b12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:24:00.308748 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-cdae8f54-bb7a-4f12-88d6-4b1e634e3931 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:00.309524 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-cdae8f54-bb7a-4f12-88d6-4b1e634e3931 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:00.324884 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1149/2304] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:24:00 2022] DELETE /identity/v3/projects/8c1889d93f674f1a856482ec11632b12 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:24:00.328881 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd507d-c662-4e3d-85ab-7ee684512b05 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:00.329331 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd507d-c662-4e3d-85ab-7ee684512b05 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:00.329859 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd507d-c662-4e3d-85ab-7ee684512b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:00.335413 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:24:00.377315 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-39dd507d-c662-4e3d-85ab-7ee684512b05 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:24:00.379186 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-39dd507d-c662-4e3d-85ab-7ee684512b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:00.471104 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1156/2305] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:24:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:24:00.480609 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fda620-3358-48ef-81fe-e8f0277f06ee None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:00.481069 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fda620-3358-48ef-81fe-e8f0277f06ee None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:00.481537 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fda620-3358-48ef-81fe-e8f0277f06ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:00.513416 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-36fda620-3358-48ef-81fe-e8f0277f06ee None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:24:00.516122 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-36fda620-3358-48ef-81fe-e8f0277f06ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:00.528731 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1150/2306] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:24:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:24:00.534021 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd507d-c662-4e3d-85ab-7ee684512b05 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:00.546852 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd507d-c662-4e3d-85ab-7ee684512b05 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:00.553134 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4809c582-450c-49dd-b7ce-23da3fd074c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:00.553867 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809c582-450c-49dd-b7ce-23da3fd074c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:00.554226 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809c582-450c-49dd-b7ce-23da3fd074c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:00.554506 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809c582-450c-49dd-b7ce-23da3fd074c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:00.555186 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4809c582-450c-49dd-b7ce-23da3fd074c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:24:00.555526 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4809c582-450c-49dd-b7ce-23da3fd074c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:00.557144 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4809c582-450c-49dd-b7ce-23da3fd074c6 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:00.580531 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fda620-3358-48ef-81fe-e8f0277f06ee None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:00.586045 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1157/2307] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:24:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:24:00.594179 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fda620-3358-48ef-81fe-e8f0277f06ee None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:00.600119 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a68a49-5d40-451f-aa07-6190bfe8be57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:00.600892 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a68a49-5d40-451f-aa07-6190bfe8be57 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:00.601604 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a68a49-5d40-451f-aa07-6190bfe8be57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:00.602173 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a68a49-5d40-451f-aa07-6190bfe8be57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:00.603201 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a68a49-5d40-451f-aa07-6190bfe8be57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:00.605638 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a68a49-5d40-451f-aa07-6190bfe8be57 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:00.644143 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1151/2308] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:24:00 2022] POST /identity/v3/projects => generated 375 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:24:00.645359 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4809c582-450c-49dd-b7ce-23da3fd074c6 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:00.657810 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4809c582-450c-49dd-b7ce-23da3fd074c6 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:00.757479 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d17d95-eccc-42c0-89ad-a5597c5e6f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:00.757479 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d17d95-eccc-42c0-89ad-a5597c5e6f9c admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:00.757479 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d17d95-eccc-42c0-89ad-a5597c5e6f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:00.757479 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d17d95-eccc-42c0-89ad-a5597c5e6f9c admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:00.758578 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d17d95-eccc-42c0-89ad-a5597c5e6f9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:00.761223 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d17d95-eccc-42c0-89ad-a5597c5e6f9c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:00.790799 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1158/2309] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:24:00 2022] POST /identity/v3/users => generated 288 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:24:00.796725 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a68a49-5d40-451f-aa07-6190bfe8be57 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:00.809056 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a68a49-5d40-451f-aa07-6190bfe8be57 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:00.842655 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08019ccc-1b53-4b1c-afe1-82fbaaf3c562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:00.843388 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08019ccc-1b53-4b1c-afe1-82fbaaf3c562 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:00.843772 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08019ccc-1b53-4b1c-afe1-82fbaaf3c562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:00.844047 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08019ccc-1b53-4b1c-afe1-82fbaaf3c562 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:00.844820 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08019ccc-1b53-4b1c-afe1-82fbaaf3c562 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:00.847667 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08019ccc-1b53-4b1c-afe1-82fbaaf3c562 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:00.865737 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1152/2310] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:24:00.867832 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d17d95-eccc-42c0-89ad-a5597c5e6f9c admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:00.879916 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d17d95-eccc-42c0-89ad-a5597c5e6f9c admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:00.886356 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c37fb3-aa1c-46eb-949d-6f3c0f388c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:00.887134 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c37fb3-aa1c-46eb-949d-6f3c0f388c3b admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:00.887419 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c37fb3-aa1c-46eb-949d-6f3c0f388c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:00.888174 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c37fb3-aa1c-46eb-949d-6f3c0f388c3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:00.888438 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c37fb3-aa1c-46eb-949d-6f3c0f388c3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:00.890101 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c37fb3-aa1c-46eb-949d-6f3c0f388c3b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:00.908649 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1159/2311] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:24:00.912753 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08019ccc-1b53-4b1c-afe1-82fbaaf3c562 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:00.926391 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08019ccc-1b53-4b1c-afe1-82fbaaf3c562 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:00.931333 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc2c3f0-349e-4532-ab6e-63bb11e4088b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:00.932416 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2c3f0-349e-4532-ab6e-63bb11e4088b admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:00.932760 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2c3f0-349e-4532-ab6e-63bb11e4088b admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:00.933063 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2c3f0-349e-4532-ab6e-63bb11e4088b admin admin] PATH_INFO: `/v3/projects/230ca9aa1ef0417dabde3404273597a6/users/ea7dda4314c7448eba22912f4fdae288/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:00.951177 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc2c3f0-349e-4532-ab6e-63bb11e4088b admin admin] RBAC: Authorizing `identity:create_grant(project_id=230ca9aa1ef0417dabde3404273597a6, user_id=ea7dda4314c7448eba22912f4fdae288, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:00.953958 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc2c3f0-349e-4532-ab6e-63bb11e4088b admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:00.970902 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1153/2312] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:24:00 2022] PUT /identity/v3/projects/230ca9aa1ef0417dabde3404273597a6/users/ea7dda4314c7448eba22912f4fdae288/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:24:00.982458 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f846d9-f9bd-4c03-b239-a95f021d5935 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:00.982808 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f846d9-f9bd-4c03-b239-a95f021d5935 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:00.983101 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f846d9-f9bd-4c03-b239-a95f021d5935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:01.016842 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-20f846d9-f9bd-4c03-b239-a95f021d5935 None None] MFA Rules not processed for user `ea7dda4314c7448eba22912f4fdae288`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:24:01.018175 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-20f846d9-f9bd-4c03-b239-a95f021d5935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:01.078272 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:24:01.117058 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1160/2313] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:24:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:24:01.125460 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc2c3f0-349e-4532-ab6e-63bb11e4088b admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:01.127841 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-bbc2c3f0-349e-4532-ab6e-63bb11e4088b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:01.156734 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:24:01.238421 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc2c3f0-349e-4532-ab6e-63bb11e4088b admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:01.243386 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e18b74-9ab9-4e19-a23a-5ad8ad5b2216 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:01.244179 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e18b74-9ab9-4e19-a23a-5ad8ad5b2216 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:01.244662 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e18b74-9ab9-4e19-a23a-5ad8ad5b2216 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:01.245135 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e18b74-9ab9-4e19-a23a-5ad8ad5b2216 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:01.256231 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e18b74-9ab9-4e19-a23a-5ad8ad5b2216 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:01.257748 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e18b74-9ab9-4e19-a23a-5ad8ad5b2216 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:01.279306 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1154/2314] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:24:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:24:02.461476 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d90af9-f194-4a48-bcb4-a23e2f6f7723 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:02.462151 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d90af9-f194-4a48-bcb4-a23e2f6f7723 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:02.462151 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d90af9-f194-4a48-bcb4-a23e2f6f7723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:02.485114 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-21d90af9-f194-4a48-bcb4-a23e2f6f7723 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:24:02.486488 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-21d90af9-f194-4a48-bcb4-a23e2f6f7723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:02.583780 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1161/2315] 10.222.0.58 () {58 vars in 1016 bytes} [Wed Jun 29 12:24:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:24:02.613091 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e18b74-9ab9-4e19-a23a-5ad8ad5b2216 service cinder] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:02.617171 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a6e18b74-9ab9-4e19-a23a-5ad8ad5b2216 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:02.807346 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e18b74-9ab9-4e19-a23a-5ad8ad5b2216 service cinder] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:02.816131 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80728a4c-9b59-400e-9a81-b07722df2291 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7adaa2ef440941aa8214f2b2fd49b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:02.816823 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80728a4c-9b59-400e-9a81-b07722df2291 service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:02.817101 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80728a4c-9b59-400e-9a81-b07722df2291 service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:02.817335 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80728a4c-9b59-400e-9a81-b07722df2291 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:02.832692 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80728a4c-9b59-400e-9a81-b07722df2291 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:02.835138 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80728a4c-9b59-400e-9a81-b07722df2291 service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:02.849911 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1155/2316] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:24:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:24:05.333253 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d90af9-f194-4a48-bcb4-a23e2f6f7723 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:05.336444 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-21d90af9-f194-4a48-bcb4-a23e2f6f7723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:05.536587 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d90af9-f194-4a48-bcb4-a23e2f6f7723 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:05.547095 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb59c6-9335-4296-a5b8-bac899f6da83 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '286a99b42d9246db909040bf8ab18ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:05.547960 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb59c6-9335-4296-a5b8-bac899f6da83 service placement] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:05.548245 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb59c6-9335-4296-a5b8-bac899f6da83 service placement] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:05.548528 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb59c6-9335-4296-a5b8-bac899f6da83 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:05.550808 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9abb59c6-9335-4296-a5b8-bac899f6da83 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:05.565987 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abb59c6-9335-4296-a5b8-bac899f6da83 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:05.567650 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abb59c6-9335-4296-a5b8-bac899f6da83 service placement] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:05.581001 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1162/2317] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:24:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:24:07.696941 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d539453-995f-4f67-b059-446bd3e64d80 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:07.696941 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d539453-995f-4f67-b059-446bd3e64d80 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:07.698515 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d539453-995f-4f67-b059-446bd3e64d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:07.735583 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-3d539453-995f-4f67-b059-446bd3e64d80 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:24:07.738363 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-3d539453-995f-4f67-b059-446bd3e64d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:07.753978 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1156/2318] 10.222.0.58 () {58 vars in 1016 bytes} [Wed Jun 29 12:24:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:24:07.783100 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb59c6-9335-4296-a5b8-bac899f6da83 service placement] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:07.786777 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9abb59c6-9335-4296-a5b8-bac899f6da83 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:07.815349 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb59c6-9335-4296-a5b8-bac899f6da83 service placement] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:07.827295 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a27086-57c4-41f2-bb49-619b9e26f1c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7adaa2ef440941aa8214f2b2fd49b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:07.828308 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a27086-57c4-41f2-bb49-619b9e26f1c3 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:07.828753 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a27086-57c4-41f2-bb49-619b9e26f1c3 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:07.829492 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a27086-57c4-41f2-bb49-619b9e26f1c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:07.841454 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a27086-57c4-41f2-bb49-619b9e26f1c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:07.843459 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a27086-57c4-41f2-bb49-619b9e26f1c3 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:07.855778 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1163/2319] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:24:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:24:11.090545 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931250cb-7f87-4bfa-b34f-81bed61cce68 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:11.091248 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931250cb-7f87-4bfa-b34f-81bed61cce68 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:11.091248 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931250cb-7f87-4bfa-b34f-81bed61cce68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:11.113909 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-931250cb-7f87-4bfa-b34f-81bed61cce68 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:24:11.115145 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-931250cb-7f87-4bfa-b34f-81bed61cce68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:11.124590 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1157/2320] 10.222.0.58 () {58 vars in 1016 bytes} [Wed Jun 29 12:24:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:24:11.156540 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a27086-57c4-41f2-bb49-619b9e26f1c3 service nova] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:11.170847 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a27086-57c4-41f2-bb49-619b9e26f1c3 service nova] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:11.177006 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06044b5c-9ffd-4d7b-86ba-98995420d120 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7adaa2ef440941aa8214f2b2fd49b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:11.177719 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06044b5c-9ffd-4d7b-86ba-98995420d120 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:11.178018 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06044b5c-9ffd-4d7b-86ba-98995420d120 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:11.178296 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06044b5c-9ffd-4d7b-86ba-98995420d120 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:11.188461 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06044b5c-9ffd-4d7b-86ba-98995420d120 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:11.190372 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06044b5c-9ffd-4d7b-86ba-98995420d120 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:11.202308 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1164/2321] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:24:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:24:11.888812 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686acdb-2b93-4405-b222-6f2ea47b7ea1 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:11.889195 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686acdb-2b93-4405-b222-6f2ea47b7ea1 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:11.889552 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686acdb-2b93-4405-b222-6f2ea47b7ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:11.909289 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-d686acdb-2b93-4405-b222-6f2ea47b7ea1 None None] MFA Rules not processed for user `cad33601754a462c828566fb54c6e100`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:24:11.910598 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-d686acdb-2b93-4405-b222-6f2ea47b7ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:11.966734 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:24:11.979632 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1158/2322] 10.222.0.27 () {58 vars in 967 bytes} [Wed Jun 29 12:24:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:24:11.995983 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06044b5c-9ffd-4d7b-86ba-98995420d120 service nova] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:11.998072 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-06044b5c-9ffd-4d7b-86ba-98995420d120 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:12.044128 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:24:12.094661 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06044b5c-9ffd-4d7b-86ba-98995420d120 service nova] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:12.100000 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc131e99-ed4a-4673-95a4-a2b5679f16e3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc92f8232bda407c84365eb10ede737f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:12.100693 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc131e99-ed4a-4673-95a4-a2b5679f16e3 service swift] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:12.101075 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc131e99-ed4a-4673-95a4-a2b5679f16e3 service swift] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:12.101204 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc131e99-ed4a-4673-95a4-a2b5679f16e3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:12.112231 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc131e99-ed4a-4673-95a4-a2b5679f16e3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:12.114505 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc131e99-ed4a-4673-95a4-a2b5679f16e3 service swift] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:12.128946 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1165/2323] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Jun 29 12:24:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 12:24:14.108934 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8551e0-fd06-49f7-b0c1-bca25f08e64d None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:14.109612 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8551e0-fd06-49f7-b0c1-bca25f08e64d None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:14.110177 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8551e0-fd06-49f7-b0c1-bca25f08e64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:14.136718 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-ee8551e0-fd06-49f7-b0c1-bca25f08e64d None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:24:14.138587 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ee8551e0-fd06-49f7-b0c1-bca25f08e64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:14.149049 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1159/2324] 10.222.0.58 () {58 vars in 1016 bytes} [Wed Jun 29 12:24:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:24:14.170421 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc131e99-ed4a-4673-95a4-a2b5679f16e3 service swift] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:14.196978 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc131e99-ed4a-4673-95a4-a2b5679f16e3 service swift] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:14.204991 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac22f202-7109-4a18-a2d3-d92849d786a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7adaa2ef440941aa8214f2b2fd49b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:14.205670 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22f202-7109-4a18-a2d3-d92849d786a2 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:14.205996 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22f202-7109-4a18-a2d3-d92849d786a2 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:14.206277 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22f202-7109-4a18-a2d3-d92849d786a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:14.219026 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac22f202-7109-4a18-a2d3-d92849d786a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:14.225433 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac22f202-7109-4a18-a2d3-d92849d786a2 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:14.242435 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1166/2325] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:24:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:24:14.349656 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8551e0-fd06-49f7-b0c1-bca25f08e64d None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:14.361811 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8551e0-fd06-49f7-b0c1-bca25f08e64d None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:14.368881 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d657d3-8740-438f-aa53-734b73e95a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:14.370011 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d657d3-8740-438f-aa53-734b73e95a74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:14.370345 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d657d3-8740-438f-aa53-734b73e95a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:14.370759 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d657d3-8740-438f-aa53-734b73e95a74 admin admin] PATH_INFO: `/v3/users/ea7dda4314c7448eba22912f4fdae288` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:14.372045 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d657d3-8740-438f-aa53-734b73e95a74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea7dda4314c7448eba22912f4fdae288)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:14.374129 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d657d3-8740-438f-aa53-734b73e95a74 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:14.445152 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b0d657d3-8740-438f-aa53-734b73e95a74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea7dda4314c7448eba22912f4fdae288'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:14.470422 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b0d657d3-8740-438f-aa53-734b73e95a74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea7dda4314c7448eba22912f4fdae288'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:14.481873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b0d657d3-8740-438f-aa53-734b73e95a74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea7dda4314c7448eba22912f4fdae288'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:14.483170 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b0d657d3-8740-438f-aa53-734b73e95a74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea7dda4314c7448eba22912f4fdae288'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:14.498129 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b0d657d3-8740-438f-aa53-734b73e95a74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea7dda4314c7448eba22912f4fdae288'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:14.510903 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1160/2326] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:24:14 2022] DELETE /identity/v3/users/ea7dda4314c7448eba22912f4fdae288 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:24:14.516848 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff215203-6100-4f6f-9ba5-438d2659c42a None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:14.517224 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff215203-6100-4f6f-9ba5-438d2659c42a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:14.517611 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff215203-6100-4f6f-9ba5-438d2659c42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:14.547423 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-ff215203-6100-4f6f-9ba5-438d2659c42a None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:24:14.549788 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ff215203-6100-4f6f-9ba5-438d2659c42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:14.607615 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d657d3-8740-438f-aa53-734b73e95a74 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:14.611131 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-b0d657d3-8740-438f-aa53-734b73e95a74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:14.653108 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1167/2327] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:24:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:24:14.664796 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff215203-6100-4f6f-9ba5-438d2659c42a None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:14.668681 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ff215203-6100-4f6f-9ba5-438d2659c42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:14.714586 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d657d3-8740-438f-aa53-734b73e95a74 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:14.721821 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c56ee9-6b03-48b6-af4f-0713bbe2dc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:14.723001 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c56ee9-6b03-48b6-af4f-0713bbe2dc0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:14.723257 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c56ee9-6b03-48b6-af4f-0713bbe2dc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:14.723530 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c56ee9-6b03-48b6-af4f-0713bbe2dc0f admin admin] PATH_INFO: `/v3/users/18392ef8bf1f4679bd28dc870aa74a0d` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:14.724883 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c56ee9-6b03-48b6-af4f-0713bbe2dc0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=18392ef8bf1f4679bd28dc870aa74a0d)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:14.726919 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c56ee9-6b03-48b6-af4f-0713bbe2dc0f admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:14.747212 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff215203-6100-4f6f-9ba5-438d2659c42a None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:14.752755 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d81b893-7d1e-4d1f-9f40-a3b286aec314 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:14.753563 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81b893-7d1e-4d1f-9f40-a3b286aec314 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:14.753923 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81b893-7d1e-4d1f-9f40-a3b286aec314 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:14.754477 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81b893-7d1e-4d1f-9f40-a3b286aec314 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:14.767776 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d81b893-7d1e-4d1f-9f40-a3b286aec314 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:14.769438 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d81b893-7d1e-4d1f-9f40-a3b286aec314 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:14.783157 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1168/2328] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:24:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:24:14.796748 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-59c56ee9-6b03-48b6-af4f-0713bbe2dc0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18392ef8bf1f4679bd28dc870aa74a0d'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:14.811456 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:24:14.815485 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-59c56ee9-6b03-48b6-af4f-0713bbe2dc0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18392ef8bf1f4679bd28dc870aa74a0d'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:14.827529 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-59c56ee9-6b03-48b6-af4f-0713bbe2dc0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18392ef8bf1f4679bd28dc870aa74a0d'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:14.829613 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-59c56ee9-6b03-48b6-af4f-0713bbe2dc0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18392ef8bf1f4679bd28dc870aa74a0d'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:14.841225 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-59c56ee9-6b03-48b6-af4f-0713bbe2dc0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18392ef8bf1f4679bd28dc870aa74a0d'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:14.850060 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1161/2329] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:24:14 2022] DELETE /identity/v3/users/18392ef8bf1f4679bd28dc870aa74a0d => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:24:15.077894 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d81b893-7d1e-4d1f-9f40-a3b286aec314 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:15.091323 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d81b893-7d1e-4d1f-9f40-a3b286aec314 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:15.187458 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:24:15.204238 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cace4a-eef4-4469-8ec7-888bde3e5b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:15.205908 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cace4a-eef4-4469-8ec7-888bde3e5b0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:15.205908 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cace4a-eef4-4469-8ec7-888bde3e5b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:15.206498 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cace4a-eef4-4469-8ec7-888bde3e5b0b admin admin] PATH_INFO: `/v3/projects/859acc3c2d5e48268667272dc2d850be` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:15.208241 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cace4a-eef4-4469-8ec7-888bde3e5b0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=859acc3c2d5e48268667272dc2d850be)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:15.210950 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cace4a-eef4-4469-8ec7-888bde3e5b0b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:15.218250 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c56ee9-6b03-48b6-af4f-0713bbe2dc0f admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:15.220440 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-59c56ee9-6b03-48b6-af4f-0713bbe2dc0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:15.238172 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c56ee9-6b03-48b6-af4f-0713bbe2dc0f admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:15.244570 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c816d617-c245-4ddd-a470-c9dfcdf98bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:15.245754 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816d617-c245-4ddd-a470-c9dfcdf98bec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:15.247477 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816d617-c245-4ddd-a470-c9dfcdf98bec admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:15.248183 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816d617-c245-4ddd-a470-c9dfcdf98bec admin admin] PATH_INFO: `/v3/projects/230ca9aa1ef0417dabde3404273597a6` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:15.250242 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c816d617-c245-4ddd-a470-c9dfcdf98bec admin admin] RBAC: Authorizing `identity:delete_project(project_id=230ca9aa1ef0417dabde3404273597a6)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:15.252411 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c816d617-c245-4ddd-a470-c9dfcdf98bec admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:15.292862 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-06cace4a-eef4-4469-8ec7-888bde3e5b0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '859acc3c2d5e48268667272dc2d850be', 'request_id': 'req-06cace4a-eef4-4469-8ec7-888bde3e5b0b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:15.299120 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-06cace4a-eef4-4469-8ec7-888bde3e5b0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '859acc3c2d5e48268667272dc2d850be', 'request_id': 'req-06cace4a-eef4-4469-8ec7-888bde3e5b0b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:15.309353 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-06cace4a-eef4-4469-8ec7-888bde3e5b0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '859acc3c2d5e48268667272dc2d850be', 'request_id': 'req-06cace4a-eef4-4469-8ec7-888bde3e5b0b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:15.315572 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-c816d617-c245-4ddd-a470-c9dfcdf98bec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '230ca9aa1ef0417dabde3404273597a6', 'request_id': 'req-c816d617-c245-4ddd-a470-c9dfcdf98bec'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:15.322232 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-c816d617-c245-4ddd-a470-c9dfcdf98bec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '230ca9aa1ef0417dabde3404273597a6', 'request_id': 'req-c816d617-c245-4ddd-a470-c9dfcdf98bec'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:15.322495 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-06cace4a-eef4-4469-8ec7-888bde3e5b0b admin admin] The token cache is being invalidate because project 859acc3c2d5e48268667272dc2d850be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:24:15.323855 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-06cace4a-eef4-4469-8ec7-888bde3e5b0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:15.324543 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-06cace4a-eef4-4469-8ec7-888bde3e5b0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:15.326238 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1169/2330] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:24:15 2022] DELETE /identity/v3/projects/859acc3c2d5e48268667272dc2d850be => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:24:15.331352 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65391a6-4b3c-459f-bf8f-f7ed96c77848 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:15.331636 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65391a6-4b3c-459f-bf8f-f7ed96c77848 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:15.332088 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65391a6-4b3c-459f-bf8f-f7ed96c77848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:15.332401 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-c816d617-c245-4ddd-a470-c9dfcdf98bec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '230ca9aa1ef0417dabde3404273597a6', 'request_id': 'req-c816d617-c245-4ddd-a470-c9dfcdf98bec'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:15.352001 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-c816d617-c245-4ddd-a470-c9dfcdf98bec admin admin] The token cache is being invalidate because project 230ca9aa1ef0417dabde3404273597a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:24:15.352548 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-b65391a6-4b3c-459f-bf8f-f7ed96c77848 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:24:15.352723 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-c816d617-c245-4ddd-a470-c9dfcdf98bec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:15.353467 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-c816d617-c245-4ddd-a470-c9dfcdf98bec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:15.353853 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b65391a6-4b3c-459f-bf8f-f7ed96c77848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:15.355929 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1162/2331] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:24:15 2022] DELETE /identity/v3/projects/230ca9aa1ef0417dabde3404273597a6 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:24:15.361687 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70de1e-3c36-4b1d-a9c3-d95ee39e5d13 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:15.362107 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70de1e-3c36-4b1d-a9c3-d95ee39e5d13 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:15.362483 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70de1e-3c36-4b1d-a9c3-d95ee39e5d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:15.382147 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-5e70de1e-3c36-4b1d-a9c3-d95ee39e5d13 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:24:15.383299 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-5e70de1e-3c36-4b1d-a9c3-d95ee39e5d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:15.435853 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1170/2332] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:24:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:24:15.444290 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d271b-0d14-47d7-88a2-81d58b87fca3 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:15.444581 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d271b-0d14-47d7-88a2-81d58b87fca3 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:15.445071 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d271b-0d14-47d7-88a2-81d58b87fca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:15.456207 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1163/2333] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:24:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:24:15.465305 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd75be3-bd7a-4f6a-94d9-25bc5b0ad919 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:15.465840 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd75be3-bd7a-4f6a-94d9-25bc5b0ad919 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:15.466651 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd75be3-bd7a-4f6a-94d9-25bc5b0ad919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:15.467888 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-cd0d271b-0d14-47d7-88a2-81d58b87fca3 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:24:15.469139 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-cd0d271b-0d14-47d7-88a2-81d58b87fca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:15.481830 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1171/2334] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:24:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:24:15.485978 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d271b-0d14-47d7-88a2-81d58b87fca3 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:15.496271 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-dbd75be3-bd7a-4f6a-94d9-25bc5b0ad919 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:24:15.497488 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d271b-0d14-47d7-88a2-81d58b87fca3 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:15.497608 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-dbd75be3-bd7a-4f6a-94d9-25bc5b0ad919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:15.505554 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491af54b-bb69-4e49-9216-b1457214cb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:15.508982 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1164/2335] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:24:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:24:15.509133 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491af54b-bb69-4e49-9216-b1457214cb92 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:15.509133 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491af54b-bb69-4e49-9216-b1457214cb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:15.509133 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491af54b-bb69-4e49-9216-b1457214cb92 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:15.509133 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491af54b-bb69-4e49-9216-b1457214cb92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:24:15.509133 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491af54b-bb69-4e49-9216-b1457214cb92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:15.509733 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491af54b-bb69-4e49-9216-b1457214cb92 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:15.510887 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd75be3-bd7a-4f6a-94d9-25bc5b0ad919 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:15.521805 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd75be3-bd7a-4f6a-94d9-25bc5b0ad919 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:15.532101 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba7a2bc-83c8-41d6-92cd-c6a6d75f4d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:15.532384 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1172/2336] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:24:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:24:15.532561 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7a2bc-83c8-41d6-92cd-c6a6d75f4d4d admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:15.532561 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7a2bc-83c8-41d6-92cd-c6a6d75f4d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:15.532561 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7a2bc-83c8-41d6-92cd-c6a6d75f4d4d admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:15.532561 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba7a2bc-83c8-41d6-92cd-c6a6d75f4d4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:24:15.532561 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba7a2bc-83c8-41d6-92cd-c6a6d75f4d4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:15.532561 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba7a2bc-83c8-41d6-92cd-c6a6d75f4d4d admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:15.533294 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491af54b-bb69-4e49-9216-b1457214cb92 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:15.545462 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491af54b-bb69-4e49-9216-b1457214cb92 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:15.547695 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1165/2337] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:24:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:24:15.551101 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31665176-3e6e-4c9e-bbc9-7baa5b4af00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:15.552003 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31665176-3e6e-4c9e-bbc9-7baa5b4af00b admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:15.552265 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba7a2bc-83c8-41d6-92cd-c6a6d75f4d4d admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:15.552379 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31665176-3e6e-4c9e-bbc9-7baa5b4af00b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:15.552818 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31665176-3e6e-4c9e-bbc9-7baa5b4af00b admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:15.553290 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31665176-3e6e-4c9e-bbc9-7baa5b4af00b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:15.555584 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31665176-3e6e-4c9e-bbc9-7baa5b4af00b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:15.564127 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba7a2bc-83c8-41d6-92cd-c6a6d75f4d4d admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:15.569398 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9fe5fa-2692-44a8-949f-b1618e3eabe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:15.570113 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9fe5fa-2692-44a8-949f-b1618e3eabe4 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:15.570398 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9fe5fa-2692-44a8-949f-b1618e3eabe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:15.570671 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9fe5fa-2692-44a8-949f-b1618e3eabe4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:15.571366 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9fe5fa-2692-44a8-949f-b1618e3eabe4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:15.573814 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9fe5fa-2692-44a8-949f-b1618e3eabe4 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:15.588172 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1173/2338] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:24:15 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:24:15.589512 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31665176-3e6e-4c9e-bbc9-7baa5b4af00b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:15.604018 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1166/2339] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:24:15 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:24:15.608817 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9fe5fa-2692-44a8-949f-b1618e3eabe4 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:15.636941 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:24:15.643198 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:24:15.669231 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31665176-3e6e-4c9e-bbc9-7baa5b4af00b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:15.689236 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9fe5fa-2692-44a8-949f-b1618e3eabe4 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:15.694660 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd4ace0-5b77-440b-b36b-ebd8cdad9614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:15.695334 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4ace0-5b77-440b-b36b-ebd8cdad9614 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:15.695617 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4ace0-5b77-440b-b36b-ebd8cdad9614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:15.695892 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4ace0-5b77-440b-b36b-ebd8cdad9614 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:15.696601 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd4ace0-5b77-440b-b36b-ebd8cdad9614 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:15.698763 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd4ace0-5b77-440b-b36b-ebd8cdad9614 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:15.719583 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1167/2340] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:24:15 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:24:15.723734 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd4ace0-5b77-440b-b36b-ebd8cdad9614 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:15.735364 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd4ace0-5b77-440b-b36b-ebd8cdad9614 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:15.737963 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d08e1a-7306-438c-82cd-e4dd7a635883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:15.738650 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d08e1a-7306-438c-82cd-e4dd7a635883 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:15.738934 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d08e1a-7306-438c-82cd-e4dd7a635883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:15.739208 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d08e1a-7306-438c-82cd-e4dd7a635883 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:15.739911 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d08e1a-7306-438c-82cd-e4dd7a635883 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:15.740428 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc351a9-927a-47ea-84aa-6f595fc9a34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:15.741088 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc351a9-927a-47ea-84aa-6f595fc9a34b admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:15.741395 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc351a9-927a-47ea-84aa-6f595fc9a34b admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:15.741670 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc351a9-927a-47ea-84aa-6f595fc9a34b admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:15.741889 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d08e1a-7306-438c-82cd-e4dd7a635883 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:15.742498 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc351a9-927a-47ea-84aa-6f595fc9a34b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:15.744080 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc351a9-927a-47ea-84aa-6f595fc9a34b admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:15.754972 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1168/2341] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:24:15.760857 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc351a9-927a-47ea-84aa-6f595fc9a34b admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:15.764525 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1174/2342] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:24:15 2022] POST /identity/v3/users => generated 292 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:24:15.768679 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d08e1a-7306-438c-82cd-e4dd7a635883 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:15.771864 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc351a9-927a-47ea-84aa-6f595fc9a34b admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:15.778909 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92211a9d-eaf6-498c-a661-cb34f5b6988e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:15.779575 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92211a9d-eaf6-498c-a661-cb34f5b6988e admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:15.779882 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92211a9d-eaf6-498c-a661-cb34f5b6988e admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:15.780199 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92211a9d-eaf6-498c-a661-cb34f5b6988e admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:15.780844 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d08e1a-7306-438c-82cd-e4dd7a635883 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:15.781052 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92211a9d-eaf6-498c-a661-cb34f5b6988e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:15.782602 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92211a9d-eaf6-498c-a661-cb34f5b6988e admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:15.788220 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3abe2b-efbb-44a6-98c1-718830f9fff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:15.788972 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3abe2b-efbb-44a6-98c1-718830f9fff9 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:15.789259 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3abe2b-efbb-44a6-98c1-718830f9fff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:15.789540 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3abe2b-efbb-44a6-98c1-718830f9fff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:15.790314 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3abe2b-efbb-44a6-98c1-718830f9fff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:15.792000 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3abe2b-efbb-44a6-98c1-718830f9fff9 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:15.796930 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1169/2343] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:24:15.797984 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92211a9d-eaf6-498c-a661-cb34f5b6988e admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:15.806473 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1175/2344] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:24:15.807804 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3abe2b-efbb-44a6-98c1-718830f9fff9 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:15.808973 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92211a9d-eaf6-498c-a661-cb34f5b6988e admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:15.814436 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af27f7ff-cdb8-4b66-9303-67f2963d5611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:15.815399 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27f7ff-cdb8-4b66-9303-67f2963d5611 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:15.815748 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27f7ff-cdb8-4b66-9303-67f2963d5611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:15.815985 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27f7ff-cdb8-4b66-9303-67f2963d5611 admin admin] PATH_INFO: `/v3/projects/72b51253335448f69fd006153a89b7a2/users/1a23373205cb4c50accf1acfb3500dd7/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:15.821632 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3abe2b-efbb-44a6-98c1-718830f9fff9 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:15.827256 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f863eb-e428-4b74-8a6f-473f18bbfecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:15.827931 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f863eb-e428-4b74-8a6f-473f18bbfecf admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:15.828189 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f863eb-e428-4b74-8a6f-473f18bbfecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:15.828461 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f863eb-e428-4b74-8a6f-473f18bbfecf admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:15.829617 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f863eb-e428-4b74-8a6f-473f18bbfecf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:15.830837 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f863eb-e428-4b74-8a6f-473f18bbfecf admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:15.832475 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af27f7ff-cdb8-4b66-9303-67f2963d5611 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72b51253335448f69fd006153a89b7a2, user_id=1a23373205cb4c50accf1acfb3500dd7, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:15.835522 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af27f7ff-cdb8-4b66-9303-67f2963d5611 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:15.851035 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1176/2345] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:24:15.856097 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f863eb-e428-4b74-8a6f-473f18bbfecf admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:15.858398 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1170/2346] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:24:15 2022] PUT /identity/v3/projects/72b51253335448f69fd006153a89b7a2/users/1a23373205cb4c50accf1acfb3500dd7/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:24:15.868521 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85167d4-0d18-4afd-a1ac-2e0d5b540519 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:15.868876 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85167d4-0d18-4afd-a1ac-2e0d5b540519 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:15.869129 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85167d4-0d18-4afd-a1ac-2e0d5b540519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:15.872247 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f863eb-e428-4b74-8a6f-473f18bbfecf admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:15.895843 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-d85167d4-0d18-4afd-a1ac-2e0d5b540519 None None] MFA Rules not processed for user `1a23373205cb4c50accf1acfb3500dd7`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:24:15.897069 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-d85167d4-0d18-4afd-a1ac-2e0d5b540519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:15.930506 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e9164-52cb-4449-8991-f4533e15e5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:15.931439 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e9164-52cb-4449-8991-f4533e15e5d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:15.931718 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e9164-52cb-4449-8991-f4533e15e5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:15.932019 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e9164-52cb-4449-8991-f4533e15e5d9 admin admin] PATH_INFO: `/v3/projects/d2125736c1ea413da2c35a22eea2ef1f/users/27b2c14eadc445d3997e4a240756dc5c/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:15.948753 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e9164-52cb-4449-8991-f4533e15e5d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2125736c1ea413da2c35a22eea2ef1f, user_id=27b2c14eadc445d3997e4a240756dc5c, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:15.951658 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e9164-52cb-4449-8991-f4533e15e5d9 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:15.967010 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1177/2347] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:24:15 2022] PUT /identity/v3/projects/d2125736c1ea413da2c35a22eea2ef1f/users/27b2c14eadc445d3997e4a240756dc5c/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:24:15.976463 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1171/2348] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:24:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:24:15.976608 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e9164-52cb-4449-8991-f4533e15e5d9 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:15.977777 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21b88b-dd5c-4cc5-805a-ed535a959edf None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:15.978066 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21b88b-dd5c-4cc5-805a-ed535a959edf None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:15.978338 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21b88b-dd5c-4cc5-805a-ed535a959edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:16.005976 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-ae21b88b-dd5c-4cc5-805a-ed535a959edf None None] MFA Rules not processed for user `27b2c14eadc445d3997e4a240756dc5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:24:16.007336 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ae21b88b-dd5c-4cc5-805a-ed535a959edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:16.016951 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:24:16.038400 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e9164-52cb-4449-8991-f4533e15e5d9 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:16.043706 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5000634f-28e1-4acc-beee-ca36306da71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:16.044406 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000634f-28e1-4acc-beee-ca36306da71d admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:16.044658 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000634f-28e1-4acc-beee-ca36306da71d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:16.044929 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000634f-28e1-4acc-beee-ca36306da71d admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:16.045629 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5000634f-28e1-4acc-beee-ca36306da71d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:16.047597 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5000634f-28e1-4acc-beee-ca36306da71d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:16.053719 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:24:16.084932 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1178/2349] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:24:15 2022] POST /identity/v3/projects => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:24:16.087634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1172/2350] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:24:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:24:16.089198 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5000634f-28e1-4acc-beee-ca36306da71d admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:16.100796 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21b88b-dd5c-4cc5-805a-ed535a959edf None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:16.102219 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ae21b88b-dd5c-4cc5-805a-ed535a959edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:16.182759 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21b88b-dd5c-4cc5-805a-ed535a959edf None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:16.184393 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5000634f-28e1-4acc-beee-ca36306da71d admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:16.214411 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf33d41-d0c2-45de-93fa-a4556ba52a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:16.215206 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf33d41-d0c2-45de-93fa-a4556ba52a29 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:16.215488 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf33d41-d0c2-45de-93fa-a4556ba52a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:16.215904 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf33d41-d0c2-45de-93fa-a4556ba52a29 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:16.216803 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf33d41-d0c2-45de-93fa-a4556ba52a29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:16.218868 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf33d41-d0c2-45de-93fa-a4556ba52a29 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:16.241259 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1179/2351] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:24:16 2022] POST /identity/v3/users => generated 292 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:24:16.247922 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf33d41-d0c2-45de-93fa-a4556ba52a29 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:16.258482 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf33d41-d0c2-45de-93fa-a4556ba52a29 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:16.264456 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10a2e2-e4ae-4433-945f-f2d288431a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:16.265171 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10a2e2-e4ae-4433-945f-f2d288431a58 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:16.265412 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10a2e2-e4ae-4433-945f-f2d288431a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:16.265685 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10a2e2-e4ae-4433-945f-f2d288431a58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:16.267087 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c10a2e2-e4ae-4433-945f-f2d288431a58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:16.268700 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c10a2e2-e4ae-4433-945f-f2d288431a58 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:16.274528 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b5ba0d-38cc-43b4-9aa6-552f311d2aaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:16.275653 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5ba0d-38cc-43b4-9aa6-552f311d2aaf service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:16.276066 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5ba0d-38cc-43b4-9aa6-552f311d2aaf service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:16.276401 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5ba0d-38cc-43b4-9aa6-552f311d2aaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:16.280731 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1180/2352] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:24:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:24:16.285306 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10a2e2-e4ae-4433-945f-f2d288431a58 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:16.298245 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10a2e2-e4ae-4433-945f-f2d288431a58 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:16.303189 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc5b43-1f55-4584-a522-3c418d03c3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:16.303854 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc5b43-1f55-4584-a522-3c418d03c3e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:16.304134 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc5b43-1f55-4584-a522-3c418d03c3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:16.304406 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc5b43-1f55-4584-a522-3c418d03c3e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:16.305135 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afc5b43-1f55-4584-a522-3c418d03c3e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:16.306779 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afc5b43-1f55-4584-a522-3c418d03c3e9 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:16.318225 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1181/2353] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:24:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:24:16.322341 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc5b43-1f55-4584-a522-3c418d03c3e9 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:16.333368 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc5b43-1f55-4584-a522-3c418d03c3e9 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:16.338766 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c9961-3848-4ea0-b4f9-62e45b6d8060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:16.340551 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c9961-3848-4ea0-b4f9-62e45b6d8060 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:16.340989 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c9961-3848-4ea0-b4f9-62e45b6d8060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:16.341354 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c9961-3848-4ea0-b4f9-62e45b6d8060 admin admin] PATH_INFO: `/v3/projects/a9b60a831a3840d8ae58174cefa5083f/users/f6911cb0e1eb44c9997d11cb97c7a743/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:16.341615 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b5ba0d-38cc-43b4-9aa6-552f311d2aaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:16.343121 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b5ba0d-38cc-43b4-9aa6-552f311d2aaf service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:16.352675 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1173/2354] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:24:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:24:16.359208 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1c9961-3848-4ea0-b4f9-62e45b6d8060 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9b60a831a3840d8ae58174cefa5083f, user_id=f6911cb0e1eb44c9997d11cb97c7a743, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:16.361899 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1c9961-3848-4ea0-b4f9-62e45b6d8060 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:16.377548 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1182/2355] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:24:16 2022] PUT /identity/v3/projects/a9b60a831a3840d8ae58174cefa5083f/users/f6911cb0e1eb44c9997d11cb97c7a743/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:24:16.449785 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ca3dd-58c0-40ad-ba1c-eb69e01b097f None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:16.450072 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ca3dd-58c0-40ad-ba1c-eb69e01b097f None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:16.450351 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ca3dd-58c0-40ad-ba1c-eb69e01b097f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:16.482631 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-7b2ca3dd-58c0-40ad-ba1c-eb69e01b097f None None] MFA Rules not processed for user `f6911cb0e1eb44c9997d11cb97c7a743`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:24:16.483876 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-7b2ca3dd-58c0-40ad-ba1c-eb69e01b097f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:16.537682 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:24:16.565953 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1174/2356] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:24:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:24:16.571936 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c9961-3848-4ea0-b4f9-62e45b6d8060 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:16.674332 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c9961-3848-4ea0-b4f9-62e45b6d8060 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:16.681424 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a4449a-4ba2-4010-8b0c-f2bb96e03bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:16.682461 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4449a-4ba2-4010-8b0c-f2bb96e03bc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:16.682749 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4449a-4ba2-4010-8b0c-f2bb96e03bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:16.683220 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4449a-4ba2-4010-8b0c-f2bb96e03bc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:16.684305 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a4449a-4ba2-4010-8b0c-f2bb96e03bc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:16.686868 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a4449a-4ba2-4010-8b0c-f2bb96e03bc5 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:16.703523 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:24:16.723399 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1183/2357] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:24:16 2022] POST /identity/v3/projects => generated 383 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:24:16.730744 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2ca3dd-58c0-40ad-ba1c-eb69e01b097f None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:16.744328 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2ca3dd-58c0-40ad-ba1c-eb69e01b097f None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:16.845003 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717cd28-4df1-4c21-88ea-fbb63691fa5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:16.846198 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717cd28-4df1-4c21-88ea-fbb63691fa5f admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:16.846565 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717cd28-4df1-4c21-88ea-fbb63691fa5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:16.847027 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717cd28-4df1-4c21-88ea-fbb63691fa5f admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:16.848248 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4717cd28-4df1-4c21-88ea-fbb63691fa5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:16.851795 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4717cd28-4df1-4c21-88ea-fbb63691fa5f admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:16.878891 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1175/2358] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:24:16 2022] POST /identity/v3/users => generated 298 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:24:16.884153 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a4449a-4ba2-4010-8b0c-f2bb96e03bc5 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:16.897532 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a4449a-4ba2-4010-8b0c-f2bb96e03bc5 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:16.904529 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47373125-53bd-48b6-aefe-ed24bc3e60cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:16.905266 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47373125-53bd-48b6-aefe-ed24bc3e60cd admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:16.905547 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47373125-53bd-48b6-aefe-ed24bc3e60cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:16.905853 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47373125-53bd-48b6-aefe-ed24bc3e60cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:16.906610 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47373125-53bd-48b6-aefe-ed24bc3e60cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:16.908758 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47373125-53bd-48b6-aefe-ed24bc3e60cd admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:16.923755 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1184/2359] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:24:16 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:24:16.928250 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717cd28-4df1-4c21-88ea-fbb63691fa5f admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:16.940338 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717cd28-4df1-4c21-88ea-fbb63691fa5f admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:16.949077 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8752797-9e3e-44a0-a20e-9358228006fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:16.950306 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8752797-9e3e-44a0-a20e-9358228006fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:16.950653 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8752797-9e3e-44a0-a20e-9358228006fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:16.950873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8752797-9e3e-44a0-a20e-9358228006fc admin admin] PATH_INFO: `/v3/projects/c7dd793bcc814196b028a5def1027630/users/3c2ce533794548058302012e9fe1d01d/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:16.968342 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8752797-9e3e-44a0-a20e-9358228006fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7dd793bcc814196b028a5def1027630, user_id=3c2ce533794548058302012e9fe1d01d, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:16.971089 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8752797-9e3e-44a0-a20e-9358228006fc admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:16.988615 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1176/2360] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:24:16 2022] PUT /identity/v3/projects/c7dd793bcc814196b028a5def1027630/users/3c2ce533794548058302012e9fe1d01d/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:24:16.993884 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47373125-53bd-48b6-aefe-ed24bc3e60cd admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:17.005110 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47373125-53bd-48b6-aefe-ed24bc3e60cd admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:17.080032 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d876ec9a-8469-4999-8409-82f3f4100b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:17.080704 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876ec9a-8469-4999-8409-82f3f4100b57 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:17.080979 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876ec9a-8469-4999-8409-82f3f4100b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:17.081248 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876ec9a-8469-4999-8409-82f3f4100b57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:17.082004 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d876ec9a-8469-4999-8409-82f3f4100b57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:17.083608 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d876ec9a-8469-4999-8409-82f3f4100b57 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:17.094470 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1185/2361] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:24:16 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:24:17.099988 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8752797-9e3e-44a0-a20e-9358228006fc admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:17.111690 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8752797-9e3e-44a0-a20e-9358228006fc admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:17.116715 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa665c87-295f-487c-a7cb-c6d466abe539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:17.117611 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa665c87-295f-487c-a7cb-c6d466abe539 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:17.117924 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa665c87-295f-487c-a7cb-c6d466abe539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:17.118202 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa665c87-295f-487c-a7cb-c6d466abe539 admin admin] PATH_INFO: `/v3/projects/c7dd793bcc814196b028a5def1027630/users/3c2ce533794548058302012e9fe1d01d/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:17.120676 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa665c87-295f-487c-a7cb-c6d466abe539 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7dd793bcc814196b028a5def1027630, user_id=3c2ce533794548058302012e9fe1d01d, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:17.123366 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa665c87-295f-487c-a7cb-c6d466abe539 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:17.137376 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1177/2362] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:24:17 2022] PUT /identity/v3/projects/c7dd793bcc814196b028a5def1027630/users/3c2ce533794548058302012e9fe1d01d/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:24:17.149643 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c0c7f-9001-4d50-bd97-3620e41ed34d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:17.150067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c0c7f-9001-4d50-bd97-3620e41ed34d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:17.150381 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c0c7f-9001-4d50-bd97-3620e41ed34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:17.180189 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-347c0c7f-9001-4d50-bd97-3620e41ed34d None None] MFA Rules not processed for user `3c2ce533794548058302012e9fe1d01d`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:24:17.181434 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-347c0c7f-9001-4d50-bd97-3620e41ed34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:17.283816 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1186/2363] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:24:17 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:24:17.295707 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa665c87-295f-487c-a7cb-c6d466abe539 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:17.367867 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa665c87-295f-487c-a7cb-c6d466abe539 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:17.375639 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650f3df-3c1b-4ec1-92c3-4de3a4c45384 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:17.375639 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650f3df-3c1b-4ec1-92c3-4de3a4c45384 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:17.375639 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650f3df-3c1b-4ec1-92c3-4de3a4c45384 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:17.375639 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650f3df-3c1b-4ec1-92c3-4de3a4c45384 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:17.429959 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:24:17.444236 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1650f3df-3c1b-4ec1-92c3-4de3a4c45384 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:17.445988 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1650f3df-3c1b-4ec1-92c3-4de3a4c45384 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:17.465871 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1178/2364] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:24:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:24:18.368568 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848fc587-c4e2-4b5a-be01-8104ab2d391c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:18.368568 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848fc587-c4e2-4b5a-be01-8104ab2d391c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:18.372081 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848fc587-c4e2-4b5a-be01-8104ab2d391c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:18.389553 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-848fc587-c4e2-4b5a-be01-8104ab2d391c None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:24:18.390828 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-848fc587-c4e2-4b5a-be01-8104ab2d391c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:18.453621 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1187/2365] 10.222.0.58 () {58 vars in 1016 bytes} [Wed Jun 29 12:24:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:24:18.471922 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650f3df-3c1b-4ec1-92c3-4de3a4c45384 service cinder] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:18.473475 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-1650f3df-3c1b-4ec1-92c3-4de3a4c45384 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:18.557422 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650f3df-3c1b-4ec1-92c3-4de3a4c45384 service cinder] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:18.564239 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a16635-3734-4cae-be30-9ff724c7c234 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7adaa2ef440941aa8214f2b2fd49b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:18.564893 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a16635-3734-4cae-be30-9ff724c7c234 service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:18.565174 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a16635-3734-4cae-be30-9ff724c7c234 service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:18.565444 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a16635-3734-4cae-be30-9ff724c7c234 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:18.575402 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a16635-3734-4cae-be30-9ff724c7c234 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:18.577016 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a16635-3734-4cae-be30-9ff724c7c234 service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:18.587383 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1179/2366] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:24:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:24:18.984234 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848fc587-c4e2-4b5a-be01-8104ab2d391c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:18.991096 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:24:18.992174 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a16635-3734-4cae-be30-9ff724c7c234 service nova] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:18.995512 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848fc587-c4e2-4b5a-be01-8104ab2d391c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:19.002280 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320ce67b-2486-4c2a-a3bd-3f76c1104266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:19.002719 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a16635-3734-4cae-be30-9ff724c7c234 service nova] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:19.003140 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ce67b-2486-4c2a-a3bd-3f76c1104266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:19.003530 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ce67b-2486-4c2a-a3bd-3f76c1104266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:19.003904 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ce67b-2486-4c2a-a3bd-3f76c1104266 admin admin] PATH_INFO: `/v3/users/27b2c14eadc445d3997e4a240756dc5c` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:19.005177 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320ce67b-2486-4c2a-a3bd-3f76c1104266 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27b2c14eadc445d3997e4a240756dc5c)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:19.006364 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af9731-7bb9-4a48-a01d-80eb3336dc6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:19.007000 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af9731-7bb9-4a48-a01d-80eb3336dc6f service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:19.007158 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320ce67b-2486-4c2a-a3bd-3f76c1104266 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:19.007278 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af9731-7bb9-4a48-a01d-80eb3336dc6f service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:19.007575 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af9731-7bb9-4a48-a01d-80eb3336dc6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:19.063863 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-320ce67b-2486-4c2a-a3bd-3f76c1104266 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27b2c14eadc445d3997e4a240756dc5c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:19.064677 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-320ce67b-2486-4c2a-a3bd-3f76c1104266 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27b2c14eadc445d3997e4a240756dc5c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:19.065120 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-320ce67b-2486-4c2a-a3bd-3f76c1104266 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27b2c14eadc445d3997e4a240756dc5c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:19.074158 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af9731-7bb9-4a48-a01d-80eb3336dc6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:19.075992 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af9731-7bb9-4a48-a01d-80eb3336dc6f service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:19.078729 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-320ce67b-2486-4c2a-a3bd-3f76c1104266 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27b2c14eadc445d3997e4a240756dc5c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:19.085549 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1180/2367] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:24:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:24:19.086189 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-320ce67b-2486-4c2a-a3bd-3f76c1104266 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27b2c14eadc445d3997e4a240756dc5c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:19.099811 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1188/2368] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:24:18 2022] DELETE /identity/v3/users/27b2c14eadc445d3997e4a240756dc5c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:24:19.105483 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d90800-7436-4b7b-925b-da941a4bb814 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:19.105887 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d90800-7436-4b7b-925b-da941a4bb814 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:19.106158 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d90800-7436-4b7b-925b-da941a4bb814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:19.123853 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-18d90800-7436-4b7b-925b-da941a4bb814 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:24:19.125076 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-18d90800-7436-4b7b-925b-da941a4bb814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:19.202884 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1181/2369] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:24:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:24:19.213845 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320ce67b-2486-4c2a-a3bd-3f76c1104266 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:19.217000 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-320ce67b-2486-4c2a-a3bd-3f76c1104266 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:19.295052 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320ce67b-2486-4c2a-a3bd-3f76c1104266 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:19.298757 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c23311-1d29-4915-aff5-651a659dd7dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:19.299449 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c23311-1d29-4915-aff5-651a659dd7dd service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:19.299662 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c23311-1d29-4915-aff5-651a659dd7dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:19.299967 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c23311-1d29-4915-aff5-651a659dd7dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:19.310697 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c23311-1d29-4915-aff5-651a659dd7dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:19.312145 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c23311-1d29-4915-aff5-651a659dd7dd service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:19.322019 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1189/2370] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:24:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:24:19.607703 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d90800-7436-4b7b-925b-da941a4bb814 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:19.610053 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-18d90800-7436-4b7b-925b-da941a4bb814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:19.623841 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d90800-7436-4b7b-925b-da941a4bb814 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:19.630772 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eaa83e-b70c-4fa8-b4ed-9f6df9fc90cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:19.631852 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eaa83e-b70c-4fa8-b4ed-9f6df9fc90cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:19.632135 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eaa83e-b70c-4fa8-b4ed-9f6df9fc90cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:19.632410 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eaa83e-b70c-4fa8-b4ed-9f6df9fc90cc admin admin] PATH_INFO: `/v3/projects/d2125736c1ea413da2c35a22eea2ef1f` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:19.634080 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eaa83e-b70c-4fa8-b4ed-9f6df9fc90cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2125736c1ea413da2c35a22eea2ef1f)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:19.636296 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eaa83e-b70c-4fa8-b4ed-9f6df9fc90cc admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:19.645105 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:24:19.694658 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c23311-1d29-4915-aff5-651a659dd7dd service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:19.696095 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-16c23311-1d29-4915-aff5-651a659dd7dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:19.700281 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f2eaa83e-b70c-4fa8-b4ed-9f6df9fc90cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2125736c1ea413da2c35a22eea2ef1f', 'request_id': 'req-f2eaa83e-b70c-4fa8-b4ed-9f6df9fc90cc'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:19.707138 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f2eaa83e-b70c-4fa8-b4ed-9f6df9fc90cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2125736c1ea413da2c35a22eea2ef1f', 'request_id': 'req-f2eaa83e-b70c-4fa8-b4ed-9f6df9fc90cc'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:19.716715 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f2eaa83e-b70c-4fa8-b4ed-9f6df9fc90cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2125736c1ea413da2c35a22eea2ef1f', 'request_id': 'req-f2eaa83e-b70c-4fa8-b4ed-9f6df9fc90cc'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:19.737549 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f2eaa83e-b70c-4fa8-b4ed-9f6df9fc90cc admin admin] The token cache is being invalidate because project d2125736c1ea413da2c35a22eea2ef1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:24:19.737834 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f2eaa83e-b70c-4fa8-b4ed-9f6df9fc90cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:19.738696 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f2eaa83e-b70c-4fa8-b4ed-9f6df9fc90cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:19.740610 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1182/2371] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:24:19 2022] DELETE /identity/v3/projects/d2125736c1ea413da2c35a22eea2ef1f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:24:19.745718 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295bf68-b69f-41d2-a91c-45e1b1c16eb7 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:19.745999 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295bf68-b69f-41d2-a91c-45e1b1c16eb7 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:19.746276 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295bf68-b69f-41d2-a91c-45e1b1c16eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:19.772142 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-c295bf68-b69f-41d2-a91c-45e1b1c16eb7 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:24:19.773409 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-c295bf68-b69f-41d2-a91c-45e1b1c16eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:19.790051 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c23311-1d29-4915-aff5-651a659dd7dd service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:19.824763 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:24:19.844960 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25fbbe3-7426-418a-82b6-2cef4f49497c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:19.845801 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25fbbe3-7426-418a-82b6-2cef4f49497c service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:19.846147 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25fbbe3-7426-418a-82b6-2cef4f49497c service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:19.846490 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25fbbe3-7426-418a-82b6-2cef4f49497c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:19.848347 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a25fbbe3-7426-418a-82b6-2cef4f49497c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:19.892044 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1183/2372] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:24:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:24:19.898376 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7216be1-1513-441e-9d17-43d27312640f None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:19.898826 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7216be1-1513-441e-9d17-43d27312640f None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:19.899141 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7216be1-1513-441e-9d17-43d27312640f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:19.919480 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-d7216be1-1513-441e-9d17-43d27312640f None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:24:19.920159 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25fbbe3-7426-418a-82b6-2cef4f49497c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:19.920717 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-d7216be1-1513-441e-9d17-43d27312640f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:19.921915 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25fbbe3-7426-418a-82b6-2cef4f49497c service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:19.933335 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1184/2373] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:24:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:24:19.933489 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1190/2374] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:24:19 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:24:19.934189 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7216be1-1513-441e-9d17-43d27312640f None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:19.944890 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7216be1-1513-441e-9d17-43d27312640f None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:19.951373 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a486d0-aa28-4594-a0fe-6c089439040d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:19.952155 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a486d0-aa28-4594-a0fe-6c089439040d admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:19.952513 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a486d0-aa28-4594-a0fe-6c089439040d admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:19.952949 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a486d0-aa28-4594-a0fe-6c089439040d admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:19.953789 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a486d0-aa28-4594-a0fe-6c089439040d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:24:19.954176 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a486d0-aa28-4594-a0fe-6c089439040d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:19.956021 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a486d0-aa28-4594-a0fe-6c089439040d admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:19.972570 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1185/2375] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:24:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:24:19.973826 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25fbbe3-7426-418a-82b6-2cef4f49497c service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:19.991287 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25fbbe3-7426-418a-82b6-2cef4f49497c service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:19.996803 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a55493-23f7-48c6-8c88-4d905892c7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:19.997486 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a55493-23f7-48c6-8c88-4d905892c7e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:19.997813 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a55493-23f7-48c6-8c88-4d905892c7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:19.998092 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a55493-23f7-48c6-8c88-4d905892c7e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:19.998795 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a55493-23f7-48c6-8c88-4d905892c7e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:20.000761 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a55493-23f7-48c6-8c88-4d905892c7e9 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:20.036441 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1191/2376] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:24:19 2022] POST /identity/v3/projects => generated 371 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:24:20.041534 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a486d0-aa28-4594-a0fe-6c089439040d admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:20.060988 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a486d0-aa28-4594-a0fe-6c089439040d admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:20.127378 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292bb54b-79b2-44db-b0dd-dc09c50f44f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:20.128172 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292bb54b-79b2-44db-b0dd-dc09c50f44f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:20.129548 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292bb54b-79b2-44db-b0dd-dc09c50f44f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:20.129548 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292bb54b-79b2-44db-b0dd-dc09c50f44f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:20.129548 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292bb54b-79b2-44db-b0dd-dc09c50f44f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:20.131826 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292bb54b-79b2-44db-b0dd-dc09c50f44f6 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:20.158674 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1186/2377] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:24:20 2022] POST /identity/v3/users => generated 286 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:24:20.163029 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a55493-23f7-48c6-8c88-4d905892c7e9 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:20.174789 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a55493-23f7-48c6-8c88-4d905892c7e9 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:20.179707 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e76d78-c06e-4fd3-87fd-9be4a09b203c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:20.180435 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e76d78-c06e-4fd3-87fd-9be4a09b203c admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:20.180714 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e76d78-c06e-4fd3-87fd-9be4a09b203c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:20.180981 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e76d78-c06e-4fd3-87fd-9be4a09b203c admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:20.181794 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e76d78-c06e-4fd3-87fd-9be4a09b203c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:20.183491 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e76d78-c06e-4fd3-87fd-9be4a09b203c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:20.196512 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1192/2378] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:24:20.201724 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292bb54b-79b2-44db-b0dd-dc09c50f44f6 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:20.212861 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292bb54b-79b2-44db-b0dd-dc09c50f44f6 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:20.217600 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21f881-63f8-4af3-9b2f-d103d0b74ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:20.218290 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21f881-63f8-4af3-9b2f-d103d0b74ddd admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:20.218572 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21f881-63f8-4af3-9b2f-d103d0b74ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:20.218839 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21f881-63f8-4af3-9b2f-d103d0b74ddd admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:20.219569 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee21f881-63f8-4af3-9b2f-d103d0b74ddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:20.221163 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee21f881-63f8-4af3-9b2f-d103d0b74ddd admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:20.222634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:24:20.244417 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1187/2379] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:24:20.248783 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e76d78-c06e-4fd3-87fd-9be4a09b203c admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:20.258969 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e76d78-c06e-4fd3-87fd-9be4a09b203c admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:20.264799 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f224d2-e28a-4d82-b5f6-1305bf32cea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:20.265687 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f224d2-e28a-4d82-b5f6-1305bf32cea0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:20.265991 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f224d2-e28a-4d82-b5f6-1305bf32cea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:20.266263 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f224d2-e28a-4d82-b5f6-1305bf32cea0 admin admin] PATH_INFO: `/v3/projects/271729ce407f443ba7cb6e73a8b2cd8d/users/b7d6b638f52942fb921b7adbf3ff0783/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:20.289736 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f224d2-e28a-4d82-b5f6-1305bf32cea0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=271729ce407f443ba7cb6e73a8b2cd8d, user_id=b7d6b638f52942fb921b7adbf3ff0783, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:20.293722 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f224d2-e28a-4d82-b5f6-1305bf32cea0 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:20.310804 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1193/2380] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:24:20 2022] PUT /identity/v3/projects/271729ce407f443ba7cb6e73a8b2cd8d/users/b7d6b638f52942fb921b7adbf3ff0783/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:24:20.322470 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea239fd5-cdc1-4a99-ae7a-b747e16f1448 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:20.322796 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea239fd5-cdc1-4a99-ae7a-b747e16f1448 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:20.323075 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea239fd5-cdc1-4a99-ae7a-b747e16f1448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:20.350607 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-ea239fd5-cdc1-4a99-ae7a-b747e16f1448 None None] MFA Rules not processed for user `b7d6b638f52942fb921b7adbf3ff0783`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:24:20.351816 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ea239fd5-cdc1-4a99-ae7a-b747e16f1448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:20.423941 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1188/2381] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:24:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:24:20.436045 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f224d2-e28a-4d82-b5f6-1305bf32cea0 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:20.437877 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-53f224d2-e28a-4d82-b5f6-1305bf32cea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:20.525083 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f224d2-e28a-4d82-b5f6-1305bf32cea0 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:20.529929 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f38785-d8d3-41ad-84d8-16a80dbf63ec service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd865d1b935a54ca2b44beda5b0277336', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:20.530587 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f38785-d8d3-41ad-84d8-16a80dbf63ec service glance] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:20.530871 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f38785-d8d3-41ad-84d8-16a80dbf63ec service glance] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:20.531147 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f38785-d8d3-41ad-84d8-16a80dbf63ec service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:20.540231 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f38785-d8d3-41ad-84d8-16a80dbf63ec service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:20.542095 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f38785-d8d3-41ad-84d8-16a80dbf63ec service glance] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:20.551549 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1194/2382] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:24:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:24:21.810576 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff522a9-716d-4af3-a8c6-20b2b137d4c0 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:21.811101 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff522a9-716d-4af3-a8c6-20b2b137d4c0 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:21.811205 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff522a9-716d-4af3-a8c6-20b2b137d4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:21.836823 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-8ff522a9-716d-4af3-a8c6-20b2b137d4c0 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:24:21.838262 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-8ff522a9-716d-4af3-a8c6-20b2b137d4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:21.920297 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1189/2383] 10.222.0.58 () {58 vars in 1016 bytes} [Wed Jun 29 12:24:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:24:21.945590 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f38785-d8d3-41ad-84d8-16a80dbf63ec service glance] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:21.947136 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-04f38785-d8d3-41ad-84d8-16a80dbf63ec service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:21.967782 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:24:22.084594 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f38785-d8d3-41ad-84d8-16a80dbf63ec service glance] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:22.091307 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ab969-5521-4f5c-9f1c-a525aa9cdf06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7adaa2ef440941aa8214f2b2fd49b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:22.092068 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ab969-5521-4f5c-9f1c-a525aa9cdf06 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:22.092450 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ab969-5521-4f5c-9f1c-a525aa9cdf06 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:22.092828 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ab969-5521-4f5c-9f1c-a525aa9cdf06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:22.102238 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77ab969-5521-4f5c-9f1c-a525aa9cdf06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:22.104241 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77ab969-5521-4f5c-9f1c-a525aa9cdf06 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:22.114914 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1195/2384] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:24:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:24:23.916771 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff522a9-716d-4af3-a8c6-20b2b137d4c0 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:23.918856 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-8ff522a9-716d-4af3-a8c6-20b2b137d4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:23.937862 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff522a9-716d-4af3-a8c6-20b2b137d4c0 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:23.944545 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ea78b-7d70-42fc-a109-91a61c1543e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:23.945911 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ea78b-7d70-42fc-a109-91a61c1543e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:23.946346 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ea78b-7d70-42fc-a109-91a61c1543e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:23.946753 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ea78b-7d70-42fc-a109-91a61c1543e7 admin admin] PATH_INFO: `/v3/users/1a23373205cb4c50accf1acfb3500dd7` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:23.949358 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ea78b-7d70-42fc-a109-91a61c1543e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a23373205cb4c50accf1acfb3500dd7)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:23.952891 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ea78b-7d70-42fc-a109-91a61c1543e7 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:24.013651 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-8e5ea78b-7d70-42fc-a109-91a61c1543e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a23373205cb4c50accf1acfb3500dd7'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:24.029680 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-8e5ea78b-7d70-42fc-a109-91a61c1543e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a23373205cb4c50accf1acfb3500dd7'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:24.038201 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-8e5ea78b-7d70-42fc-a109-91a61c1543e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a23373205cb4c50accf1acfb3500dd7'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:24.039037 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-8e5ea78b-7d70-42fc-a109-91a61c1543e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a23373205cb4c50accf1acfb3500dd7'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:24.049398 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-8e5ea78b-7d70-42fc-a109-91a61c1543e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a23373205cb4c50accf1acfb3500dd7'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:24.051551 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:24:24.061889 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1190/2385] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:24:23 2022] DELETE /identity/v3/users/1a23373205cb4c50accf1acfb3500dd7 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:24:24.066842 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859fbde-a25f-43eb-bac0-dc840e3d1cd0 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:24.068144 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859fbde-a25f-43eb-bac0-dc840e3d1cd0 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:24.068144 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859fbde-a25f-43eb-bac0-dc840e3d1cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:24.088586 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-d859fbde-a25f-43eb-bac0-dc840e3d1cd0 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:24:24.089935 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d859fbde-a25f-43eb-bac0-dc840e3d1cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:24.168724 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1196/2386] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:24:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:24:24.186027 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ea78b-7d70-42fc-a109-91a61c1543e7 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:24.187629 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-8e5ea78b-7d70-42fc-a109-91a61c1543e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:24.269004 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ea78b-7d70-42fc-a109-91a61c1543e7 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:24.272752 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94e1d5-ce35-419a-a478-3de9f2dc2f27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:24.273423 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94e1d5-ce35-419a-a478-3de9f2dc2f27 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:24.273705 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94e1d5-ce35-419a-a478-3de9f2dc2f27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:24.274014 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94e1d5-ce35-419a-a478-3de9f2dc2f27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:24.286006 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c94e1d5-ce35-419a-a478-3de9f2dc2f27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:24.287493 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c94e1d5-ce35-419a-a478-3de9f2dc2f27 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:24.297770 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1191/2387] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:24:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:24:24.683703 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d859fbde-a25f-43eb-bac0-dc840e3d1cd0 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:24.688052 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d859fbde-a25f-43eb-bac0-dc840e3d1cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:24.718368 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d859fbde-a25f-43eb-bac0-dc840e3d1cd0 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:24.723479 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18854cf6-cc01-485c-b24e-26f889aac213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:24.724470 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18854cf6-cc01-485c-b24e-26f889aac213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:24.724567 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18854cf6-cc01-485c-b24e-26f889aac213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:24.724827 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18854cf6-cc01-485c-b24e-26f889aac213 admin admin] PATH_INFO: `/v3/projects/72b51253335448f69fd006153a89b7a2` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:24.726222 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18854cf6-cc01-485c-b24e-26f889aac213 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72b51253335448f69fd006153a89b7a2)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:24.728125 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18854cf6-cc01-485c-b24e-26f889aac213 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:24.801534 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-18854cf6-cc01-485c-b24e-26f889aac213 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72b51253335448f69fd006153a89b7a2', 'request_id': 'req-18854cf6-cc01-485c-b24e-26f889aac213'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:24.811088 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-18854cf6-cc01-485c-b24e-26f889aac213 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72b51253335448f69fd006153a89b7a2', 'request_id': 'req-18854cf6-cc01-485c-b24e-26f889aac213'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:24.823262 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-18854cf6-cc01-485c-b24e-26f889aac213 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72b51253335448f69fd006153a89b7a2', 'request_id': 'req-18854cf6-cc01-485c-b24e-26f889aac213'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:24.847696 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-18854cf6-cc01-485c-b24e-26f889aac213 admin admin] The token cache is being invalidate because project 72b51253335448f69fd006153a89b7a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:24:24.847696 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-18854cf6-cc01-485c-b24e-26f889aac213 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:24.849673 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-18854cf6-cc01-485c-b24e-26f889aac213 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:24.850588 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1197/2388] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:24:24 2022] DELETE /identity/v3/projects/72b51253335448f69fd006153a89b7a2 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:24:24.855422 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94e1d5-ce35-419a-a478-3de9f2dc2f27 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:24.871276 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94e1d5-ce35-419a-a478-3de9f2dc2f27 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:24.962648 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a9e82-73bb-4541-b2c4-b129ff0b32ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:24.964159 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a9e82-73bb-4541-b2c4-b129ff0b32ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:24.964445 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a9e82-73bb-4541-b2c4-b129ff0b32ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:24.964733 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a9e82-73bb-4541-b2c4-b129ff0b32ae admin admin] PATH_INFO: `/v3/users/f6911cb0e1eb44c9997d11cb97c7a743` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:24.966033 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7a9e82-73bb-4541-b2c4-b129ff0b32ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6911cb0e1eb44c9997d11cb97c7a743)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:24.967992 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7a9e82-73bb-4541-b2c4-b129ff0b32ae admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:25.050948 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-be7a9e82-73bb-4541-b2c4-b129ff0b32ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6911cb0e1eb44c9997d11cb97c7a743'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:25.075806 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-be7a9e82-73bb-4541-b2c4-b129ff0b32ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6911cb0e1eb44c9997d11cb97c7a743'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:25.087841 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-be7a9e82-73bb-4541-b2c4-b129ff0b32ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6911cb0e1eb44c9997d11cb97c7a743'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:25.089451 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-be7a9e82-73bb-4541-b2c4-b129ff0b32ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6911cb0e1eb44c9997d11cb97c7a743'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:25.110433 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-be7a9e82-73bb-4541-b2c4-b129ff0b32ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6911cb0e1eb44c9997d11cb97c7a743'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:25.118385 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1192/2389] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:24:24 2022] DELETE /identity/v3/users/f6911cb0e1eb44c9997d11cb97c7a743 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:24:25.558258 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18854cf6-cc01-485c-b24e-26f889aac213 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:25.560218 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-18854cf6-cc01-485c-b24e-26f889aac213 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:25.584047 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18854cf6-cc01-485c-b24e-26f889aac213 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:25.609119 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:24:25.694934 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df3201b-459f-4ffc-9f66-366b33ce9aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:25.696604 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df3201b-459f-4ffc-9f66-366b33ce9aba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:25.699335 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df3201b-459f-4ffc-9f66-366b33ce9aba admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:25.700737 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df3201b-459f-4ffc-9f66-366b33ce9aba admin admin] PATH_INFO: `/v3/projects/a9b60a831a3840d8ae58174cefa5083f` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:25.704479 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df3201b-459f-4ffc-9f66-366b33ce9aba admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9b60a831a3840d8ae58174cefa5083f)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:25.714291 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df3201b-459f-4ffc-9f66-366b33ce9aba admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:25.799506 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5df3201b-459f-4ffc-9f66-366b33ce9aba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9b60a831a3840d8ae58174cefa5083f', 'request_id': 'req-5df3201b-459f-4ffc-9f66-366b33ce9aba'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:25.806775 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5df3201b-459f-4ffc-9f66-366b33ce9aba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9b60a831a3840d8ae58174cefa5083f', 'request_id': 'req-5df3201b-459f-4ffc-9f66-366b33ce9aba'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:25.824935 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5df3201b-459f-4ffc-9f66-366b33ce9aba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9b60a831a3840d8ae58174cefa5083f', 'request_id': 'req-5df3201b-459f-4ffc-9f66-366b33ce9aba'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:25.843190 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5df3201b-459f-4ffc-9f66-366b33ce9aba admin admin] The token cache is being invalidate because project a9b60a831a3840d8ae58174cefa5083f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:24:25.852455 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5df3201b-459f-4ffc-9f66-366b33ce9aba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:25.853284 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5df3201b-459f-4ffc-9f66-366b33ce9aba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:25.857732 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1198/2390] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:24:25 2022] DELETE /identity/v3/projects/a9b60a831a3840d8ae58174cefa5083f => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:24:25.860638 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a9e82-73bb-4541-b2c4-b129ff0b32ae admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:25.862789 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-be7a9e82-73bb-4541-b2c4-b129ff0b32ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:25.903425 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a9e82-73bb-4541-b2c4-b129ff0b32ae admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:25.935909 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:24:26.016660 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab60e8-3062-4a5d-8029-7dde03b814d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:26.017579 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab60e8-3062-4a5d-8029-7dde03b814d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:26.017886 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab60e8-3062-4a5d-8029-7dde03b814d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:26.018183 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab60e8-3062-4a5d-8029-7dde03b814d3 admin admin] PATH_INFO: `/v3/users/3c2ce533794548058302012e9fe1d01d` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:26.019471 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab60e8-3062-4a5d-8029-7dde03b814d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c2ce533794548058302012e9fe1d01d)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:26.021437 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab60e8-3062-4a5d-8029-7dde03b814d3 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:26.121778 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-edab60e8-3062-4a5d-8029-7dde03b814d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c2ce533794548058302012e9fe1d01d'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:26.159379 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-edab60e8-3062-4a5d-8029-7dde03b814d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c2ce533794548058302012e9fe1d01d'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:26.169555 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-edab60e8-3062-4a5d-8029-7dde03b814d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c2ce533794548058302012e9fe1d01d'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:26.181224 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-edab60e8-3062-4a5d-8029-7dde03b814d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c2ce533794548058302012e9fe1d01d'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:26.201562 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-edab60e8-3062-4a5d-8029-7dde03b814d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c2ce533794548058302012e9fe1d01d'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:26.209745 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1193/2391] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:24:25 2022] DELETE /identity/v3/users/3c2ce533794548058302012e9fe1d01d => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:24:26.794507 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df3201b-459f-4ffc-9f66-366b33ce9aba admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:26.797056 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5df3201b-459f-4ffc-9f66-366b33ce9aba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:26.819967 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df3201b-459f-4ffc-9f66-366b33ce9aba admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:26.945876 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01f0940-4a5a-49ff-b2cb-5067e8f78daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:26.946793 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f0940-4a5a-49ff-b2cb-5067e8f78daa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:26.947116 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f0940-4a5a-49ff-b2cb-5067e8f78daa admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:26.948008 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f0940-4a5a-49ff-b2cb-5067e8f78daa admin admin] PATH_INFO: `/v3/projects/c7dd793bcc814196b028a5def1027630` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:26.950304 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01f0940-4a5a-49ff-b2cb-5067e8f78daa admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7dd793bcc814196b028a5def1027630)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:26.952553 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01f0940-4a5a-49ff-b2cb-5067e8f78daa admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:27.017882 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a01f0940-4a5a-49ff-b2cb-5067e8f78daa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7dd793bcc814196b028a5def1027630', 'request_id': 'req-a01f0940-4a5a-49ff-b2cb-5067e8f78daa'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:27.020557 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:24:27.027214 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a01f0940-4a5a-49ff-b2cb-5067e8f78daa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7dd793bcc814196b028a5def1027630', 'request_id': 'req-a01f0940-4a5a-49ff-b2cb-5067e8f78daa'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:27.040308 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a01f0940-4a5a-49ff-b2cb-5067e8f78daa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7dd793bcc814196b028a5def1027630', 'request_id': 'req-a01f0940-4a5a-49ff-b2cb-5067e8f78daa'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:27.084375 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a01f0940-4a5a-49ff-b2cb-5067e8f78daa admin admin] The token cache is being invalidate because project c7dd793bcc814196b028a5def1027630 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:24:27.084688 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a01f0940-4a5a-49ff-b2cb-5067e8f78daa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:27.085438 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a01f0940-4a5a-49ff-b2cb-5067e8f78daa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:27.087240 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1199/2392] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:24:26 2022] DELETE /identity/v3/projects/c7dd793bcc814196b028a5def1027630 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:24:36.204552 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=44,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:24:37.070278 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=6,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:24:38.943786 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63fcc0a-195f-444e-ade1-e6ed06fef584 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:38.944690 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63fcc0a-195f-444e-ade1-e6ed06fef584 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:38.945128 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63fcc0a-195f-444e-ade1-e6ed06fef584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:38.969438 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-e63fcc0a-195f-444e-ade1-e6ed06fef584 None None] MFA Rules not processed for user `66d93db01b9441b7b51e90019d482fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:24:38.970747 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e63fcc0a-195f-444e-ade1-e6ed06fef584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:39.113024 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1194/2393] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:24:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:24:45.044998 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01f0940-4a5a-49ff-b2cb-5067e8f78daa admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:45.046619 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a01f0940-4a5a-49ff-b2cb-5067e8f78daa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:45.126035 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01f0940-4a5a-49ff-b2cb-5067e8f78daa admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:45.130960 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c377627-a234-4c41-8147-445ad601a61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:45.131869 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c377627-a234-4c41-8147-445ad601a61d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:45.132133 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c377627-a234-4c41-8147-445ad601a61d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:45.132406 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c377627-a234-4c41-8147-445ad601a61d admin admin] PATH_INFO: `/v3/users/b7d6b638f52942fb921b7adbf3ff0783` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:45.133643 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c377627-a234-4c41-8147-445ad601a61d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7d6b638f52942fb921b7adbf3ff0783)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:45.136073 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c377627-a234-4c41-8147-445ad601a61d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:45.189888 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7c377627-a234-4c41-8147-445ad601a61d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7d6b638f52942fb921b7adbf3ff0783'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:45.190554 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7c377627-a234-4c41-8147-445ad601a61d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7d6b638f52942fb921b7adbf3ff0783'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:45.191175 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7c377627-a234-4c41-8147-445ad601a61d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7d6b638f52942fb921b7adbf3ff0783'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:45.205857 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7c377627-a234-4c41-8147-445ad601a61d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7d6b638f52942fb921b7adbf3ff0783'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:45.214966 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7c377627-a234-4c41-8147-445ad601a61d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7d6b638f52942fb921b7adbf3ff0783'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:45.228526 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1200/2394] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:24:45 2022] DELETE /identity/v3/users/b7d6b638f52942fb921b7adbf3ff0783 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:24:45.234016 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a62d7-4d72-4ea3-8919-5a7be805d2ca None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:45.234578 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a62d7-4d72-4ea3-8919-5a7be805d2ca None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:45.234578 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a62d7-4d72-4ea3-8919-5a7be805d2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:45.258750 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-e66a62d7-4d72-4ea3-8919-5a7be805d2ca None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:24:45.261087 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e66a62d7-4d72-4ea3-8919-5a7be805d2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:45.340321 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1195/2395] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:24:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:24:45.351589 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c377627-a234-4c41-8147-445ad601a61d admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:45.353366 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7c377627-a234-4c41-8147-445ad601a61d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:45.437368 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c377627-a234-4c41-8147-445ad601a61d admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:45.442799 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b1382-ae36-4dad-81e7-67f932dafcc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:45.443812 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b1382-ae36-4dad-81e7-67f932dafcc0 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:45.444265 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b1382-ae36-4dad-81e7-67f932dafcc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:45.444697 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b1382-ae36-4dad-81e7-67f932dafcc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:45.456626 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549b1382-ae36-4dad-81e7-67f932dafcc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:45.458163 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549b1382-ae36-4dad-81e7-67f932dafcc0 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:45.470299 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1201/2396] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:24:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:24:45.848288 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a62d7-4d72-4ea3-8919-5a7be805d2ca None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:45.850025 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e66a62d7-4d72-4ea3-8919-5a7be805d2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:45.890511 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a62d7-4d72-4ea3-8919-5a7be805d2ca None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:45.899632 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f558b-a41b-4671-a13a-7d76e0fc0565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:45.901428 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f558b-a41b-4671-a13a-7d76e0fc0565 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:45.902079 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f558b-a41b-4671-a13a-7d76e0fc0565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:45.903446 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f558b-a41b-4671-a13a-7d76e0fc0565 admin admin] PATH_INFO: `/v3/projects/271729ce407f443ba7cb6e73a8b2cd8d` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:45.905637 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9f558b-a41b-4671-a13a-7d76e0fc0565 admin admin] RBAC: Authorizing `identity:delete_project(project_id=271729ce407f443ba7cb6e73a8b2cd8d)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:45.910801 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9f558b-a41b-4671-a13a-7d76e0fc0565 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:45.990853 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-da9f558b-a41b-4671-a13a-7d76e0fc0565 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '271729ce407f443ba7cb6e73a8b2cd8d', 'request_id': 'req-da9f558b-a41b-4671-a13a-7d76e0fc0565'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:45.998008 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-da9f558b-a41b-4671-a13a-7d76e0fc0565 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '271729ce407f443ba7cb6e73a8b2cd8d', 'request_id': 'req-da9f558b-a41b-4671-a13a-7d76e0fc0565'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:46.008731 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-da9f558b-a41b-4671-a13a-7d76e0fc0565 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '271729ce407f443ba7cb6e73a8b2cd8d', 'request_id': 'req-da9f558b-a41b-4671-a13a-7d76e0fc0565'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:46.023053 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-da9f558b-a41b-4671-a13a-7d76e0fc0565 admin admin] The token cache is being invalidate because project 271729ce407f443ba7cb6e73a8b2cd8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:24:46.023448 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-da9f558b-a41b-4671-a13a-7d76e0fc0565 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:46.024364 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-da9f558b-a41b-4671-a13a-7d76e0fc0565 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:24:46.026413 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1196/2397] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:24:45 2022] DELETE /identity/v3/projects/271729ce407f443ba7cb6e73a8b2cd8d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:24:53.197347 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e341423-566c-4502-bfd1-ad97b544b139 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:53.198135 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e341423-566c-4502-bfd1-ad97b544b139 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:53.198135 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e341423-566c-4502-bfd1-ad97b544b139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:53.220226 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-8e341423-566c-4502-bfd1-ad97b544b139 None None] MFA Rules not processed for user `6ec17bc9af1e497590bf0ac31f29d463`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:24:53.221486 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8e341423-566c-4502-bfd1-ad97b544b139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:53.246814 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:24:53.297065 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1202/2398] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:24:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:24:53.482531 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f29eb2-4880-4b41-bf21-6ccdf28f8b78 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:53.483081 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f29eb2-4880-4b41-bf21-6ccdf28f8b78 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:53.483081 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f29eb2-4880-4b41-bf21-6ccdf28f8b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:53.503938 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-66f29eb2-4880-4b41-bf21-6ccdf28f8b78 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:24:53.505082 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-66f29eb2-4880-4b41-bf21-6ccdf28f8b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:53.534855 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:24:53.590435 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1197/2399] 10.222.0.58 () {58 vars in 1016 bytes} [Wed Jun 29 12:24:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:24:53.737455 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e341423-566c-4502-bfd1-ad97b544b139 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:53.738924 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8e341423-566c-4502-bfd1-ad97b544b139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:53.831305 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e341423-566c-4502-bfd1-ad97b544b139 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:53.837797 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386183b-86bc-40a7-b827-f8edb0caaa29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7adaa2ef440941aa8214f2b2fd49b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:53.838546 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386183b-86bc-40a7-b827-f8edb0caaa29 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:53.838814 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386183b-86bc-40a7-b827-f8edb0caaa29 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:53.839089 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386183b-86bc-40a7-b827-f8edb0caaa29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:53.848464 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4386183b-86bc-40a7-b827-f8edb0caaa29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:53.850114 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4386183b-86bc-40a7-b827-f8edb0caaa29 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:53.860630 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1203/2400] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:24:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:24:56.820397 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab91f7-4e03-4ac8-9a9d-b99d69fda1f9 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:56.821008 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab91f7-4e03-4ac8-9a9d-b99d69fda1f9 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:56.821129 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab91f7-4e03-4ac8-9a9d-b99d69fda1f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:56.842605 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-29ab91f7-4e03-4ac8-9a9d-b99d69fda1f9 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:24:56.844119 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-29ab91f7-4e03-4ac8-9a9d-b99d69fda1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:56.855558 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1198/2401] 10.222.0.58 () {58 vars in 1016 bytes} [Wed Jun 29 12:24:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:24:56.874461 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386183b-86bc-40a7-b827-f8edb0caaa29 service nova] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:56.889207 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386183b-86bc-40a7-b827-f8edb0caaa29 service nova] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:56.896917 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5abed-aa1c-4f52-942c-ff1192eef233 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7adaa2ef440941aa8214f2b2fd49b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:56.898073 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5abed-aa1c-4f52-942c-ff1192eef233 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:56.898999 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5abed-aa1c-4f52-942c-ff1192eef233 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:56.899210 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5abed-aa1c-4f52-942c-ff1192eef233 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:56.913579 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac5abed-aa1c-4f52-942c-ff1192eef233 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:56.915364 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac5abed-aa1c-4f52-942c-ff1192eef233 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:24:56.926236 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1204/2402] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:24:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:24:59.915948 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd07df1-e8a8-4bd8-bd88-b82c35d0ee70 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:59.916579 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd07df1-e8a8-4bd8-bd88-b82c35d0ee70 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:59.916579 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd07df1-e8a8-4bd8-bd88-b82c35d0ee70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:59.937964 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-3fd07df1-e8a8-4bd8-bd88-b82c35d0ee70 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:24:59.939203 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-3fd07df1-e8a8-4bd8-bd88-b82c35d0ee70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:24:59.947561 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1199/2403] 10.222.0.58 () {58 vars in 1016 bytes} [Wed Jun 29 12:24:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:24:59.964567 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5abed-aa1c-4f52-942c-ff1192eef233 service nova] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:24:59.977802 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5abed-aa1c-4f52-942c-ff1192eef233 service nova] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:24:59.987345 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68aa921-57d2-4704-b2e6-9470cb870e66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7adaa2ef440941aa8214f2b2fd49b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:24:59.988002 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68aa921-57d2-4704-b2e6-9470cb870e66 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:24:59.988282 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68aa921-57d2-4704-b2e6-9470cb870e66 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:24:59.988550 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68aa921-57d2-4704-b2e6-9470cb870e66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:24:59.997232 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68aa921-57d2-4704-b2e6-9470cb870e66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:24:59.999488 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68aa921-57d2-4704-b2e6-9470cb870e66 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:25:00.009141 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1205/2404] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:24:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:25:03.082378 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25a9b3-77c3-45fc-bb54-b0ced839ba4b None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:25:03.082896 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25a9b3-77c3-45fc-bb54-b0ced839ba4b None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:25:03.083001 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25a9b3-77c3-45fc-bb54-b0ced839ba4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:25:03.103812 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-1d25a9b3-77c3-45fc-bb54-b0ced839ba4b None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:25:03.105028 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-1d25a9b3-77c3-45fc-bb54-b0ced839ba4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:25:03.113857 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1200/2405] 10.222.0.58 () {58 vars in 1016 bytes} [Wed Jun 29 12:25:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:25:03.131770 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68aa921-57d2-4704-b2e6-9470cb870e66 service nova] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:25:03.143976 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68aa921-57d2-4704-b2e6-9470cb870e66 service nova] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:25:03.150714 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b8f908-2b4c-4fab-bbcd-fc40704929ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7adaa2ef440941aa8214f2b2fd49b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:25:03.151348 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8f908-2b4c-4fab-bbcd-fc40704929ec service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:25:03.151629 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8f908-2b4c-4fab-bbcd-fc40704929ec service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:25:03.151902 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8f908-2b4c-4fab-bbcd-fc40704929ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:25:03.163242 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b8f908-2b4c-4fab-bbcd-fc40704929ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:25:03.165104 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b8f908-2b4c-4fab-bbcd-fc40704929ec service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:25:03.178549 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1206/2406] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:25:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:25:06.273212 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f731e-212e-4586-8dd5-9f75fb9da261 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:25:06.273813 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f731e-212e-4586-8dd5-9f75fb9da261 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:25:06.273813 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f731e-212e-4586-8dd5-9f75fb9da261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:25:06.294094 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-091f731e-212e-4586-8dd5-9f75fb9da261 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:25:06.295352 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-091f731e-212e-4586-8dd5-9f75fb9da261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:25:06.303702 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1201/2407] 10.222.0.58 () {58 vars in 1016 bytes} [Wed Jun 29 12:25:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:25:06.320257 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b8f908-2b4c-4fab-bbcd-fc40704929ec service nova] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:25:06.332110 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b8f908-2b4c-4fab-bbcd-fc40704929ec service nova] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:25:06.338529 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa82d0d-77ff-410d-a616-c0e09c0f44f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7adaa2ef440941aa8214f2b2fd49b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:25:06.339182 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa82d0d-77ff-410d-a616-c0e09c0f44f0 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:25:06.339465 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa82d0d-77ff-410d-a616-c0e09c0f44f0 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:25:06.339746 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa82d0d-77ff-410d-a616-c0e09c0f44f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:25:06.348920 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa82d0d-77ff-410d-a616-c0e09c0f44f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:25:06.350775 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa82d0d-77ff-410d-a616-c0e09c0f44f0 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:25:06.361144 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1207/2408] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:25:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:25:16.287281 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=26 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:25:16.356486 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=73 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:25:35.920675 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9184c76-329b-4b22-93a2-0591f0f7d579 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:25:35.921339 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9184c76-329b-4b22-93a2-0591f0f7d579 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:25:35.921339 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9184c76-329b-4b22-93a2-0591f0f7d579 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:25:35.923044 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1202/2409] 10.222.0.27 () {54 vars in 921 bytes} [Wed Jun 29 12:25:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:25:35.936752 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301bcb73-5ec1-4b9f-bc27-6807c164e311 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:25:35.939919 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301bcb73-5ec1-4b9f-bc27-6807c164e311 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:25:35.940553 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301bcb73-5ec1-4b9f-bc27-6807c164e311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:25:35.991439 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-301bcb73-5ec1-4b9f-bc27-6807c164e311 None None] MFA Rules not processed for user `286a99b42d9246db909040bf8ab18ea1`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:25:35.992960 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-301bcb73-5ec1-4b9f-bc27-6807c164e311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:25:36.004019 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9184c76-329b-4b22-93a2-0591f0f7d579 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:25:36.007041 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-b9184c76-329b-4b22-93a2-0591f0f7d579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:25:36.033059 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9184c76-329b-4b22-93a2-0591f0f7d579 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:25:36.041516 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f08fa96-ec10-4496-93e0-02dfe5eaca08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:25:36.042676 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08fa96-ec10-4496-93e0-02dfe5eaca08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:25:36.042943 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08fa96-ec10-4496-93e0-02dfe5eaca08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:25:36.043353 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08fa96-ec10-4496-93e0-02dfe5eaca08 admin admin] PATH_INFO: `/v3/users/66d93db01b9441b7b51e90019d482fbe` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:25:36.044781 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f08fa96-ec10-4496-93e0-02dfe5eaca08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66d93db01b9441b7b51e90019d482fbe)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:25:36.050218 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f08fa96-ec10-4496-93e0-02dfe5eaca08 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:25:36.087111 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1208/2410] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Jun 29 12:25:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:25:36.097625 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301bcb73-5ec1-4b9f-bc27-6807c164e311 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:25:36.099042 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-301bcb73-5ec1-4b9f-bc27-6807c164e311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:25:36.111325 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-8f08fa96-ec10-4496-93e0-02dfe5eaca08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66d93db01b9441b7b51e90019d482fbe'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:25:36.113626 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301bcb73-5ec1-4b9f-bc27-6807c164e311 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:25:36.119233 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7906e9-49ce-4992-9e31-059c0a3cd286 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '286a99b42d9246db909040bf8ab18ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:25:36.119878 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7906e9-49ce-4992-9e31-059c0a3cd286 service placement] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:25:36.120161 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7906e9-49ce-4992-9e31-059c0a3cd286 service placement] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:25:36.120433 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7906e9-49ce-4992-9e31-059c0a3cd286 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:25:36.127678 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-8f08fa96-ec10-4496-93e0-02dfe5eaca08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66d93db01b9441b7b51e90019d482fbe'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:25:36.129614 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7906e9-49ce-4992-9e31-059c0a3cd286 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:25:36.131294 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7906e9-49ce-4992-9e31-059c0a3cd286 service placement] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:25:36.136326 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-8f08fa96-ec10-4496-93e0-02dfe5eaca08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66d93db01b9441b7b51e90019d482fbe'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:25:36.137144 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-8f08fa96-ec10-4496-93e0-02dfe5eaca08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66d93db01b9441b7b51e90019d482fbe'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:25:36.142075 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1209/2411] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:25:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:25:36.146506 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-8f08fa96-ec10-4496-93e0-02dfe5eaca08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66d93db01b9441b7b51e90019d482fbe'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:25:36.153289 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1203/2412] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:25:36 2022] DELETE /identity/v3/users/66d93db01b9441b7b51e90019d482fbe => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:25:36.431450 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7906e9-49ce-4992-9e31-059c0a3cd286 service placement] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:25:36.449114 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7906e9-49ce-4992-9e31-059c0a3cd286 service placement] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:25:36.518366 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ead009b-bd05-4c55-8162-c91371032f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:25:36.518977 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead009b-bd05-4c55-8162-c91371032f23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:25:36.519259 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead009b-bd05-4c55-8162-c91371032f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:25:36.519534 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead009b-bd05-4c55-8162-c91371032f23 admin admin] PATH_INFO: `/v3/projects/e7ed996b379b4d14bb3474526d538934` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:25:36.520766 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ead009b-bd05-4c55-8162-c91371032f23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7ed996b379b4d14bb3474526d538934)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:25:36.523159 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ead009b-bd05-4c55-8162-c91371032f23 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:25:36.580289 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7ead009b-bd05-4c55-8162-c91371032f23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7ed996b379b4d14bb3474526d538934', 'request_id': 'req-7ead009b-bd05-4c55-8162-c91371032f23'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:25:36.586978 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7ead009b-bd05-4c55-8162-c91371032f23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7ed996b379b4d14bb3474526d538934', 'request_id': 'req-7ead009b-bd05-4c55-8162-c91371032f23'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:25:36.599326 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7ead009b-bd05-4c55-8162-c91371032f23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7ed996b379b4d14bb3474526d538934', 'request_id': 'req-7ead009b-bd05-4c55-8162-c91371032f23'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:25:36.611112 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:25:36.616975 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7ead009b-bd05-4c55-8162-c91371032f23 admin admin] The token cache is being invalidate because project e7ed996b379b4d14bb3474526d538934 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:25:36.617548 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7ead009b-bd05-4c55-8162-c91371032f23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:25:36.618514 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7ead009b-bd05-4c55-8162-c91371032f23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:25:36.621384 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1210/2413] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:25:36 2022] DELETE /identity/v3/projects/e7ed996b379b4d14bb3474526d538934 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:25:36.627731 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41837e27-d72a-4870-b509-b6673dbe1aeb None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:25:36.628810 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41837e27-d72a-4870-b509-b6673dbe1aeb None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:25:36.629569 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41837e27-d72a-4870-b509-b6673dbe1aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:25:36.663824 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-41837e27-d72a-4870-b509-b6673dbe1aeb None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:25:36.665137 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-41837e27-d72a-4870-b509-b6673dbe1aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:25:36.736697 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1204/2414] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:25:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:25:36.744491 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f03bfb8-29d4-49d5-a59a-0b7cc1b6f00b None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:25:36.744788 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f03bfb8-29d4-49d5-a59a-0b7cc1b6f00b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:25:36.745054 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f03bfb8-29d4-49d5-a59a-0b7cc1b6f00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:25:36.766410 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-1f03bfb8-29d4-49d5-a59a-0b7cc1b6f00b None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:25:36.767658 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1f03bfb8-29d4-49d5-a59a-0b7cc1b6f00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:25:36.776747 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1211/2415] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:25:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:25:36.782660 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41837e27-d72a-4870-b509-b6673dbe1aeb None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:25:36.796167 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41837e27-d72a-4870-b509-b6673dbe1aeb None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:25:36.801651 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7345050-fc71-4b8a-832b-52b008aa8be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:25:36.802595 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7345050-fc71-4b8a-832b-52b008aa8be3 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:25:36.802888 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7345050-fc71-4b8a-832b-52b008aa8be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:25:36.803159 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7345050-fc71-4b8a-832b-52b008aa8be3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:25:36.803927 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7345050-fc71-4b8a-832b-52b008aa8be3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:25:36.804237 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7345050-fc71-4b8a-832b-52b008aa8be3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:25:36.805912 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7345050-fc71-4b8a-832b-52b008aa8be3 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:25:36.825012 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1205/2416] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:25:36.826207 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f03bfb8-29d4-49d5-a59a-0b7cc1b6f00b None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:25:36.836071 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f03bfb8-29d4-49d5-a59a-0b7cc1b6f00b None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:25:36.840345 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086dc917-8e94-44dc-aac4-bfbed391c399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:25:36.840990 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086dc917-8e94-44dc-aac4-bfbed391c399 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:25:36.841266 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086dc917-8e94-44dc-aac4-bfbed391c399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:25:36.841534 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086dc917-8e94-44dc-aac4-bfbed391c399 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:25:36.842273 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086dc917-8e94-44dc-aac4-bfbed391c399 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:25:36.844305 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086dc917-8e94-44dc-aac4-bfbed391c399 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:25:36.871754 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1212/2417] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:25:36 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:25:36.875670 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7345050-fc71-4b8a-832b-52b008aa8be3 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:25:36.885521 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7345050-fc71-4b8a-832b-52b008aa8be3 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:25:36.948188 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c6425-de4f-474e-ab3b-a1f1b6cc080f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:25:36.948915 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c6425-de4f-474e-ab3b-a1f1b6cc080f admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:25:36.949141 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c6425-de4f-474e-ab3b-a1f1b6cc080f admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:25:36.949420 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c6425-de4f-474e-ab3b-a1f1b6cc080f admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:25:36.950165 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c6425-de4f-474e-ab3b-a1f1b6cc080f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:25:36.952108 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c6425-de4f-474e-ab3b-a1f1b6cc080f admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:25:36.959287 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:25:36.975880 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1206/2418] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:25:36 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:25:36.979921 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086dc917-8e94-44dc-aac4-bfbed391c399 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:25:36.991658 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086dc917-8e94-44dc-aac4-bfbed391c399 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:25:36.996937 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1acf412-fd1b-4c13-928a-4ae868d57ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:25:36.997780 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acf412-fd1b-4c13-928a-4ae868d57ddb admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:25:36.998066 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acf412-fd1b-4c13-928a-4ae868d57ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:25:36.998365 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acf412-fd1b-4c13-928a-4ae868d57ddb admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:25:36.999110 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1acf412-fd1b-4c13-928a-4ae868d57ddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:25:37.000882 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1acf412-fd1b-4c13-928a-4ae868d57ddb admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:25:37.012369 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1213/2419] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:25:37.017869 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c6425-de4f-474e-ab3b-a1f1b6cc080f admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:25:37.031402 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c6425-de4f-474e-ab3b-a1f1b6cc080f admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:25:37.036536 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af56d0-6958-463f-9ac6-43e2840fe8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:25:37.037220 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af56d0-6958-463f-9ac6-43e2840fe8ac admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:25:37.037501 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af56d0-6958-463f-9ac6-43e2840fe8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:25:37.037801 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af56d0-6958-463f-9ac6-43e2840fe8ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:25:37.038543 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7af56d0-6958-463f-9ac6-43e2840fe8ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:25:37.040157 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7af56d0-6958-463f-9ac6-43e2840fe8ac admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:25:37.054697 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1207/2420] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:25:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:25:37.058864 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1acf412-fd1b-4c13-928a-4ae868d57ddb admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:25:37.070703 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1acf412-fd1b-4c13-928a-4ae868d57ddb admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:25:37.075646 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac5f30-040a-43db-acf4-e215be739f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:25:37.076660 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac5f30-040a-43db-acf4-e215be739f9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:25:37.077044 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac5f30-040a-43db-acf4-e215be739f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:25:37.077634 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac5f30-040a-43db-acf4-e215be739f9b admin admin] PATH_INFO: `/v3/projects/d4945631025f4741ad5cb9f0a4332133/users/097db64718d54e54ba05712930f21810/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:25:37.093874 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ac5f30-040a-43db-acf4-e215be739f9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4945631025f4741ad5cb9f0a4332133, user_id=097db64718d54e54ba05712930f21810, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:25:37.096697 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ac5f30-040a-43db-acf4-e215be739f9b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:25:37.111934 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1214/2421] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:25:37 2022] PUT /identity/v3/projects/d4945631025f4741ad5cb9f0a4332133/users/097db64718d54e54ba05712930f21810/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:25:37.117274 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dba263-ed07-4c0d-9e35-2ea5c6509404 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:25:37.117630 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dba263-ed07-4c0d-9e35-2ea5c6509404 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:25:37.118995 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dba263-ed07-4c0d-9e35-2ea5c6509404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:25:37.137101 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-45dba263-ed07-4c0d-9e35-2ea5c6509404 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:25:37.138302 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-45dba263-ed07-4c0d-9e35-2ea5c6509404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:25:37.202011 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1208/2422] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:25:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:25:37.211992 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac5f30-040a-43db-acf4-e215be739f9b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:25:37.213947 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f2ac5f30-040a-43db-acf4-e215be739f9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:25:37.286608 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac5f30-040a-43db-acf4-e215be739f9b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:25:37.290313 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a82d67-5ab7-4ef4-9b33-92f8fac476ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:25:37.290964 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a82d67-5ab7-4ef4-9b33-92f8fac476ca service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:25:37.291269 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a82d67-5ab7-4ef4-9b33-92f8fac476ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:25:37.291537 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a82d67-5ab7-4ef4-9b33-92f8fac476ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:25:37.301666 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a82d67-5ab7-4ef4-9b33-92f8fac476ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:25:37.303166 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a82d67-5ab7-4ef4-9b33-92f8fac476ca service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:25:37.314221 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1215/2423] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:25:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:25:42.237897 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e0487-7643-4486-9781-f6269c56412b None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:25:42.238733 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e0487-7643-4486-9781-f6269c56412b None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:25:42.239181 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e0487-7643-4486-9781-f6269c56412b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:25:42.272939 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-460e0487-7643-4486-9781-f6269c56412b None None] MFA Rules not processed for user `097db64718d54e54ba05712930f21810`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:25:42.275507 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-460e0487-7643-4486-9781-f6269c56412b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:25:42.400928 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1209/2424] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:25:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:25:42.404691 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a82d67-5ab7-4ef4-9b33-92f8fac476ca service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:25:42.421268 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a82d67-5ab7-4ef4-9b33-92f8fac476ca service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:25:42.427407 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f787c7-3bc9-4e9e-a20b-f18c99c5152f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:25:42.428488 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f787c7-3bc9-4e9e-a20b-f18c99c5152f admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:25:42.428771 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f787c7-3bc9-4e9e-a20b-f18c99c5152f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:25:42.429047 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f787c7-3bc9-4e9e-a20b-f18c99c5152f admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:25:42.429853 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f787c7-3bc9-4e9e-a20b-f18c99c5152f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:25:42.432380 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f787c7-3bc9-4e9e-a20b-f18c99c5152f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:25:42.463785 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1216/2425] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:25:42 2022] POST /identity/v3/projects => generated 371 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:25:42.468330 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e0487-7643-4486-9781-f6269c56412b None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:25:42.485432 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e0487-7643-4486-9781-f6269c56412b None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:25:42.569342 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9534abb1-9fc2-4c38-8044-fb60eb08a7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:25:42.570531 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534abb1-9fc2-4c38-8044-fb60eb08a7db admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:25:42.571026 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534abb1-9fc2-4c38-8044-fb60eb08a7db admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:25:42.571365 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534abb1-9fc2-4c38-8044-fb60eb08a7db admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:25:42.572142 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9534abb1-9fc2-4c38-8044-fb60eb08a7db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:25:42.574184 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9534abb1-9fc2-4c38-8044-fb60eb08a7db admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:25:42.596224 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:25:42.607463 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1210/2426] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:25:42 2022] POST /identity/v3/users => generated 292 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:25:42.608760 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f787c7-3bc9-4e9e-a20b-f18c99c5152f admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:25:42.626764 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f787c7-3bc9-4e9e-a20b-f18c99c5152f admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:25:42.635737 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6612ae7-ed76-4f95-82cc-f5f0feed6133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:25:42.636483 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6612ae7-ed76-4f95-82cc-f5f0feed6133 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:25:42.636766 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6612ae7-ed76-4f95-82cc-f5f0feed6133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:25:42.637037 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6612ae7-ed76-4f95-82cc-f5f0feed6133 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:25:42.638087 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6612ae7-ed76-4f95-82cc-f5f0feed6133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:25:42.639941 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6612ae7-ed76-4f95-82cc-f5f0feed6133 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:25:42.656743 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1217/2427] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:25:42.658013 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9534abb1-9fc2-4c38-8044-fb60eb08a7db admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:25:42.668110 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9534abb1-9fc2-4c38-8044-fb60eb08a7db admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:25:42.673739 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ed369-c43d-41b9-aa14-a2c0f2de3edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:25:42.674488 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ed369-c43d-41b9-aa14-a2c0f2de3edb admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:25:42.674834 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ed369-c43d-41b9-aa14-a2c0f2de3edb admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:25:42.675201 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ed369-c43d-41b9-aa14-a2c0f2de3edb admin admin] PATH_INFO: `/v3/projects/33d13c6f301f401e8284d7b17a4312e5/users/f69b32b32a144f6eb6a9a2d2af4dd74f/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:25:42.697764 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50ed369-c43d-41b9-aa14-a2c0f2de3edb admin admin] RBAC: Authorizing `identity:create_grant(project_id=33d13c6f301f401e8284d7b17a4312e5, user_id=f69b32b32a144f6eb6a9a2d2af4dd74f, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:25:42.700602 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50ed369-c43d-41b9-aa14-a2c0f2de3edb admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:25:42.715147 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1211/2428] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:25:42 2022] PUT /identity/v3/projects/33d13c6f301f401e8284d7b17a4312e5/users/f69b32b32a144f6eb6a9a2d2af4dd74f/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:25:42.719251 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6612ae7-ed76-4f95-82cc-f5f0feed6133 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:25:42.729957 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6612ae7-ed76-4f95-82cc-f5f0feed6133 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:25:42.787735 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8772c633-9b4a-4da8-893e-f21dd5de411e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:25:42.788419 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772c633-9b4a-4da8-893e-f21dd5de411e admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:25:42.788739 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772c633-9b4a-4da8-893e-f21dd5de411e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:25:42.788991 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772c633-9b4a-4da8-893e-f21dd5de411e admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:25:42.789740 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8772c633-9b4a-4da8-893e-f21dd5de411e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:25:42.791428 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8772c633-9b4a-4da8-893e-f21dd5de411e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:25:42.805257 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1218/2429] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:25:42.806592 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ed369-c43d-41b9-aa14-a2c0f2de3edb admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:25:42.818930 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ed369-c43d-41b9-aa14-a2c0f2de3edb admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:25:42.825587 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d7dd9-c992-477f-9acc-a02799f05217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:25:42.826768 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d7dd9-c992-477f-9acc-a02799f05217 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:25:42.827083 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d7dd9-c992-477f-9acc-a02799f05217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:25:42.827478 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d7dd9-c992-477f-9acc-a02799f05217 admin admin] PATH_INFO: `/v3/projects/33d13c6f301f401e8284d7b17a4312e5/users/f69b32b32a144f6eb6a9a2d2af4dd74f/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:25:42.829548 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43d7dd9-c992-477f-9acc-a02799f05217 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33d13c6f301f401e8284d7b17a4312e5, user_id=f69b32b32a144f6eb6a9a2d2af4dd74f, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:25:42.832247 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43d7dd9-c992-477f-9acc-a02799f05217 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:25:42.847446 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1212/2430] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:25:42 2022] PUT /identity/v3/projects/33d13c6f301f401e8284d7b17a4312e5/users/f69b32b32a144f6eb6a9a2d2af4dd74f/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:25:42.889142 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb0bc0-ba2c-4ed3-b1f9-1ace13cbca80 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:25:42.889530 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb0bc0-ba2c-4ed3-b1f9-1ace13cbca80 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:25:42.889854 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb0bc0-ba2c-4ed3-b1f9-1ace13cbca80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:25:42.895924 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:25:42.911433 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-87bb0bc0-ba2c-4ed3-b1f9-1ace13cbca80 None None] MFA Rules not processed for user `f2f7f01eb34a486aa78320673c7f1c0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:25:42.912588 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-87bb0bc0-ba2c-4ed3-b1f9-1ace13cbca80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:25:42.983582 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1219/2431] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:25:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:25:48.115908 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db1498-7e3f-4a12-ba1c-41b3fcc182bc None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:25:48.116393 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db1498-7e3f-4a12-ba1c-41b3fcc182bc None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:25:48.116501 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db1498-7e3f-4a12-ba1c-41b3fcc182bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:25:48.152600 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-27db1498-7e3f-4a12-ba1c-41b3fcc182bc None None] MFA Rules not processed for user `f69b32b32a144f6eb6a9a2d2af4dd74f`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:25:48.153995 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-27db1498-7e3f-4a12-ba1c-41b3fcc182bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:25:48.236786 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1213/2432] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:25:48 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:25:48.243362 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb0bc0-ba2c-4ed3-b1f9-1ace13cbca80 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:25:48.244947 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-87bb0bc0-ba2c-4ed3-b1f9-1ace13cbca80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:25:48.336503 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb0bc0-ba2c-4ed3-b1f9-1ace13cbca80 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:25:48.343100 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea49d6-4f03-4501-a985-d60f38c62ccd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7adaa2ef440941aa8214f2b2fd49b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:25:48.343956 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea49d6-4f03-4501-a985-d60f38c62ccd service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:25:48.344311 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea49d6-4f03-4501-a985-d60f38c62ccd service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:25:48.344663 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea49d6-4f03-4501-a985-d60f38c62ccd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:25:48.415889 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ea49d6-4f03-4501-a985-d60f38c62ccd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:25:48.417586 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ea49d6-4f03-4501-a985-d60f38c62ccd service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:25:48.434663 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1220/2433] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:25:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:25:50.730953 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184fb0e-1d41-4142-a92f-39a46de4ab71 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:25:50.731963 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184fb0e-1d41-4142-a92f-39a46de4ab71 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:25:50.732455 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184fb0e-1d41-4142-a92f-39a46de4ab71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:25:50.751500 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-b184fb0e-1d41-4142-a92f-39a46de4ab71 None None] MFA Rules not processed for user `097db64718d54e54ba05712930f21810`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:25:50.753298 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-b184fb0e-1d41-4142-a92f-39a46de4ab71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:25:50.762315 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1214/2434] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:25:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:25:54.617342 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea49d6-4f03-4501-a985-d60f38c62ccd service nova] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:25:54.621052 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-67ea49d6-4f03-4501-a985-d60f38c62ccd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:25:54.687255 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:25:54.706355 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea49d6-4f03-4501-a985-d60f38c62ccd service nova] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:25:54.711024 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a64aab-323a-4878-ac08-ee98d5d3db18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:25:54.712128 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a64aab-323a-4878-ac08-ee98d5d3db18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:25:54.712508 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a64aab-323a-4878-ac08-ee98d5d3db18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:25:54.712692 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a64aab-323a-4878-ac08-ee98d5d3db18 admin admin] PATH_INFO: `/v3/users/6ec17bc9af1e497590bf0ac31f29d463` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:25:54.713969 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a64aab-323a-4878-ac08-ee98d5d3db18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ec17bc9af1e497590bf0ac31f29d463)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:25:54.715941 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a64aab-323a-4878-ac08-ee98d5d3db18 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:25:54.784711 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b9a64aab-323a-4878-ac08-ee98d5d3db18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ec17bc9af1e497590bf0ac31f29d463'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:25:54.787027 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b9a64aab-323a-4878-ac08-ee98d5d3db18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ec17bc9af1e497590bf0ac31f29d463'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:25:54.787605 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b9a64aab-323a-4878-ac08-ee98d5d3db18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ec17bc9af1e497590bf0ac31f29d463'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:25:54.807177 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b9a64aab-323a-4878-ac08-ee98d5d3db18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ec17bc9af1e497590bf0ac31f29d463'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:25:54.817436 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b9a64aab-323a-4878-ac08-ee98d5d3db18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ec17bc9af1e497590bf0ac31f29d463'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:25:54.832431 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1221/2435] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:25:54 2022] DELETE /identity/v3/users/6ec17bc9af1e497590bf0ac31f29d463 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:25:55.036103 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b184fb0e-1d41-4142-a92f-39a46de4ab71 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:25:55.049309 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b184fb0e-1d41-4142-a92f-39a46de4ab71 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:25:55.133151 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db593f-c5b4-49b9-8aa4-4cfd74484c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:25:55.134130 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db593f-c5b4-49b9-8aa4-4cfd74484c43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:25:55.134412 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db593f-c5b4-49b9-8aa4-4cfd74484c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:25:55.134725 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db593f-c5b4-49b9-8aa4-4cfd74484c43 admin admin] PATH_INFO: `/v3/projects/7cbe808881a9478eb25bff42d03289c8` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:25:55.136265 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74db593f-c5b4-49b9-8aa4-4cfd74484c43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cbe808881a9478eb25bff42d03289c8)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:25:55.138215 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74db593f-c5b4-49b9-8aa4-4cfd74484c43 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:25:55.189322 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:25:55.196730 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-74db593f-c5b4-49b9-8aa4-4cfd74484c43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cbe808881a9478eb25bff42d03289c8', 'request_id': 'req-74db593f-c5b4-49b9-8aa4-4cfd74484c43'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:25:55.203248 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-74db593f-c5b4-49b9-8aa4-4cfd74484c43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cbe808881a9478eb25bff42d03289c8', 'request_id': 'req-74db593f-c5b4-49b9-8aa4-4cfd74484c43'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:25:55.212519 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-74db593f-c5b4-49b9-8aa4-4cfd74484c43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cbe808881a9478eb25bff42d03289c8', 'request_id': 'req-74db593f-c5b4-49b9-8aa4-4cfd74484c43'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:25:55.224489 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-74db593f-c5b4-49b9-8aa4-4cfd74484c43 admin admin] The token cache is being invalidate because project 7cbe808881a9478eb25bff42d03289c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:25:55.224763 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-74db593f-c5b4-49b9-8aa4-4cfd74484c43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:25:55.225449 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-74db593f-c5b4-49b9-8aa4-4cfd74484c43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:25:55.227076 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1215/2436] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:25:55 2022] DELETE /identity/v3/projects/7cbe808881a9478eb25bff42d03289c8 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:25:55.233106 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8e6fc-9988-4c49-b40d-63012defc909 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:25:55.233402 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8e6fc-9988-4c49-b40d-63012defc909 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:25:55.233780 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8e6fc-9988-4c49-b40d-63012defc909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:25:55.256940 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-d7e8e6fc-9988-4c49-b40d-63012defc909 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:25:55.258193 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d7e8e6fc-9988-4c49-b40d-63012defc909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:25:55.322451 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1222/2437] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:25:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:25:55.330432 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385f748-c893-4284-9169-0ddd8594d46a None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:25:55.330738 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385f748-c893-4284-9169-0ddd8594d46a None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:25:55.330995 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385f748-c893-4284-9169-0ddd8594d46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:25:55.352985 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-f385f748-c893-4284-9169-0ddd8594d46a None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:25:55.354374 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-f385f748-c893-4284-9169-0ddd8594d46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:25:55.363297 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1216/2438] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:25:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:25:55.367806 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e8e6fc-9988-4c49-b40d-63012defc909 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:25:55.378841 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e8e6fc-9988-4c49-b40d-63012defc909 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:25:55.384622 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838fcf6-0a79-4c83-a0be-ff0cb60c9f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:25:55.385457 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838fcf6-0a79-4c83-a0be-ff0cb60c9f59 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:25:55.385750 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838fcf6-0a79-4c83-a0be-ff0cb60c9f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:25:55.386065 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838fcf6-0a79-4c83-a0be-ff0cb60c9f59 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:25:55.386948 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1838fcf6-0a79-4c83-a0be-ff0cb60c9f59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:25:55.387388 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1838fcf6-0a79-4c83-a0be-ff0cb60c9f59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:25:55.389252 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1838fcf6-0a79-4c83-a0be-ff0cb60c9f59 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:25:55.404937 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1223/2439] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:25:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:25:55.409895 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f385f748-c893-4284-9169-0ddd8594d46a None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:25:55.419841 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f385f748-c893-4284-9169-0ddd8594d46a None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:25:55.426103 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6871f6d4-958d-4679-9389-ac44a5d3697f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:25:55.426774 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871f6d4-958d-4679-9389-ac44a5d3697f admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:25:55.427056 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871f6d4-958d-4679-9389-ac44a5d3697f admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:25:55.427330 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871f6d4-958d-4679-9389-ac44a5d3697f admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:25:55.428020 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6871f6d4-958d-4679-9389-ac44a5d3697f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:25:55.429998 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6871f6d4-958d-4679-9389-ac44a5d3697f admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:25:55.460303 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1217/2440] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:25:55 2022] POST /identity/v3/projects => generated 389 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:25:55.464560 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838fcf6-0a79-4c83-a0be-ff0cb60c9f59 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:25:55.476910 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838fcf6-0a79-4c83-a0be-ff0cb60c9f59 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:25:55.539449 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:25:55.559123 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b567ecdf-8fdd-4757-87f1-2e3c0e82bb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:25:55.559853 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b567ecdf-8fdd-4757-87f1-2e3c0e82bb3e admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:25:55.560138 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b567ecdf-8fdd-4757-87f1-2e3c0e82bb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:25:55.560417 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b567ecdf-8fdd-4757-87f1-2e3c0e82bb3e admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:25:55.561114 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b567ecdf-8fdd-4757-87f1-2e3c0e82bb3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:25:55.563661 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b567ecdf-8fdd-4757-87f1-2e3c0e82bb3e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:25:55.586810 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1224/2441] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:25:55 2022] POST /identity/v3/users => generated 295 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:25:55.591176 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6871f6d4-958d-4679-9389-ac44a5d3697f admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:25:55.606031 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6871f6d4-958d-4679-9389-ac44a5d3697f admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:25:55.612438 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ad72a-5e0e-4e1f-958a-a26ba6527d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:25:55.613102 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ad72a-5e0e-4e1f-958a-a26ba6527d47 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:25:55.613379 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ad72a-5e0e-4e1f-958a-a26ba6527d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:25:55.613646 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ad72a-5e0e-4e1f-958a-a26ba6527d47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:25:55.614412 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ad72a-5e0e-4e1f-958a-a26ba6527d47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:25:55.616008 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ad72a-5e0e-4e1f-958a-a26ba6527d47 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:25:55.628355 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1218/2442] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:25:55.633499 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b567ecdf-8fdd-4757-87f1-2e3c0e82bb3e admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:25:55.647988 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b567ecdf-8fdd-4757-87f1-2e3c0e82bb3e admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:25:55.654222 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec94c74-fe34-427c-9f74-8b8f48beda34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:25:55.655310 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec94c74-fe34-427c-9f74-8b8f48beda34 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:25:55.655892 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec94c74-fe34-427c-9f74-8b8f48beda34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:25:55.656541 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec94c74-fe34-427c-9f74-8b8f48beda34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:25:55.657628 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec94c74-fe34-427c-9f74-8b8f48beda34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:25:55.659880 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec94c74-fe34-427c-9f74-8b8f48beda34 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:25:55.671375 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1225/2443] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:25:55.675782 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ad72a-5e0e-4e1f-958a-a26ba6527d47 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:25:55.689134 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ad72a-5e0e-4e1f-958a-a26ba6527d47 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:25:55.694797 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965c2ae-1ead-4e5b-bb72-80d7c6acc941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:25:55.695694 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965c2ae-1ead-4e5b-bb72-80d7c6acc941 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:25:55.695967 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965c2ae-1ead-4e5b-bb72-80d7c6acc941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:25:55.696245 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965c2ae-1ead-4e5b-bb72-80d7c6acc941 admin admin] PATH_INFO: `/v3/projects/e314253d6a1c4669a77072312b5377f7/users/cf7d4c2c41494b62a9dea6a1d850d18c/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:25:55.714974 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965c2ae-1ead-4e5b-bb72-80d7c6acc941 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e314253d6a1c4669a77072312b5377f7, user_id=cf7d4c2c41494b62a9dea6a1d850d18c, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:25:55.718754 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965c2ae-1ead-4e5b-bb72-80d7c6acc941 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:25:55.747478 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1219/2444] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:25:55 2022] PUT /identity/v3/projects/e314253d6a1c4669a77072312b5377f7/users/cf7d4c2c41494b62a9dea6a1d850d18c/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:25:55.752786 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40657dfc-d238-4e17-b3a6-100e37425269 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:25:55.753143 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40657dfc-d238-4e17-b3a6-100e37425269 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:25:55.753485 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40657dfc-d238-4e17-b3a6-100e37425269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:25:55.771332 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-40657dfc-d238-4e17-b3a6-100e37425269 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:25:55.772656 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-40657dfc-d238-4e17-b3a6-100e37425269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:25:55.856824 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1226/2445] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:25:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:25:55.866990 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965c2ae-1ead-4e5b-bb72-80d7c6acc941 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:25:55.869192 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-6965c2ae-1ead-4e5b-bb72-80d7c6acc941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:25:55.956905 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965c2ae-1ead-4e5b-bb72-80d7c6acc941 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:25:55.960896 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a27f3-5cd0-4828-8d56-0fecddbcd552 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:25:55.961582 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a27f3-5cd0-4828-8d56-0fecddbcd552 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:25:55.961895 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a27f3-5cd0-4828-8d56-0fecddbcd552 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:25:55.962172 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a27f3-5cd0-4828-8d56-0fecddbcd552 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:25:55.973341 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a27f3-5cd0-4828-8d56-0fecddbcd552 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:25:55.974918 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a27f3-5cd0-4828-8d56-0fecddbcd552 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:25:55.989916 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1220/2446] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:25:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:26:01.243174 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0da5e-ab68-4e20-9bbe-e44a9df06bb7 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:26:01.244424 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0da5e-ab68-4e20-9bbe-e44a9df06bb7 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:26:01.244928 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0da5e-ab68-4e20-9bbe-e44a9df06bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:26:01.284838 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-76b0da5e-ab68-4e20-9bbe-e44a9df06bb7 None None] MFA Rules not processed for user `cf7d4c2c41494b62a9dea6a1d850d18c`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:26:01.286503 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-76b0da5e-ab68-4e20-9bbe-e44a9df06bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:26:01.387578 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1227/2447] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:26:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:26:01.403740 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a27f3-5cd0-4828-8d56-0fecddbcd552 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:26:01.405200 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e24a27f3-5cd0-4828-8d56-0fecddbcd552 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:26:01.521874 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a27f3-5cd0-4828-8d56-0fecddbcd552 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:26:01.528103 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb3af3b-8562-4c02-bbe7-5a847267696a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7adaa2ef440941aa8214f2b2fd49b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:26:01.528778 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3af3b-8562-4c02-bbe7-5a847267696a service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:26:01.529051 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3af3b-8562-4c02-bbe7-5a847267696a service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:26:01.529324 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3af3b-8562-4c02-bbe7-5a847267696a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:26:01.534653 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:26:01.538495 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb3af3b-8562-4c02-bbe7-5a847267696a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:26:01.540495 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb3af3b-8562-4c02-bbe7-5a847267696a service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:26:01.557937 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1221/2448] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:26:01 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:26:02.942627 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe6994-a10a-40a9-8d4c-011fd54a0785 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:26:02.943249 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe6994-a10a-40a9-8d4c-011fd54a0785 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:26:02.943249 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe6994-a10a-40a9-8d4c-011fd54a0785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:26:02.962660 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-1dbe6994-a10a-40a9-8d4c-011fd54a0785 None None] MFA Rules not processed for user `cf7d4c2c41494b62a9dea6a1d850d18c`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:26:02.963907 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1dbe6994-a10a-40a9-8d4c-011fd54a0785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:26:02.972099 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1228/2449] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:26:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:26:06.346699 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb3af3b-8562-4c02-bbe7-5a847267696a service nova] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:26:06.361524 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb3af3b-8562-4c02-bbe7-5a847267696a service nova] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:26:06.366105 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd9441c-5a38-4a37-a3c3-481c09b5dc0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:26:06.367223 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9441c-5a38-4a37-a3c3-481c09b5dc0b service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:26:06.367807 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9441c-5a38-4a37-a3c3-481c09b5dc0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:26:06.368199 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9441c-5a38-4a37-a3c3-481c09b5dc0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:26:06.370315 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-8cd9441c-5a38-4a37-a3c3-481c09b5dc0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:26:06.395145 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd9441c-5a38-4a37-a3c3-481c09b5dc0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:26:06.396914 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd9441c-5a38-4a37-a3c3-481c09b5dc0b service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:26:06.420727 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1222/2450] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:26:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:26:12.956842 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=73,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:26:14.633004 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627304f-7c45-4999-8652-2c938070a53f None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:26:14.633598 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627304f-7c45-4999-8652-2c938070a53f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:26:14.633598 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627304f-7c45-4999-8652-2c938070a53f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:26:14.653116 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-a627304f-7c45-4999-8652-2c938070a53f None None] MFA Rules not processed for user `e876198e863542518f9f932eb61f3403`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:26:14.654389 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a627304f-7c45-4999-8652-2c938070a53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:26:14.715418 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1229/2451] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:26:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:26:16.407099 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=9 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:26:20.068380 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd9441c-5a38-4a37-a3c3-481c09b5dc0b service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:26:20.077352 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd9441c-5a38-4a37-a3c3-481c09b5dc0b service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:26:20.081362 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e4b8f4-fb45-41a2-9eed-41f31b0eea99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:26:20.082037 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e4b8f4-fb45-41a2-9eed-41f31b0eea99 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:26:20.082317 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e4b8f4-fb45-41a2-9eed-41f31b0eea99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:26:20.082592 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e4b8f4-fb45-41a2-9eed-41f31b0eea99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:26:20.084451 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-98e4b8f4-fb45-41a2-9eed-41f31b0eea99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:26:20.152897 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e4b8f4-fb45-41a2-9eed-41f31b0eea99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:26:20.154432 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e4b8f4-fb45-41a2-9eed-41f31b0eea99 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:26:20.165120 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1223/2452] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:26:20 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:26:24.708883 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=25 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:26:30.160864 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=30 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:26:38.217683 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a627304f-7c45-4999-8652-2c938070a53f None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:26:38.237205 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a627304f-7c45-4999-8652-2c938070a53f None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:26:38.246462 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664eaa24-52ff-481d-9392-00a54d7e222b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7adaa2ef440941aa8214f2b2fd49b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:26:38.247491 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664eaa24-52ff-481d-9392-00a54d7e222b service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:26:38.247931 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664eaa24-52ff-481d-9392-00a54d7e222b service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:26:38.248366 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664eaa24-52ff-481d-9392-00a54d7e222b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:26:38.250494 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-664eaa24-52ff-481d-9392-00a54d7e222b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:26:38.332135 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664eaa24-52ff-481d-9392-00a54d7e222b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:26:38.333969 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664eaa24-52ff-481d-9392-00a54d7e222b service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:26:38.344810 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1230/2453] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:26:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:26:46.600976 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e4b8f4-fb45-41a2-9eed-41f31b0eea99 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:26:46.615512 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e4b8f4-fb45-41a2-9eed-41f31b0eea99 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:26:46.622271 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c986f-df5d-4891-9a3c-b79475fccc5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7adaa2ef440941aa8214f2b2fd49b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:26:46.622959 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c986f-df5d-4891-9a3c-b79475fccc5c service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:26:46.623298 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c986f-df5d-4891-9a3c-b79475fccc5c service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:26:46.623781 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c986f-df5d-4891-9a3c-b79475fccc5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:26:46.626176 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-cd1c986f-df5d-4891-9a3c-b79475fccc5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:26:46.639590 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1c986f-df5d-4891-9a3c-b79475fccc5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:26:46.641203 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1c986f-df5d-4891-9a3c-b79475fccc5c service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:26:46.665667 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1224/2454] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:26:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:26:48.339690 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=28 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:26:49.520041 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e54079-6d2b-46eb-9944-590b319f8151 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:26:49.520664 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e54079-6d2b-46eb-9944-590b319f8151 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:26:49.520664 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e54079-6d2b-46eb-9944-590b319f8151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:26:49.538454 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e8e54079-6d2b-46eb-9944-590b319f8151 None None] MFA Rules not processed for user `f2f7f01eb34a486aa78320673c7f1c0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:26:49.539672 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e8e54079-6d2b-46eb-9944-590b319f8151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:26:49.547028 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1231/2455] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:26:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:26:49.892400 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c986f-df5d-4891-9a3c-b79475fccc5c service nova] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:26:49.902418 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c986f-df5d-4891-9a3c-b79475fccc5c service nova] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:26:49.906597 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f2acdf-9348-43a1-b721-bc02ce8cf740 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:26:49.907228 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2acdf-9348-43a1-b721-bc02ce8cf740 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:26:49.907509 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2acdf-9348-43a1-b721-bc02ce8cf740 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:26:49.907782 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2acdf-9348-43a1-b721-bc02ce8cf740 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:26:49.910119 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-c8f2acdf-9348-43a1-b721-bc02ce8cf740 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:26:49.920736 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f2acdf-9348-43a1-b721-bc02ce8cf740 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:26:49.922225 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f2acdf-9348-43a1-b721-bc02ce8cf740 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:26:49.933420 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1225/2456] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:26:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:26:50.265074 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e54079-6d2b-46eb-9944-590b319f8151 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:26:50.266619 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e8e54079-6d2b-46eb-9944-590b319f8151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:26:50.341491 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e54079-6d2b-46eb-9944-590b319f8151 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:26:50.347119 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7273e5f0-0cf0-426b-a0db-0e23aafb0f8c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '286a99b42d9246db909040bf8ab18ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:26:50.347766 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273e5f0-0cf0-426b-a0db-0e23aafb0f8c service placement] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:26:50.348066 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273e5f0-0cf0-426b-a0db-0e23aafb0f8c service placement] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:26:50.348341 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273e5f0-0cf0-426b-a0db-0e23aafb0f8c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:26:50.350231 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7273e5f0-0cf0-426b-a0db-0e23aafb0f8c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:26:50.361972 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7273e5f0-0cf0-426b-a0db-0e23aafb0f8c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:26:50.363570 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7273e5f0-0cf0-426b-a0db-0e23aafb0f8c service placement] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:26:50.373562 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1232/2457] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:26:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:26:52.259375 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f2acdf-9348-43a1-b721-bc02ce8cf740 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:26:52.261088 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-c8f2acdf-9348-43a1-b721-bc02ce8cf740 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:26:52.272411 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f2acdf-9348-43a1-b721-bc02ce8cf740 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:26:52.276545 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6acdaf-c07f-40a9-b173-f16c6e99f4c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:26:52.277188 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6acdaf-c07f-40a9-b173-f16c6e99f4c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:26:52.277471 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6acdaf-c07f-40a9-b173-f16c6e99f4c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:26:52.277787 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6acdaf-c07f-40a9-b173-f16c6e99f4c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:26:52.279826 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-7b6acdaf-c07f-40a9-b173-f16c6e99f4c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:26:52.291266 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6acdaf-c07f-40a9-b173-f16c6e99f4c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:26:52.292725 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6acdaf-c07f-40a9-b173-f16c6e99f4c9 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:26:52.302567 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1226/2458] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:26:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:27:00.369448 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=35 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:27:02.298732 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=18 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:27:02.407170 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7273e5f0-0cf0-426b-a0db-0e23aafb0f8c service placement] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:02.422505 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7273e5f0-0cf0-426b-a0db-0e23aafb0f8c service placement] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:02.430050 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae483f1e-5dfd-4433-bdca-5084ef688fdb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7adaa2ef440941aa8214f2b2fd49b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:02.430710 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae483f1e-5dfd-4433-bdca-5084ef688fdb service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:02.430986 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae483f1e-5dfd-4433-bdca-5084ef688fdb service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:02.431255 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae483f1e-5dfd-4433-bdca-5084ef688fdb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:02.433230 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ae483f1e-5dfd-4433-bdca-5084ef688fdb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:27:02.447143 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae483f1e-5dfd-4433-bdca-5084ef688fdb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:02.448725 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae483f1e-5dfd-4433-bdca-5084ef688fdb service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:02.460448 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1233/2459] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:27:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:27:11.703679 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79647b05-5095-4172-9676-2c9de89ccf2c None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:11.704256 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79647b05-5095-4172-9676-2c9de89ccf2c None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:11.704256 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79647b05-5095-4172-9676-2c9de89ccf2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:11.762399 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-79647b05-5095-4172-9676-2c9de89ccf2c None None] MFA Rules not processed for user `cad33601754a462c828566fb54c6e100`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:27:11.763916 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-79647b05-5095-4172-9676-2c9de89ccf2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:27:11.840092 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1227/2460] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Jun 29 12:27:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:27:11.910907 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae483f1e-5dfd-4433-bdca-5084ef688fdb service nova] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:11.912878 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ae483f1e-5dfd-4433-bdca-5084ef688fdb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:27:12.008542 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae483f1e-5dfd-4433-bdca-5084ef688fdb service nova] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:12.013948 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ea621-139e-47b9-a951-7df3c0780d0b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc92f8232bda407c84365eb10ede737f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:12.014711 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ea621-139e-47b9-a951-7df3c0780d0b service swift] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:12.014994 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ea621-139e-47b9-a951-7df3c0780d0b service swift] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:12.015269 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ea621-139e-47b9-a951-7df3c0780d0b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:12.023716 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407ea621-139e-47b9-a951-7df3c0780d0b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:12.025311 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407ea621-139e-47b9-a951-7df3c0780d0b service swift] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:12.034347 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1234/2461] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Jun 29 12:27:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 12:27:12.484649 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79647b05-5095-4172-9676-2c9de89ccf2c None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:12.511322 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79647b05-5095-4172-9676-2c9de89ccf2c None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:12.533343 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e474bf-93b2-4041-a14b-e74de884a478 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7adaa2ef440941aa8214f2b2fd49b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:12.534316 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e474bf-93b2-4041-a14b-e74de884a478 service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:12.534598 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e474bf-93b2-4041-a14b-e74de884a478 service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:12.535088 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e474bf-93b2-4041-a14b-e74de884a478 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:12.536940 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-b8e474bf-93b2-4041-a14b-e74de884a478 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:27:12.561493 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e474bf-93b2-4041-a14b-e74de884a478 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:12.563786 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e474bf-93b2-4041-a14b-e74de884a478 service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:12.583522 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1228/2462] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:27:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:27:22.030389 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=47 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:27:22.577943 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=46 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:27:24.849247 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda2a99-8e76-4bd5-bec0-8c647762a9ee None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:24.849909 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda2a99-8e76-4bd5-bec0-8c647762a9ee None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:24.849909 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda2a99-8e76-4bd5-bec0-8c647762a9ee None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:24.851478 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1235/2463] 10.222.0.27 () {54 vars in 921 bytes} [Wed Jun 29 12:27:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:27:24.858656 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bbf0e6-d184-452c-8397-3484c7ba10a1 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:24.858656 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bbf0e6-d184-452c-8397-3484c7ba10a1 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:24.859303 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bbf0e6-d184-452c-8397-3484c7ba10a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:24.899496 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-17bbf0e6-d184-452c-8397-3484c7ba10a1 None None] MFA Rules not processed for user `7adaa2ef440941aa8214f2b2fd49b54e`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:27:24.900733 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-17bbf0e6-d184-452c-8397-3484c7ba10a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:27:24.910184 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1229/2464] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Jun 29 12:27:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:27:24.921992 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda2a99-8e76-4bd5-bec0-8c647762a9ee None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:24.923689 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-acda2a99-8e76-4bd5-bec0-8c647762a9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:27:24.987972 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda2a99-8e76-4bd5-bec0-8c647762a9ee None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:24.992828 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698329c3-264a-496f-bb17-a7a05845441d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd865d1b935a54ca2b44beda5b0277336', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:24.993659 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698329c3-264a-496f-bb17-a7a05845441d service glance] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:24.993970 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698329c3-264a-496f-bb17-a7a05845441d service glance] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:24.994345 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698329c3-264a-496f-bb17-a7a05845441d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:25.004832 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698329c3-264a-496f-bb17-a7a05845441d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:25.006343 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698329c3-264a-496f-bb17-a7a05845441d service glance] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:25.021920 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1236/2465] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:27:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:27:25.101369 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1434ae6-3a7b-42e6-94c4-70ed4c0d9a2d None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:25.101644 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1434ae6-3a7b-42e6-94c4-70ed4c0d9a2d None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:25.101964 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1434ae6-3a7b-42e6-94c4-70ed4c0d9a2d None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:25.103345 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1230/2466] 10.222.0.27 () {54 vars in 921 bytes} [Wed Jun 29 12:27:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:27:25.108946 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8af29a-52e6-43f7-967b-107a28dadd34 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:25.109233 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8af29a-52e6-43f7-967b-107a28dadd34 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:25.109516 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8af29a-52e6-43f7-967b-107a28dadd34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:25.129450 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-8e8af29a-52e6-43f7-967b-107a28dadd34 None None] MFA Rules not processed for user `e94618bb382d46f7aaa2ef8f5d690bf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:27:25.130736 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8e8af29a-52e6-43f7-967b-107a28dadd34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:27:25.138321 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1237/2467] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Jun 29 12:27:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:27:25.150443 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1434ae6-3a7b-42e6-94c4-70ed4c0d9a2d None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:25.162125 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1434ae6-3a7b-42e6-94c4-70ed4c0d9a2d None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:25.166365 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7523ad-990d-4ff3-ac8a-d03faaeb8d02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:25.167094 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7523ad-990d-4ff3-ac8a-d03faaeb8d02 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:25.167384 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7523ad-990d-4ff3-ac8a-d03faaeb8d02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:25.167662 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7523ad-990d-4ff3-ac8a-d03faaeb8d02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:25.175648 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7523ad-990d-4ff3-ac8a-d03faaeb8d02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:25.177093 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7523ad-990d-4ff3-ac8a-d03faaeb8d02 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:25.185793 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1231/2468] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:27:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:27:25.271406 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643373e-fded-4911-8ea5-f503bba330b3 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:25.271828 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643373e-fded-4911-8ea5-f503bba330b3 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:25.272108 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643373e-fded-4911-8ea5-f503bba330b3 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:25.273630 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1238/2469] 10.222.0.27 () {54 vars in 921 bytes} [Wed Jun 29 12:27:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:27:25.279403 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2f78b-1582-49cf-83cb-42612e392b61 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:25.279687 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2f78b-1582-49cf-83cb-42612e392b61 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:25.280334 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2f78b-1582-49cf-83cb-42612e392b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:25.299112 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-9bf2f78b-1582-49cf-83cb-42612e392b61 None None] MFA Rules not processed for user `7adaa2ef440941aa8214f2b2fd49b54e`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:27:25.300336 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-9bf2f78b-1582-49cf-83cb-42612e392b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:27:25.311268 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1232/2470] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Jun 29 12:27:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:27:25.323655 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8643373e-fded-4911-8ea5-f503bba330b3 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:25.336481 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8643373e-fded-4911-8ea5-f503bba330b3 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:25.340965 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f0f3e3-b48f-432d-bb9d-adddb45a3db9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:25.341453 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0f3e3-b48f-432d-bb9d-adddb45a3db9 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:25.341757 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0f3e3-b48f-432d-bb9d-adddb45a3db9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:25.342031 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0f3e3-b48f-432d-bb9d-adddb45a3db9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:25.353285 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f0f3e3-b48f-432d-bb9d-adddb45a3db9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:25.354774 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f0f3e3-b48f-432d-bb9d-adddb45a3db9 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:25.366320 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1239/2471] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:27:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:27:27.459884 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa39016-5109-485d-823c-445c96752881 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:27.460416 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa39016-5109-485d-823c-445c96752881 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:27.460416 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa39016-5109-485d-823c-445c96752881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:27.479254 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-7fa39016-5109-485d-823c-445c96752881 None None] MFA Rules not processed for user `cad33601754a462c828566fb54c6e100`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:27:27.480443 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-7fa39016-5109-485d-823c-445c96752881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:27:27.489239 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1233/2472] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Jun 29 12:27:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:27:27.501486 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f0f3e3-b48f-432d-bb9d-adddb45a3db9 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:27.513175 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f0f3e3-b48f-432d-bb9d-adddb45a3db9 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:27.518242 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36e64c8-d677-4fef-b115-542319b01d6c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc92f8232bda407c84365eb10ede737f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:27.518890 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e64c8-d677-4fef-b115-542319b01d6c service swift] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:27.519173 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e64c8-d677-4fef-b115-542319b01d6c service swift] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:27.519448 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e64c8-d677-4fef-b115-542319b01d6c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:27.528580 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36e64c8-d677-4fef-b115-542319b01d6c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:27.530221 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36e64c8-d677-4fef-b115-542319b01d6c service swift] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:27.539091 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1240/2473] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Jun 29 12:27:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 12:27:29.534081 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa39016-5109-485d-823c-445c96752881 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:29.537360 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-7fa39016-5109-485d-823c-445c96752881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:27:29.567900 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa39016-5109-485d-823c-445c96752881 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:29.573046 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0738b-f2f8-4308-8f9d-f9871d792ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:29.574047 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0738b-f2f8-4308-8f9d-f9871d792ef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:29.574511 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0738b-f2f8-4308-8f9d-f9871d792ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:29.574873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0738b-f2f8-4308-8f9d-f9871d792ef3 admin admin] PATH_INFO: `/v3/users/e876198e863542518f9f932eb61f3403` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:29.576607 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec0738b-f2f8-4308-8f9d-f9871d792ef3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e876198e863542518f9f932eb61f3403)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:29.578719 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec0738b-f2f8-4308-8f9d-f9871d792ef3 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:29.638723 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-eec0738b-f2f8-4308-8f9d-f9871d792ef3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e876198e863542518f9f932eb61f3403'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:27:29.654120 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-eec0738b-f2f8-4308-8f9d-f9871d792ef3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e876198e863542518f9f932eb61f3403'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:27:29.663283 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-eec0738b-f2f8-4308-8f9d-f9871d792ef3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e876198e863542518f9f932eb61f3403'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:27:29.664308 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-eec0738b-f2f8-4308-8f9d-f9871d792ef3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e876198e863542518f9f932eb61f3403'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:27:29.675406 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-eec0738b-f2f8-4308-8f9d-f9871d792ef3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e876198e863542518f9f932eb61f3403'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:27:29.684410 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1234/2474] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:27:29 2022] DELETE /identity/v3/users/e876198e863542518f9f932eb61f3403 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:27:29.695445 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36e64c8-d677-4fef-b115-542319b01d6c service swift] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:29.706467 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36e64c8-d677-4fef-b115-542319b01d6c service swift] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:29.763430 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1defad8b-6449-4d73-acb7-ce857984b3e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:29.764262 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1defad8b-6449-4d73-acb7-ce857984b3e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:29.764546 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1defad8b-6449-4d73-acb7-ce857984b3e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:29.764864 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1defad8b-6449-4d73-acb7-ce857984b3e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:29.766933 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1defad8b-6449-4d73-acb7-ce857984b3e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:27:29.843843 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1defad8b-6449-4d73-acb7-ce857984b3e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:29.845311 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1defad8b-6449-4d73-acb7-ce857984b3e8 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:29.856014 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1241/2475] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:27:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:27:30.059443 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0738b-f2f8-4308-8f9d-f9871d792ef3 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:30.061385 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-eec0738b-f2f8-4308-8f9d-f9871d792ef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:27:30.087115 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0738b-f2f8-4308-8f9d-f9871d792ef3 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:30.093050 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd87f7c5-d8c6-43a9-81f5-b7dd310048bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:30.094322 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87f7c5-d8c6-43a9-81f5-b7dd310048bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:30.094603 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87f7c5-d8c6-43a9-81f5-b7dd310048bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:30.094948 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87f7c5-d8c6-43a9-81f5-b7dd310048bf admin admin] PATH_INFO: `/v3/projects/9a2d788bddf640f38058e215c0f7ac46` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:30.096319 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd87f7c5-d8c6-43a9-81f5-b7dd310048bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a2d788bddf640f38058e215c0f7ac46)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:30.098346 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd87f7c5-d8c6-43a9-81f5-b7dd310048bf admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:30.157012 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-bd87f7c5-d8c6-43a9-81f5-b7dd310048bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a2d788bddf640f38058e215c0f7ac46', 'request_id': 'req-bd87f7c5-d8c6-43a9-81f5-b7dd310048bf'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:27:30.163904 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-bd87f7c5-d8c6-43a9-81f5-b7dd310048bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a2d788bddf640f38058e215c0f7ac46', 'request_id': 'req-bd87f7c5-d8c6-43a9-81f5-b7dd310048bf'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:27:30.175340 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-bd87f7c5-d8c6-43a9-81f5-b7dd310048bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a2d788bddf640f38058e215c0f7ac46', 'request_id': 'req-bd87f7c5-d8c6-43a9-81f5-b7dd310048bf'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:27:30.192596 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-bd87f7c5-d8c6-43a9-81f5-b7dd310048bf admin admin] The token cache is being invalidate because project 9a2d788bddf640f38058e215c0f7ac46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:27:30.192953 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-bd87f7c5-d8c6-43a9-81f5-b7dd310048bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:27:30.194993 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-bd87f7c5-d8c6-43a9-81f5-b7dd310048bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:27:30.196574 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1235/2476] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:27:30 2022] DELETE /identity/v3/projects/9a2d788bddf640f38058e215c0f7ac46 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:27:30.201821 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd7aec-da51-47ed-999c-52535ec7b78d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:30.202498 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd7aec-da51-47ed-999c-52535ec7b78d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:30.203043 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd7aec-da51-47ed-999c-52535ec7b78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:30.232266 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-11dd7aec-da51-47ed-999c-52535ec7b78d None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:27:30.233960 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-11dd7aec-da51-47ed-999c-52535ec7b78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:27:30.251923 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:27:30.313493 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1242/2477] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:27:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:27:30.321646 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a571357-63e6-470f-87f9-4c320df67ed6 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:30.322099 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a571357-63e6-470f-87f9-4c320df67ed6 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:30.322450 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a571357-63e6-470f-87f9-4c320df67ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:30.346934 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-5a571357-63e6-470f-87f9-4c320df67ed6 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:27:30.348546 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-5a571357-63e6-470f-87f9-4c320df67ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:27:30.358553 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1236/2478] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:27:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:27:30.363619 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd7aec-da51-47ed-999c-52535ec7b78d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:30.378007 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd7aec-da51-47ed-999c-52535ec7b78d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:30.395555 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb8d8c7-efb8-45a8-a916-bf81f1e0783e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:30.397907 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8d8c7-efb8-45a8-a916-bf81f1e0783e admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:30.398380 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8d8c7-efb8-45a8-a916-bf81f1e0783e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:30.398767 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8d8c7-efb8-45a8-a916-bf81f1e0783e admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:30.399617 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb8d8c7-efb8-45a8-a916-bf81f1e0783e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:27:30.400038 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb8d8c7-efb8-45a8-a916-bf81f1e0783e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:30.401835 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb8d8c7-efb8-45a8-a916-bf81f1e0783e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:30.419900 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1243/2479] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:27:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:27:30.421300 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a571357-63e6-470f-87f9-4c320df67ed6 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:30.426263 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:27:30.438569 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a571357-63e6-470f-87f9-4c320df67ed6 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:30.447101 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a67b8-6f90-4ecb-857a-a452a1f6c21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:30.447931 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a67b8-6f90-4ecb-857a-a452a1f6c21d admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:30.448295 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a67b8-6f90-4ecb-857a-a452a1f6c21d admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:30.448627 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a67b8-6f90-4ecb-857a-a452a1f6c21d admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:30.449365 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435a67b8-6f90-4ecb-857a-a452a1f6c21d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:30.451446 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435a67b8-6f90-4ecb-857a-a452a1f6c21d admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:30.517106 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1237/2480] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:27:30 2022] POST /identity/v3/projects => generated 379 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:27:30.521638 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb8d8c7-efb8-45a8-a916-bf81f1e0783e admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:30.536023 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb8d8c7-efb8-45a8-a916-bf81f1e0783e admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:30.617523 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b38d12-5308-4c61-af25-f7de860f2272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:30.618341 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b38d12-5308-4c61-af25-f7de860f2272 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:30.618686 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b38d12-5308-4c61-af25-f7de860f2272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:30.619030 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b38d12-5308-4c61-af25-f7de860f2272 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:30.619789 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b38d12-5308-4c61-af25-f7de860f2272 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:30.621935 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b38d12-5308-4c61-af25-f7de860f2272 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:30.643250 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1244/2481] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:27:30 2022] POST /identity/v3/users => generated 290 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:27:30.648016 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a67b8-6f90-4ecb-857a-a452a1f6c21d admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:30.659168 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a67b8-6f90-4ecb-857a-a452a1f6c21d admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:30.664162 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad60b87-f33d-4836-a9f1-08d42d888ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:30.664842 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad60b87-f33d-4836-a9f1-08d42d888ec5 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:30.665125 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad60b87-f33d-4836-a9f1-08d42d888ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:30.665402 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad60b87-f33d-4836-a9f1-08d42d888ec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:30.666179 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad60b87-f33d-4836-a9f1-08d42d888ec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:30.667799 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad60b87-f33d-4836-a9f1-08d42d888ec5 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:30.679564 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1238/2482] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:27:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:27:30.683832 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b38d12-5308-4c61-af25-f7de860f2272 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:30.697535 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b38d12-5308-4c61-af25-f7de860f2272 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:30.706759 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480fcbd-4220-4b6c-91f9-744ada9ecca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:30.707621 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480fcbd-4220-4b6c-91f9-744ada9ecca8 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:30.707971 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480fcbd-4220-4b6c-91f9-744ada9ecca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:30.708338 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480fcbd-4220-4b6c-91f9-744ada9ecca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:30.709248 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480fcbd-4220-4b6c-91f9-744ada9ecca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:30.711124 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480fcbd-4220-4b6c-91f9-744ada9ecca8 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:30.722436 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1245/2483] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:27:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:27:30.727732 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad60b87-f33d-4836-a9f1-08d42d888ec5 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:30.739567 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad60b87-f33d-4836-a9f1-08d42d888ec5 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:30.745252 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349b56f-751a-4870-9c06-a3d6894ccf8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:30.746220 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349b56f-751a-4870-9c06-a3d6894ccf8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:30.746531 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349b56f-751a-4870-9c06-a3d6894ccf8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:30.747016 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349b56f-751a-4870-9c06-a3d6894ccf8d admin admin] PATH_INFO: `/v3/projects/d269f45399694504932bbd982c51c979/users/a8b41d03f08a4169aac6b5ff587b9624/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:30.764923 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5349b56f-751a-4870-9c06-a3d6894ccf8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d269f45399694504932bbd982c51c979, user_id=a8b41d03f08a4169aac6b5ff587b9624, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:30.767666 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5349b56f-751a-4870-9c06-a3d6894ccf8d admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:30.783024 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1239/2484] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:27:30 2022] PUT /identity/v3/projects/d269f45399694504932bbd982c51c979/users/a8b41d03f08a4169aac6b5ff587b9624/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:27:30.794915 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9debb6c-dff3-4982-ad34-fe5686db01ba None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:30.795204 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9debb6c-dff3-4982-ad34-fe5686db01ba None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:30.795684 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9debb6c-dff3-4982-ad34-fe5686db01ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:30.826210 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-d9debb6c-dff3-4982-ad34-fe5686db01ba None None] MFA Rules not processed for user `a8b41d03f08a4169aac6b5ff587b9624`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:27:30.827451 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d9debb6c-dff3-4982-ad34-fe5686db01ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:27:30.906062 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1246/2485] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:27:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:27:30.910697 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349b56f-751a-4870-9c06-a3d6894ccf8d admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:30.992062 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349b56f-751a-4870-9c06-a3d6894ccf8d admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:30.996836 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf32b5-9ea6-45ca-8051-f31743c81ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:30.997565 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf32b5-9ea6-45ca-8051-f31743c81ed2 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:30.997888 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf32b5-9ea6-45ca-8051-f31743c81ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:30.998125 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf32b5-9ea6-45ca-8051-f31743c81ed2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:30.998982 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faf32b5-9ea6-45ca-8051-f31743c81ed2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:31.000812 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faf32b5-9ea6-45ca-8051-f31743c81ed2 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:31.057157 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1240/2486] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:27:30 2022] POST /identity/v3/projects => generated 381 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:27:31.061134 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9debb6c-dff3-4982-ad34-fe5686db01ba None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:31.073105 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9debb6c-dff3-4982-ad34-fe5686db01ba None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:31.102312 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:27:31.157081 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2cebfe-9976-472d-9689-3ca8a05b28f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:31.157804 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2cebfe-9976-472d-9689-3ca8a05b28f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:31.158115 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2cebfe-9976-472d-9689-3ca8a05b28f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:31.158393 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2cebfe-9976-472d-9689-3ca8a05b28f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:31.159111 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2cebfe-9976-472d-9689-3ca8a05b28f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:31.161098 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2cebfe-9976-472d-9689-3ca8a05b28f2 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:31.188458 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1247/2487] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:27:31 2022] POST /identity/v3/users => generated 297 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:27:31.195783 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf32b5-9ea6-45ca-8051-f31743c81ed2 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:31.207164 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf32b5-9ea6-45ca-8051-f31743c81ed2 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:31.218519 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24c36b-8032-48d2-8a89-ca57b5ecbf99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:31.219221 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24c36b-8032-48d2-8a89-ca57b5ecbf99 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:31.219507 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24c36b-8032-48d2-8a89-ca57b5ecbf99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:31.219784 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24c36b-8032-48d2-8a89-ca57b5ecbf99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:31.220678 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd24c36b-8032-48d2-8a89-ca57b5ecbf99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:31.222354 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd24c36b-8032-48d2-8a89-ca57b5ecbf99 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:31.237570 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1241/2488] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:27:31 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:27:31.246512 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2cebfe-9976-472d-9689-3ca8a05b28f2 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:31.263812 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2cebfe-9976-472d-9689-3ca8a05b28f2 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:31.268857 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4779d662-bb7a-4ba9-8ad5-4c9ce03d51e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:31.269937 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779d662-bb7a-4ba9-8ad5-4c9ce03d51e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:31.270259 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779d662-bb7a-4ba9-8ad5-4c9ce03d51e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:31.270532 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779d662-bb7a-4ba9-8ad5-4c9ce03d51e5 admin admin] PATH_INFO: `/v3/projects/6764749b0dd9438ab0590a2d3ed34e99/users/6c0bb4e13a5b4a2bb3ff3dfa255263d2/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:31.293575 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4779d662-bb7a-4ba9-8ad5-4c9ce03d51e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6764749b0dd9438ab0590a2d3ed34e99, user_id=6c0bb4e13a5b4a2bb3ff3dfa255263d2, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:31.296574 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4779d662-bb7a-4ba9-8ad5-4c9ce03d51e5 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:31.319528 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1248/2489] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:27:31 2022] PUT /identity/v3/projects/6764749b0dd9438ab0590a2d3ed34e99/users/6c0bb4e13a5b4a2bb3ff3dfa255263d2/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:27:31.324890 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24c36b-8032-48d2-8a89-ca57b5ecbf99 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:31.342135 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24c36b-8032-48d2-8a89-ca57b5ecbf99 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:31.440095 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe5a0f3-b9d0-4abc-9455-9bd972e05e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:31.440936 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe5a0f3-b9d0-4abc-9455-9bd972e05e82 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:31.441256 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe5a0f3-b9d0-4abc-9455-9bd972e05e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:31.441539 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe5a0f3-b9d0-4abc-9455-9bd972e05e82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:31.442391 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe5a0f3-b9d0-4abc-9455-9bd972e05e82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:31.444325 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe5a0f3-b9d0-4abc-9455-9bd972e05e82 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:31.459228 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1242/2490] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:27:31 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:27:31.460931 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4779d662-bb7a-4ba9-8ad5-4c9ce03d51e5 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:31.472007 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4779d662-bb7a-4ba9-8ad5-4c9ce03d51e5 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:31.479769 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a32ef89-bcb1-4ec2-9b9a-94311b1da138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:31.480687 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32ef89-bcb1-4ec2-9b9a-94311b1da138 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:31.480966 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32ef89-bcb1-4ec2-9b9a-94311b1da138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:31.481265 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32ef89-bcb1-4ec2-9b9a-94311b1da138 admin admin] PATH_INFO: `/v3/projects/6764749b0dd9438ab0590a2d3ed34e99/users/6c0bb4e13a5b4a2bb3ff3dfa255263d2/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:31.483320 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a32ef89-bcb1-4ec2-9b9a-94311b1da138 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6764749b0dd9438ab0590a2d3ed34e99, user_id=6c0bb4e13a5b4a2bb3ff3dfa255263d2, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:31.486146 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a32ef89-bcb1-4ec2-9b9a-94311b1da138 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:31.502303 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1249/2491] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:27:31 2022] PUT /identity/v3/projects/6764749b0dd9438ab0590a2d3ed34e99/users/6c0bb4e13a5b4a2bb3ff3dfa255263d2/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:27:31.514209 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37617179-f282-4579-abde-3ac4c106f42f None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:31.514494 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37617179-f282-4579-abde-3ac4c106f42f None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:31.514769 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37617179-f282-4579-abde-3ac4c106f42f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:31.529608 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:27:31.558480 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-37617179-f282-4579-abde-3ac4c106f42f None None] MFA Rules not processed for user `6c0bb4e13a5b4a2bb3ff3dfa255263d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:27:31.559815 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-37617179-f282-4579-abde-3ac4c106f42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:27:31.706687 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1243/2492] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:27:31 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:27:31.726677 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a32ef89-bcb1-4ec2-9b9a-94311b1da138 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:31.729865 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5a32ef89-bcb1-4ec2-9b9a-94311b1da138 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:27:31.824873 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a32ef89-bcb1-4ec2-9b9a-94311b1da138 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:31.828986 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff6dff-cf73-4b55-94c5-7395b730d63d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:31.829887 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff6dff-cf73-4b55-94c5-7395b730d63d service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:31.830180 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff6dff-cf73-4b55-94c5-7395b730d63d service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:31.830452 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff6dff-cf73-4b55-94c5-7395b730d63d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:31.841457 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ff6dff-cf73-4b55-94c5-7395b730d63d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:31.842951 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ff6dff-cf73-4b55-94c5-7395b730d63d service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:31.854459 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1250/2493] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:27:31 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:27:31.938471 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37617179-f282-4579-abde-3ac4c106f42f None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:31.948527 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37617179-f282-4579-abde-3ac4c106f42f None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:31.952409 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c0898-016b-45c3-be4c-b7de2162815c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:31.953183 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c0898-016b-45c3-be4c-b7de2162815c service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:31.953512 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c0898-016b-45c3-be4c-b7de2162815c service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:31.953819 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c0898-016b-45c3-be4c-b7de2162815c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:32.047496 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8c0898-016b-45c3-be4c-b7de2162815c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:32.055652 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8c0898-016b-45c3-be4c-b7de2162815c service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:32.069868 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1244/2494] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:27:31 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:27:39.208572 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff6dff-cf73-4b55-94c5-7395b730d63d service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:39.289975 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff6dff-cf73-4b55-94c5-7395b730d63d service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:39.297860 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96f5cf-486b-490f-8dc4-84f612ac1f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:39.298910 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96f5cf-486b-490f-8dc4-84f612ac1f83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:39.299311 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96f5cf-486b-490f-8dc4-84f612ac1f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:39.299462 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96f5cf-486b-490f-8dc4-84f612ac1f83 admin admin] PATH_INFO: `/v3/users/a8b41d03f08a4169aac6b5ff587b9624` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:39.300798 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e96f5cf-486b-490f-8dc4-84f612ac1f83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8b41d03f08a4169aac6b5ff587b9624)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:39.303545 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e96f5cf-486b-490f-8dc4-84f612ac1f83 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:39.321659 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:27:39.369496 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3e96f5cf-486b-490f-8dc4-84f612ac1f83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8b41d03f08a4169aac6b5ff587b9624'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:27:39.370069 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3e96f5cf-486b-490f-8dc4-84f612ac1f83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8b41d03f08a4169aac6b5ff587b9624'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:27:39.370683 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3e96f5cf-486b-490f-8dc4-84f612ac1f83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8b41d03f08a4169aac6b5ff587b9624'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:27:39.384427 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3e96f5cf-486b-490f-8dc4-84f612ac1f83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8b41d03f08a4169aac6b5ff587b9624'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:27:39.393985 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3e96f5cf-486b-490f-8dc4-84f612ac1f83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8b41d03f08a4169aac6b5ff587b9624'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:27:39.406548 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1251/2495] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:27:39 2022] DELETE /identity/v3/users/a8b41d03f08a4169aac6b5ff587b9624 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:27:39.411386 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c084ee-59bd-47f9-b34d-0b970834157e None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:39.412094 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c084ee-59bd-47f9-b34d-0b970834157e None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:39.412094 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c084ee-59bd-47f9-b34d-0b970834157e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:39.435472 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-58c084ee-59bd-47f9-b34d-0b970834157e None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:27:39.436635 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-58c084ee-59bd-47f9-b34d-0b970834157e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:27:39.505368 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1245/2496] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:27:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:27:39.515692 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96f5cf-486b-490f-8dc4-84f612ac1f83 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:39.517864 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3e96f5cf-486b-490f-8dc4-84f612ac1f83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:27:39.582056 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96f5cf-486b-490f-8dc4-84f612ac1f83 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:39.586235 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62155e-b408-4c65-a628-a13271f6e337 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:39.586878 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62155e-b408-4c65-a628-a13271f6e337 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:39.587154 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62155e-b408-4c65-a628-a13271f6e337 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:39.587409 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62155e-b408-4c65-a628-a13271f6e337 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:39.597028 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62155e-b408-4c65-a628-a13271f6e337 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:39.598495 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62155e-b408-4c65-a628-a13271f6e337 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:39.608249 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1252/2497] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:27:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:27:39.923800 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c084ee-59bd-47f9-b34d-0b970834157e None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:39.925427 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-58c084ee-59bd-47f9-b34d-0b970834157e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:27:39.946850 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c084ee-59bd-47f9-b34d-0b970834157e None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:39.952021 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b072233-1382-47a9-ae00-0f5b97770e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:39.953068 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b072233-1382-47a9-ae00-0f5b97770e56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:39.953387 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b072233-1382-47a9-ae00-0f5b97770e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:39.953855 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b072233-1382-47a9-ae00-0f5b97770e56 admin admin] PATH_INFO: `/v3/projects/d269f45399694504932bbd982c51c979` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:39.955152 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b072233-1382-47a9-ae00-0f5b97770e56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d269f45399694504932bbd982c51c979)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:39.957109 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b072233-1382-47a9-ae00-0f5b97770e56 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:39.992334 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:27:40.012579 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-5b072233-1382-47a9-ae00-0f5b97770e56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd269f45399694504932bbd982c51c979', 'request_id': 'req-5b072233-1382-47a9-ae00-0f5b97770e56'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:27:40.018490 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-5b072233-1382-47a9-ae00-0f5b97770e56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd269f45399694504932bbd982c51c979', 'request_id': 'req-5b072233-1382-47a9-ae00-0f5b97770e56'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:27:40.027576 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-5b072233-1382-47a9-ae00-0f5b97770e56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd269f45399694504932bbd982c51c979', 'request_id': 'req-5b072233-1382-47a9-ae00-0f5b97770e56'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:27:40.041395 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-5b072233-1382-47a9-ae00-0f5b97770e56 admin admin] The token cache is being invalidate because project d269f45399694504932bbd982c51c979 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:27:40.041844 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-5b072233-1382-47a9-ae00-0f5b97770e56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:27:40.042587 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-5b072233-1382-47a9-ae00-0f5b97770e56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:27:40.044171 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1246/2498] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:27:39 2022] DELETE /identity/v3/projects/d269f45399694504932bbd982c51c979 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:27:40.048397 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62155e-b408-4c65-a628-a13271f6e337 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:40.064568 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62155e-b408-4c65-a628-a13271f6e337 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:40.133162 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3634a-9fc3-4b02-af79-bb5677ea3aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:40.133993 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3634a-9fc3-4b02-af79-bb5677ea3aba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:40.134278 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3634a-9fc3-4b02-af79-bb5677ea3aba admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:40.134555 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3634a-9fc3-4b02-af79-bb5677ea3aba admin admin] PATH_INFO: `/v3/users/6c0bb4e13a5b4a2bb3ff3dfa255263d2` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:40.135770 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d3634a-9fc3-4b02-af79-bb5677ea3aba admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c0bb4e13a5b4a2bb3ff3dfa255263d2)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:40.137714 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d3634a-9fc3-4b02-af79-bb5677ea3aba admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:40.181579 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:27:40.192383 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-53d3634a-9fc3-4b02-af79-bb5677ea3aba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c0bb4e13a5b4a2bb3ff3dfa255263d2'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:27:40.193025 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-53d3634a-9fc3-4b02-af79-bb5677ea3aba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c0bb4e13a5b4a2bb3ff3dfa255263d2'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:27:40.193902 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-53d3634a-9fc3-4b02-af79-bb5677ea3aba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c0bb4e13a5b4a2bb3ff3dfa255263d2'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:27:40.206296 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-53d3634a-9fc3-4b02-af79-bb5677ea3aba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c0bb4e13a5b4a2bb3ff3dfa255263d2'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:27:40.215547 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-53d3634a-9fc3-4b02-af79-bb5677ea3aba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c0bb4e13a5b4a2bb3ff3dfa255263d2'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:27:40.229424 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1253/2499] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:27:40 2022] DELETE /identity/v3/users/6c0bb4e13a5b4a2bb3ff3dfa255263d2 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:27:40.522584 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b072233-1382-47a9-ae00-0f5b97770e56 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:40.524426 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-5b072233-1382-47a9-ae00-0f5b97770e56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:27:40.544115 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b072233-1382-47a9-ae00-0f5b97770e56 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:40.609544 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c0d6b6-d05a-44fc-bf0f-3fa2dcb8c311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:40.610603 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0d6b6-d05a-44fc-bf0f-3fa2dcb8c311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:40.610887 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0d6b6-d05a-44fc-bf0f-3fa2dcb8c311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:40.611146 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0d6b6-d05a-44fc-bf0f-3fa2dcb8c311 admin admin] PATH_INFO: `/v3/projects/6764749b0dd9438ab0590a2d3ed34e99` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:40.612425 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c0d6b6-d05a-44fc-bf0f-3fa2dcb8c311 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6764749b0dd9438ab0590a2d3ed34e99)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:40.614477 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c0d6b6-d05a-44fc-bf0f-3fa2dcb8c311 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:40.665913 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-56c0d6b6-d05a-44fc-bf0f-3fa2dcb8c311 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6764749b0dd9438ab0590a2d3ed34e99', 'request_id': 'req-56c0d6b6-d05a-44fc-bf0f-3fa2dcb8c311'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:27:40.671977 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-56c0d6b6-d05a-44fc-bf0f-3fa2dcb8c311 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6764749b0dd9438ab0590a2d3ed34e99', 'request_id': 'req-56c0d6b6-d05a-44fc-bf0f-3fa2dcb8c311'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:27:40.680517 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-56c0d6b6-d05a-44fc-bf0f-3fa2dcb8c311 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6764749b0dd9438ab0590a2d3ed34e99', 'request_id': 'req-56c0d6b6-d05a-44fc-bf0f-3fa2dcb8c311'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:27:40.693574 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-56c0d6b6-d05a-44fc-bf0f-3fa2dcb8c311 admin admin] The token cache is being invalidate because project 6764749b0dd9438ab0590a2d3ed34e99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:27:40.694379 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-56c0d6b6-d05a-44fc-bf0f-3fa2dcb8c311 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:27:40.695036 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-56c0d6b6-d05a-44fc-bf0f-3fa2dcb8c311 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:27:40.696901 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1247/2500] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:27:40 2022] DELETE /identity/v3/projects/6764749b0dd9438ab0590a2d3ed34e99 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:27:40.702401 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1334b5-a85a-4ca9-908f-10076076469e None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:40.702750 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1334b5-a85a-4ca9-908f-10076076469e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:40.703061 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1334b5-a85a-4ca9-908f-10076076469e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:40.726567 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-ae1334b5-a85a-4ca9-908f-10076076469e None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:27:40.727766 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ae1334b5-a85a-4ca9-908f-10076076469e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:27:40.800059 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1254/2501] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:27:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:27:40.808616 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cef320-05a5-451d-8c91-43627593e9a9 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:40.808944 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cef320-05a5-451d-8c91-43627593e9a9 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:40.809226 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cef320-05a5-451d-8c91-43627593e9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:40.831554 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-38cef320-05a5-451d-8c91-43627593e9a9 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:27:40.833877 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-38cef320-05a5-451d-8c91-43627593e9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:27:40.842347 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1248/2502] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:27:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:27:40.846474 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1334b5-a85a-4ca9-908f-10076076469e None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:40.857205 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1334b5-a85a-4ca9-908f-10076076469e None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:40.862781 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53fa13-8f2f-4879-9274-4cd8b5ce9b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:40.862781 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53fa13-8f2f-4879-9274-4cd8b5ce9b73 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:40.863080 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53fa13-8f2f-4879-9274-4cd8b5ce9b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:40.863242 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53fa13-8f2f-4879-9274-4cd8b5ce9b73 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:40.864071 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af53fa13-8f2f-4879-9274-4cd8b5ce9b73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:27:40.864380 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af53fa13-8f2f-4879-9274-4cd8b5ce9b73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:40.866086 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af53fa13-8f2f-4879-9274-4cd8b5ce9b73 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:40.878391 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1255/2503] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:27:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:27:40.882805 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cef320-05a5-451d-8c91-43627593e9a9 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:40.893727 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cef320-05a5-451d-8c91-43627593e9a9 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:40.899228 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee995dbe-8d41-4f85-a5a7-0b6f7844f12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:40.899905 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee995dbe-8d41-4f85-a5a7-0b6f7844f12a admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:40.900189 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee995dbe-8d41-4f85-a5a7-0b6f7844f12a admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:40.900462 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee995dbe-8d41-4f85-a5a7-0b6f7844f12a admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:40.901226 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee995dbe-8d41-4f85-a5a7-0b6f7844f12a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:40.903520 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee995dbe-8d41-4f85-a5a7-0b6f7844f12a admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:40.934854 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1249/2504] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:27:40 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:27:40.938768 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53fa13-8f2f-4879-9274-4cd8b5ce9b73 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:40.949493 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53fa13-8f2f-4879-9274-4cd8b5ce9b73 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:41.009863 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f0ec4-3b29-41f5-98b9-dc7af38ad1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:41.010537 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f0ec4-3b29-41f5-98b9-dc7af38ad1cc admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:41.010818 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f0ec4-3b29-41f5-98b9-dc7af38ad1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:41.011087 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f0ec4-3b29-41f5-98b9-dc7af38ad1cc admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:41.011795 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8f0ec4-3b29-41f5-98b9-dc7af38ad1cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:41.013713 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8f0ec4-3b29-41f5-98b9-dc7af38ad1cc admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:41.044827 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1256/2505] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:27:40 2022] POST /identity/v3/users => generated 288 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:27:41.049757 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee995dbe-8d41-4f85-a5a7-0b6f7844f12a admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:41.062092 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee995dbe-8d41-4f85-a5a7-0b6f7844f12a admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:41.066868 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8c4256-8ce2-45ea-bd30-bb5da9f08721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:41.067580 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c4256-8ce2-45ea-bd30-bb5da9f08721 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:41.067865 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c4256-8ce2-45ea-bd30-bb5da9f08721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:41.068167 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c4256-8ce2-45ea-bd30-bb5da9f08721 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:41.068918 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8c4256-8ce2-45ea-bd30-bb5da9f08721 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:41.070748 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8c4256-8ce2-45ea-bd30-bb5da9f08721 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:41.082358 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1250/2506] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:27:41.087321 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f0ec4-3b29-41f5-98b9-dc7af38ad1cc admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:41.097561 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f0ec4-3b29-41f5-98b9-dc7af38ad1cc admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:41.103384 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc6461-edef-48dc-a64a-f6d13e3096f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:41.104059 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc6461-edef-48dc-a64a-f6d13e3096f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:41.104343 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc6461-edef-48dc-a64a-f6d13e3096f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:41.104642 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc6461-edef-48dc-a64a-f6d13e3096f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:41.105351 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cc6461-edef-48dc-a64a-f6d13e3096f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:41.106991 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cc6461-edef-48dc-a64a-f6d13e3096f2 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:41.124454 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1257/2507] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:27:41.129471 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8c4256-8ce2-45ea-bd30-bb5da9f08721 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:41.136382 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:27:41.141092 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8c4256-8ce2-45ea-bd30-bb5da9f08721 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:41.148029 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8011bab-0962-4c5f-bb8e-562c27175c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:41.148874 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8011bab-0962-4c5f-bb8e-562c27175c61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:41.149154 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8011bab-0962-4c5f-bb8e-562c27175c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:41.149422 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8011bab-0962-4c5f-bb8e-562c27175c61 admin admin] PATH_INFO: `/v3/projects/7952caf682cc4dc792c495ae973d16b2/users/b9933d0a1bb042b9ad2dbf830ae1fdb8/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:41.169184 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8011bab-0962-4c5f-bb8e-562c27175c61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7952caf682cc4dc792c495ae973d16b2, user_id=b9933d0a1bb042b9ad2dbf830ae1fdb8, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:41.171819 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8011bab-0962-4c5f-bb8e-562c27175c61 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:41.189574 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1251/2508] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:27:41 2022] PUT /identity/v3/projects/7952caf682cc4dc792c495ae973d16b2/users/b9933d0a1bb042b9ad2dbf830ae1fdb8/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:27:41.200370 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee967b6c-6b37-49c2-bf59-d59cfcb2336a None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:41.200671 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee967b6c-6b37-49c2-bf59-d59cfcb2336a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:41.201080 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee967b6c-6b37-49c2-bf59-d59cfcb2336a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:41.229734 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-ee967b6c-6b37-49c2-bf59-d59cfcb2336a None None] MFA Rules not processed for user `b9933d0a1bb042b9ad2dbf830ae1fdb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:27:41.231051 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ee967b6c-6b37-49c2-bf59-d59cfcb2336a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:27:41.236502 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:27:41.305555 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1258/2509] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:27:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:27:41.310263 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8011bab-0962-4c5f-bb8e-562c27175c61 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:41.379558 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8011bab-0962-4c5f-bb8e-562c27175c61 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:41.384806 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4658dd-9185-4d7b-a7c5-f7cc1b11f2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:41.385468 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4658dd-9185-4d7b-a7c5-f7cc1b11f2c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:41.385771 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4658dd-9185-4d7b-a7c5-f7cc1b11f2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:41.386045 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4658dd-9185-4d7b-a7c5-f7cc1b11f2c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:41.386735 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4658dd-9185-4d7b-a7c5-f7cc1b11f2c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:41.388629 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4658dd-9185-4d7b-a7c5-f7cc1b11f2c8 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:41.418244 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1252/2510] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:27:41 2022] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:27:41.422665 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee967b6c-6b37-49c2-bf59-d59cfcb2336a None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:41.437516 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee967b6c-6b37-49c2-bf59-d59cfcb2336a None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:41.507185 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72749cfe-4396-4fe7-9e03-e1d73be2624c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:41.507944 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72749cfe-4396-4fe7-9e03-e1d73be2624c admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:41.508221 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72749cfe-4396-4fe7-9e03-e1d73be2624c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:41.508543 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72749cfe-4396-4fe7-9e03-e1d73be2624c admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:41.509312 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72749cfe-4396-4fe7-9e03-e1d73be2624c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:41.511265 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72749cfe-4396-4fe7-9e03-e1d73be2624c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:41.533326 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1259/2511] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:27:41 2022] POST /identity/v3/users => generated 295 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:27:41.537582 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4658dd-9185-4d7b-a7c5-f7cc1b11f2c8 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:41.548290 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4658dd-9185-4d7b-a7c5-f7cc1b11f2c8 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:41.554075 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7922dd96-cf93-476e-bfcb-d1b465ee9e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:41.554737 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7922dd96-cf93-476e-bfcb-d1b465ee9e3c admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:41.555048 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7922dd96-cf93-476e-bfcb-d1b465ee9e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:41.555309 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7922dd96-cf93-476e-bfcb-d1b465ee9e3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:41.556049 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7922dd96-cf93-476e-bfcb-d1b465ee9e3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:41.557680 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7922dd96-cf93-476e-bfcb-d1b465ee9e3c admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:41.569302 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1253/2512] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:27:41.573374 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72749cfe-4396-4fe7-9e03-e1d73be2624c admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:41.583498 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72749cfe-4396-4fe7-9e03-e1d73be2624c admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:41.589526 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa2fb5d-2f58-42bd-9589-10beea64923e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:41.590503 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2fb5d-2f58-42bd-9589-10beea64923e admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:41.590782 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2fb5d-2f58-42bd-9589-10beea64923e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:41.591051 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2fb5d-2f58-42bd-9589-10beea64923e admin admin] PATH_INFO: `/v3/projects/f37b3231df99494caa4db32efb0a9fbd/users/423d661190c94a708635e4c4cad31684/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:41.607866 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa2fb5d-2f58-42bd-9589-10beea64923e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f37b3231df99494caa4db32efb0a9fbd, user_id=423d661190c94a708635e4c4cad31684, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:41.610568 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa2fb5d-2f58-42bd-9589-10beea64923e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:41.626090 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1260/2513] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:27:41 2022] PUT /identity/v3/projects/f37b3231df99494caa4db32efb0a9fbd/users/423d661190c94a708635e4c4cad31684/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:27:41.631863 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7922dd96-cf93-476e-bfcb-d1b465ee9e3c admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:41.647219 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7922dd96-cf93-476e-bfcb-d1b465ee9e3c admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:41.706525 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b101fb54-e560-49a0-aacb-1f2b7a55931c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:41.707234 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101fb54-e560-49a0-aacb-1f2b7a55931c admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:41.707600 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101fb54-e560-49a0-aacb-1f2b7a55931c admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:41.707964 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101fb54-e560-49a0-aacb-1f2b7a55931c admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:41.708836 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b101fb54-e560-49a0-aacb-1f2b7a55931c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:41.710814 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b101fb54-e560-49a0-aacb-1f2b7a55931c admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:41.729787 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1254/2514] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:27:41.731157 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa2fb5d-2f58-42bd-9589-10beea64923e admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:41.742440 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa2fb5d-2f58-42bd-9589-10beea64923e admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:41.748310 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dea506-22a4-45f2-87d5-e8bdd24ff1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:41.749195 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dea506-22a4-45f2-87d5-e8bdd24ff1b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:41.749472 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dea506-22a4-45f2-87d5-e8bdd24ff1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:41.749786 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dea506-22a4-45f2-87d5-e8bdd24ff1b6 admin admin] PATH_INFO: `/v3/projects/f37b3231df99494caa4db32efb0a9fbd/users/423d661190c94a708635e4c4cad31684/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:41.752001 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dea506-22a4-45f2-87d5-e8bdd24ff1b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f37b3231df99494caa4db32efb0a9fbd, user_id=423d661190c94a708635e4c4cad31684, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:41.754692 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dea506-22a4-45f2-87d5-e8bdd24ff1b6 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:41.766964 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1261/2515] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:27:41 2022] PUT /identity/v3/projects/f37b3231df99494caa4db32efb0a9fbd/users/423d661190c94a708635e4c4cad31684/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:27:41.779790 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bab762-2d81-4109-9e64-77ac183c55c7 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:41.780289 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bab762-2d81-4109-9e64-77ac183c55c7 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:41.780789 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bab762-2d81-4109-9e64-77ac183c55c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:41.817899 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-f9bab762-2d81-4109-9e64-77ac183c55c7 None None] MFA Rules not processed for user `423d661190c94a708635e4c4cad31684`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:27:41.819364 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-f9bab762-2d81-4109-9e64-77ac183c55c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:27:41.862426 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:27:41.897485 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1255/2516] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:27:41 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:27:41.909014 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dea506-22a4-45f2-87d5-e8bdd24ff1b6 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:41.911130 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c2dea506-22a4-45f2-87d5-e8bdd24ff1b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:27:41.981994 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dea506-22a4-45f2-87d5-e8bdd24ff1b6 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:41.986553 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aff155-6353-4ac5-b318-202891e43937 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:41.987227 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aff155-6353-4ac5-b318-202891e43937 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:41.987529 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aff155-6353-4ac5-b318-202891e43937 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:41.987780 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aff155-6353-4ac5-b318-202891e43937 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:42.001534 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:27:42.073585 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aff155-6353-4ac5-b318-202891e43937 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:42.077473 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aff155-6353-4ac5-b318-202891e43937 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:42.087887 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1262/2517] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:27:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:27:42.558779 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc44fe-0400-4f5e-912a-861e3a290597 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:42.559322 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc44fe-0400-4f5e-912a-861e3a290597 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:42.559322 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc44fe-0400-4f5e-912a-861e3a290597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:42.581075 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-54cc44fe-0400-4f5e-912a-861e3a290597 None None] MFA Rules not processed for user `cad33601754a462c828566fb54c6e100`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:27:42.582304 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-54cc44fe-0400-4f5e-912a-861e3a290597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:27:42.654510 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1256/2518] 10.222.0.27 () {58 vars in 967 bytes} [Wed Jun 29 12:27:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:27:42.669962 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aff155-6353-4ac5-b318-202891e43937 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:42.672559 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-29aff155-6353-4ac5-b318-202891e43937 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:27:42.750418 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aff155-6353-4ac5-b318-202891e43937 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:42.755812 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd7967-9bd7-414f-bbe3-8fa6b14ead28 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc92f8232bda407c84365eb10ede737f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:42.756722 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd7967-9bd7-414f-bbe3-8fa6b14ead28 service swift] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:42.757007 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd7967-9bd7-414f-bbe3-8fa6b14ead28 service swift] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:42.757992 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd7967-9bd7-414f-bbe3-8fa6b14ead28 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:42.768456 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cd7967-9bd7-414f-bbe3-8fa6b14ead28 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:42.770189 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cd7967-9bd7-414f-bbe3-8fa6b14ead28 service swift] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:42.779799 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1263/2519] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Jun 29 12:27:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 12:27:44.699053 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc44fe-0400-4f5e-912a-861e3a290597 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:44.700627 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-54cc44fe-0400-4f5e-912a-861e3a290597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:27:44.713747 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc44fe-0400-4f5e-912a-861e3a290597 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:44.717625 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a554303-6a3d-4f01-9f71-e155c47680cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:44.718291 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a554303-6a3d-4f01-9f71-e155c47680cb service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:44.718687 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a554303-6a3d-4f01-9f71-e155c47680cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:44.718964 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a554303-6a3d-4f01-9f71-e155c47680cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:44.729028 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a554303-6a3d-4f01-9f71-e155c47680cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:44.730494 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a554303-6a3d-4f01-9f71-e155c47680cb service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:44.740113 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1257/2520] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:27:44 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:27:52.776182 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=53 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:27:54.431800 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd7967-9bd7-414f-bbe3-8fa6b14ead28 service swift] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:54.434015 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-30cd7967-9bd7-414f-bbe3-8fa6b14ead28 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:27:54.494478 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd7967-9bd7-414f-bbe3-8fa6b14ead28 service swift] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:54.500058 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf7f2fa-aef1-4e9c-b874-c7b78efef6f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:54.500774 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7f2fa-aef1-4e9c-b874-c7b78efef6f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:54.501049 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7f2fa-aef1-4e9c-b874-c7b78efef6f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:54.501396 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7f2fa-aef1-4e9c-b874-c7b78efef6f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:54.504662 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-acf7f2fa-aef1-4e9c-b874-c7b78efef6f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:27:54.580834 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf7f2fa-aef1-4e9c-b874-c7b78efef6f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:54.582190 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf7f2fa-aef1-4e9c-b874-c7b78efef6f9 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:54.593296 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1264/2521] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:27:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:27:54.735784 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=42 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:27:57.452002 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a554303-6a3d-4f01-9f71-e155c47680cb service cinder] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:57.466948 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a554303-6a3d-4f01-9f71-e155c47680cb service cinder] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:57.474731 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb9774-a310-4c8c-867f-90bbb8b5a7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:57.475677 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb9774-a310-4c8c-867f-90bbb8b5a7b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:57.475959 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb9774-a310-4c8c-867f-90bbb8b5a7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:57.476230 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb9774-a310-4c8c-867f-90bbb8b5a7b1 admin admin] PATH_INFO: `/v3/users/b9933d0a1bb042b9ad2dbf830ae1fdb8` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:57.477790 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeb9774-a310-4c8c-867f-90bbb8b5a7b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9933d0a1bb042b9ad2dbf830ae1fdb8)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:57.479709 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeb9774-a310-4c8c-867f-90bbb8b5a7b1 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:57.555678 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-feeb9774-a310-4c8c-867f-90bbb8b5a7b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9933d0a1bb042b9ad2dbf830ae1fdb8'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:27:57.592120 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-feeb9774-a310-4c8c-867f-90bbb8b5a7b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9933d0a1bb042b9ad2dbf830ae1fdb8'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:27:57.600433 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-feeb9774-a310-4c8c-867f-90bbb8b5a7b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9933d0a1bb042b9ad2dbf830ae1fdb8'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:27:57.601176 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-feeb9774-a310-4c8c-867f-90bbb8b5a7b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9933d0a1bb042b9ad2dbf830ae1fdb8'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:27:57.618336 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-feeb9774-a310-4c8c-867f-90bbb8b5a7b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9933d0a1bb042b9ad2dbf830ae1fdb8'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:27:57.626180 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1258/2522] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:27:57 2022] DELETE /identity/v3/users/b9933d0a1bb042b9ad2dbf830ae1fdb8 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:27:57.631202 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced30cd4-60fc-45e7-8df1-7f08af549b9d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:57.631730 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced30cd4-60fc-45e7-8df1-7f08af549b9d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:57.631730 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced30cd4-60fc-45e7-8df1-7f08af549b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:57.655689 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-ced30cd4-60fc-45e7-8df1-7f08af549b9d None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:27:57.657199 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ced30cd4-60fc-45e7-8df1-7f08af549b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:27:57.740928 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1265/2523] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:27:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:27:57.746861 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb9774-a310-4c8c-867f-90bbb8b5a7b1 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:57.749620 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-feeb9774-a310-4c8c-867f-90bbb8b5a7b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:27:57.837594 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb9774-a310-4c8c-867f-90bbb8b5a7b1 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:57.842583 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2fa6c6-1d20-4934-a50e-48abf30693d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:57.843445 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2fa6c6-1d20-4934-a50e-48abf30693d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:57.843727 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2fa6c6-1d20-4934-a50e-48abf30693d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:57.844030 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2fa6c6-1d20-4934-a50e-48abf30693d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:57.857107 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2fa6c6-1d20-4934-a50e-48abf30693d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:57.858623 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2fa6c6-1d20-4934-a50e-48abf30693d3 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:57.869654 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1259/2524] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:27:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:27:58.171707 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced30cd4-60fc-45e7-8df1-7f08af549b9d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:58.173228 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ced30cd4-60fc-45e7-8df1-7f08af549b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:27:58.187145 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced30cd4-60fc-45e7-8df1-7f08af549b9d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:58.193008 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe511a52-4256-45ba-a7d1-f0313e2c9a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:58.194722 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe511a52-4256-45ba-a7d1-f0313e2c9a92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:58.195267 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe511a52-4256-45ba-a7d1-f0313e2c9a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:58.195727 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe511a52-4256-45ba-a7d1-f0313e2c9a92 admin admin] PATH_INFO: `/v3/projects/7952caf682cc4dc792c495ae973d16b2` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:58.197186 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe511a52-4256-45ba-a7d1-f0313e2c9a92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7952caf682cc4dc792c495ae973d16b2)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:58.199560 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe511a52-4256-45ba-a7d1-f0313e2c9a92 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:58.224249 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2fa6c6-1d20-4934-a50e-48abf30693d3 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:58.225988 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-7c2fa6c6-1d20-4934-a50e-48abf30693d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:27:58.259969 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:27:58.265626 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fe511a52-4256-45ba-a7d1-f0313e2c9a92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7952caf682cc4dc792c495ae973d16b2', 'request_id': 'req-fe511a52-4256-45ba-a7d1-f0313e2c9a92'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:27:58.273401 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fe511a52-4256-45ba-a7d1-f0313e2c9a92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7952caf682cc4dc792c495ae973d16b2', 'request_id': 'req-fe511a52-4256-45ba-a7d1-f0313e2c9a92'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:27:58.285297 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fe511a52-4256-45ba-a7d1-f0313e2c9a92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7952caf682cc4dc792c495ae973d16b2', 'request_id': 'req-fe511a52-4256-45ba-a7d1-f0313e2c9a92'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:27:58.298635 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fe511a52-4256-45ba-a7d1-f0313e2c9a92 admin admin] The token cache is being invalidate because project 7952caf682cc4dc792c495ae973d16b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:27:58.298837 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fe511a52-4256-45ba-a7d1-f0313e2c9a92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:27:58.299631 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fe511a52-4256-45ba-a7d1-f0313e2c9a92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:27:58.301332 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1266/2525] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:27:58 2022] DELETE /identity/v3/projects/7952caf682cc4dc792c495ae973d16b2 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:27:58.302145 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe511a52-4256-45ba-a7d1-f0313e2c9a92 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:58.303826 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-fe511a52-4256-45ba-a7d1-f0313e2c9a92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:27:58.320133 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2fa6c6-1d20-4934-a50e-48abf30693d3 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:58.333480 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:27:58.370240 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe511a52-4256-45ba-a7d1-f0313e2c9a92 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:58.377658 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca0f60f-7e87-49ba-921b-96c6b71bd47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:58.379163 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0f60f-7e87-49ba-921b-96c6b71bd47b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:58.379311 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0f60f-7e87-49ba-921b-96c6b71bd47b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:58.379593 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0f60f-7e87-49ba-921b-96c6b71bd47b admin admin] PATH_INFO: `/v3/users/f2f7f01eb34a486aa78320673c7f1c0d` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:58.381049 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca0f60f-7e87-49ba-921b-96c6b71bd47b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2f7f01eb34a486aa78320673c7f1c0d)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:58.384030 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca0f60f-7e87-49ba-921b-96c6b71bd47b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:58.389339 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3cfec8-2052-42b8-b793-30479bf6717c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '286a99b42d9246db909040bf8ab18ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:58.390139 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3cfec8-2052-42b8-b793-30479bf6717c service placement] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:58.390478 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3cfec8-2052-42b8-b793-30479bf6717c service placement] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:58.390811 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3cfec8-2052-42b8-b793-30479bf6717c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:58.392685 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ff3cfec8-2052-42b8-b793-30479bf6717c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:27:58.405053 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3cfec8-2052-42b8-b793-30479bf6717c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:58.406778 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3cfec8-2052-42b8-b793-30479bf6717c service placement] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:58.421493 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1260/2526] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:27:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:27:58.423084 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3cfec8-2052-42b8-b793-30479bf6717c service placement] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:58.426426 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ff3cfec8-2052-42b8-b793-30479bf6717c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:27:58.445778 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3cfec8-2052-42b8-b793-30479bf6717c service placement] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:58.450298 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-cca0f60f-7e87-49ba-921b-96c6b71bd47b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2f7f01eb34a486aa78320673c7f1c0d'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:27:58.451140 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-cca0f60f-7e87-49ba-921b-96c6b71bd47b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2f7f01eb34a486aa78320673c7f1c0d'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:27:58.451647 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377d696-a768-4220-8c66-d8e11406accd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:58.451914 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-cca0f60f-7e87-49ba-921b-96c6b71bd47b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2f7f01eb34a486aa78320673c7f1c0d'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:27:58.452532 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377d696-a768-4220-8c66-d8e11406accd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:58.452988 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377d696-a768-4220-8c66-d8e11406accd admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:58.453086 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377d696-a768-4220-8c66-d8e11406accd admin admin] PATH_INFO: `/v3/users/423d661190c94a708635e4c4cad31684` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:58.454411 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a377d696-a768-4220-8c66-d8e11406accd admin admin] RBAC: Authorizing `identity:delete_user(user_id=423d661190c94a708635e4c4cad31684)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:58.456412 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a377d696-a768-4220-8c66-d8e11406accd admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:58.470199 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-cca0f60f-7e87-49ba-921b-96c6b71bd47b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2f7f01eb34a486aa78320673c7f1c0d'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:27:58.484060 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-cca0f60f-7e87-49ba-921b-96c6b71bd47b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2f7f01eb34a486aa78320673c7f1c0d'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:27:58.498836 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1267/2527] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:27:58 2022] DELETE /identity/v3/users/f2f7f01eb34a486aa78320673c7f1c0d => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:27:58.513137 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a377d696-a768-4220-8c66-d8e11406accd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '423d661190c94a708635e4c4cad31684'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:27:58.527170 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a377d696-a768-4220-8c66-d8e11406accd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '423d661190c94a708635e4c4cad31684'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:27:58.537544 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a377d696-a768-4220-8c66-d8e11406accd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '423d661190c94a708635e4c4cad31684'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:27:58.538347 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a377d696-a768-4220-8c66-d8e11406accd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '423d661190c94a708635e4c4cad31684'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:27:58.549262 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a377d696-a768-4220-8c66-d8e11406accd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '423d661190c94a708635e4c4cad31684'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:27:58.559102 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1261/2528] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:27:58 2022] DELETE /identity/v3/users/423d661190c94a708635e4c4cad31684 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:27:58.707856 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca0f60f-7e87-49ba-921b-96c6b71bd47b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:58.709391 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-cca0f60f-7e87-49ba-921b-96c6b71bd47b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:27:58.774672 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:27:58.790050 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca0f60f-7e87-49ba-921b-96c6b71bd47b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:58.854980 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7240ee-02ab-4665-9d26-9164d8564432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:58.855975 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7240ee-02ab-4665-9d26-9164d8564432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:58.856385 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7240ee-02ab-4665-9d26-9164d8564432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:58.856781 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7240ee-02ab-4665-9d26-9164d8564432 admin admin] PATH_INFO: `/v3/projects/dd94b52299d4428998033fcc17fd7bc6` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:58.858051 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7240ee-02ab-4665-9d26-9164d8564432 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd94b52299d4428998033fcc17fd7bc6)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:58.860224 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7240ee-02ab-4665-9d26-9164d8564432 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:58.870525 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377d696-a768-4220-8c66-d8e11406accd admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:58.872168 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a377d696-a768-4220-8c66-d8e11406accd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:27:58.886868 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377d696-a768-4220-8c66-d8e11406accd admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:58.892387 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15b323-6319-47ba-99ce-90d72aa806f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:58.893275 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15b323-6319-47ba-99ce-90d72aa806f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:58.893629 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15b323-6319-47ba-99ce-90d72aa806f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:58.893975 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15b323-6319-47ba-99ce-90d72aa806f0 admin admin] PATH_INFO: `/v3/projects/f37b3231df99494caa4db32efb0a9fbd` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:58.895105 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef15b323-6319-47ba-99ce-90d72aa806f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f37b3231df99494caa4db32efb0a9fbd)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:58.897104 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef15b323-6319-47ba-99ce-90d72aa806f0 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:58.915746 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fb7240ee-02ab-4665-9d26-9164d8564432 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd94b52299d4428998033fcc17fd7bc6', 'request_id': 'req-fb7240ee-02ab-4665-9d26-9164d8564432'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:27:58.923189 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fb7240ee-02ab-4665-9d26-9164d8564432 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd94b52299d4428998033fcc17fd7bc6', 'request_id': 'req-fb7240ee-02ab-4665-9d26-9164d8564432'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:27:58.933060 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fb7240ee-02ab-4665-9d26-9164d8564432 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd94b52299d4428998033fcc17fd7bc6', 'request_id': 'req-fb7240ee-02ab-4665-9d26-9164d8564432'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:27:58.945089 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fb7240ee-02ab-4665-9d26-9164d8564432 admin admin] The token cache is being invalidate because project dd94b52299d4428998033fcc17fd7bc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:27:58.945372 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fb7240ee-02ab-4665-9d26-9164d8564432 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:27:58.946147 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fb7240ee-02ab-4665-9d26-9164d8564432 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:27:58.947696 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1268/2529] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:27:58 2022] DELETE /identity/v3/projects/dd94b52299d4428998033fcc17fd7bc6 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:27:58.952750 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b500b9-8231-4fe0-aca3-1d97055f0215 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:58.953030 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b500b9-8231-4fe0-aca3-1d97055f0215 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:58.953305 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b500b9-8231-4fe0-aca3-1d97055f0215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:58.954681 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-ef15b323-6319-47ba-99ce-90d72aa806f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f37b3231df99494caa4db32efb0a9fbd', 'request_id': 'req-ef15b323-6319-47ba-99ce-90d72aa806f0'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:27:58.960319 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-ef15b323-6319-47ba-99ce-90d72aa806f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f37b3231df99494caa4db32efb0a9fbd', 'request_id': 'req-ef15b323-6319-47ba-99ce-90d72aa806f0'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:27:58.969125 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-ef15b323-6319-47ba-99ce-90d72aa806f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f37b3231df99494caa4db32efb0a9fbd', 'request_id': 'req-ef15b323-6319-47ba-99ce-90d72aa806f0'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:27:58.974378 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-75b500b9-8231-4fe0-aca3-1d97055f0215 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:27:58.976075 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-75b500b9-8231-4fe0-aca3-1d97055f0215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:27:58.981985 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-ef15b323-6319-47ba-99ce-90d72aa806f0 admin admin] The token cache is being invalidate because project f37b3231df99494caa4db32efb0a9fbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:27:58.982278 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-ef15b323-6319-47ba-99ce-90d72aa806f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:27:58.982938 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-ef15b323-6319-47ba-99ce-90d72aa806f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:27:58.984755 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1262/2530] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:27:58 2022] DELETE /identity/v3/projects/f37b3231df99494caa4db32efb0a9fbd => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:27:58.991448 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4fe8e-7e67-4943-b751-af02a8e8dc6b None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:58.991890 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4fe8e-7e67-4943-b751-af02a8e8dc6b None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:58.992424 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4fe8e-7e67-4943-b751-af02a8e8dc6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:58.999242 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:27:59.015101 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-8da4fe8e-7e67-4943-b751-af02a8e8dc6b None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:27:59.016362 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-8da4fe8e-7e67-4943-b751-af02a8e8dc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:27:59.050222 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1269/2531] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:27:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:27:59.054636 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a004bd-72d6-4442-a9e6-bedaa9d76245 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:59.054927 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a004bd-72d6-4442-a9e6-bedaa9d76245 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:59.055207 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a004bd-72d6-4442-a9e6-bedaa9d76245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:59.078879 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-d5a004bd-72d6-4442-a9e6-bedaa9d76245 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:27:59.080177 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d5a004bd-72d6-4442-a9e6-bedaa9d76245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:27:59.083736 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1263/2532] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:27:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:27:59.089878 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1270/2533] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:27:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:27:59.091791 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12d117-dcc3-4864-b6e0-72dd40813a91 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:59.092178 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12d117-dcc3-4864-b6e0-72dd40813a91 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:59.092360 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a004bd-72d6-4442-a9e6-bedaa9d76245 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:59.092468 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12d117-dcc3-4864-b6e0-72dd40813a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:59.102703 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a004bd-72d6-4442-a9e6-bedaa9d76245 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:59.107992 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f51b1-d22d-43cc-a56f-a19d5838c178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:59.108693 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f51b1-d22d-43cc-a56f-a19d5838c178 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:59.109003 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f51b1-d22d-43cc-a56f-a19d5838c178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:59.109251 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f51b1-d22d-43cc-a56f-a19d5838c178 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:59.110045 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376f51b1-d22d-43cc-a56f-a19d5838c178 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:27:59.110375 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376f51b1-d22d-43cc-a56f-a19d5838c178 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:59.112020 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376f51b1-d22d-43cc-a56f-a19d5838c178 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:59.114853 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-8b12d117-dcc3-4864-b6e0-72dd40813a91 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:27:59.116133 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-8b12d117-dcc3-4864-b6e0-72dd40813a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:27:59.125642 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1271/2534] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:27:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:27:59.128974 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1264/2535] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:27:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:27:59.130198 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f51b1-d22d-43cc-a56f-a19d5838c178 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:59.130366 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b12d117-dcc3-4864-b6e0-72dd40813a91 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:59.141262 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f51b1-d22d-43cc-a56f-a19d5838c178 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:59.143494 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b12d117-dcc3-4864-b6e0-72dd40813a91 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:59.146405 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7334c8-b73a-4107-9964-739355c9509e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:59.147152 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7334c8-b73a-4107-9964-739355c9509e admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:59.147403 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7334c8-b73a-4107-9964-739355c9509e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:59.147684 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7334c8-b73a-4107-9964-739355c9509e admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:59.148424 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7334c8-b73a-4107-9964-739355c9509e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:27:59.148534 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b87a1-3f60-4560-87b5-bd3265bb0e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:59.148737 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7334c8-b73a-4107-9964-739355c9509e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:59.149191 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b87a1-3f60-4560-87b5-bd3265bb0e06 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:59.149476 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b87a1-3f60-4560-87b5-bd3265bb0e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:59.149786 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b87a1-3f60-4560-87b5-bd3265bb0e06 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:59.150509 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7334c8-b73a-4107-9964-739355c9509e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:59.150618 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612b87a1-3f60-4560-87b5-bd3265bb0e06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:59.153216 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612b87a1-3f60-4560-87b5-bd3265bb0e06 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:59.160628 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:27:59.172067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1272/2536] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:27:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:27:59.173476 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7334c8-b73a-4107-9964-739355c9509e admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:59.185820 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7334c8-b73a-4107-9964-739355c9509e admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:59.191414 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f20ef61-f7d0-4666-914e-64c93932e0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:59.192140 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20ef61-f7d0-4666-914e-64c93932e0c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:59.192424 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20ef61-f7d0-4666-914e-64c93932e0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:59.192704 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20ef61-f7d0-4666-914e-64c93932e0c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:59.193418 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f20ef61-f7d0-4666-914e-64c93932e0c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:59.195425 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f20ef61-f7d0-4666-914e-64c93932e0c4 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:59.200914 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1265/2537] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:27:59 2022] POST /identity/v3/projects => generated 375 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:27:59.205314 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b87a1-3f60-4560-87b5-bd3265bb0e06 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:59.227795 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1273/2538] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:27:59 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:27:59.232424 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f20ef61-f7d0-4666-914e-64c93932e0c4 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:59.278834 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b87a1-3f60-4560-87b5-bd3265bb0e06 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:59.295524 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f20ef61-f7d0-4666-914e-64c93932e0c4 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:59.300261 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a9f29-735f-45d5-9788-22f9769fc79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:59.301253 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a9f29-735f-45d5-9788-22f9769fc79d admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:59.301535 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a9f29-735f-45d5-9788-22f9769fc79d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:59.301842 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a9f29-735f-45d5-9788-22f9769fc79d admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:59.302902 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929a9f29-735f-45d5-9788-22f9769fc79d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:59.304847 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929a9f29-735f-45d5-9788-22f9769fc79d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:59.331817 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1274/2539] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:27:59 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:27:59.332764 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a9f29-735f-45d5-9788-22f9769fc79d admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:59.342281 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deffc28f-5ea9-4c79-8daa-f77a7bf55f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:59.342959 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deffc28f-5ea9-4c79-8daa-f77a7bf55f74 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:59.343236 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deffc28f-5ea9-4c79-8daa-f77a7bf55f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:59.343503 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deffc28f-5ea9-4c79-8daa-f77a7bf55f74 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:59.343806 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a9f29-735f-45d5-9788-22f9769fc79d admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:59.344221 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deffc28f-5ea9-4c79-8daa-f77a7bf55f74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:59.346174 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deffc28f-5ea9-4c79-8daa-f77a7bf55f74 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:59.348796 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b4fb0-b346-4746-9f71-8f216160feef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:59.349462 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b4fb0-b346-4746-9f71-8f216160feef admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:59.349769 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b4fb0-b346-4746-9f71-8f216160feef admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:59.350042 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b4fb0-b346-4746-9f71-8f216160feef admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:59.350774 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b4fb0-b346-4746-9f71-8f216160feef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:59.352357 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b4fb0-b346-4746-9f71-8f216160feef admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:59.364051 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1275/2540] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:27:59.367521 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1266/2541] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:27:59 2022] POST /identity/v3/users => generated 288 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:27:59.367839 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b4fb0-b346-4746-9f71-8f216160feef admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:59.371381 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deffc28f-5ea9-4c79-8daa-f77a7bf55f74 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:59.379345 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b4fb0-b346-4746-9f71-8f216160feef admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:59.381073 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deffc28f-5ea9-4c79-8daa-f77a7bf55f74 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:59.384118 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52a854-6aa4-4cd1-876d-a79d372aa000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:59.384781 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52a854-6aa4-4cd1-876d-a79d372aa000 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:59.385128 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52a854-6aa4-4cd1-876d-a79d372aa000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:59.385401 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52a854-6aa4-4cd1-876d-a79d372aa000 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:59.385645 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81032e13-92d8-4b77-a22c-3dc395995524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:59.386157 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b52a854-6aa4-4cd1-876d-a79d372aa000 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:59.386333 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81032e13-92d8-4b77-a22c-3dc395995524 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:59.386615 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81032e13-92d8-4b77-a22c-3dc395995524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:59.386925 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81032e13-92d8-4b77-a22c-3dc395995524 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:59.387653 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81032e13-92d8-4b77-a22c-3dc395995524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:59.387944 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b52a854-6aa4-4cd1-876d-a79d372aa000 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:59.389295 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81032e13-92d8-4b77-a22c-3dc395995524 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:59.394682 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:27:59.399517 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1276/2542] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:27:59.402704 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1267/2543] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:27:59.403874 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52a854-6aa4-4cd1-876d-a79d372aa000 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:59.404018 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81032e13-92d8-4b77-a22c-3dc395995524 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:59.414109 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52a854-6aa4-4cd1-876d-a79d372aa000 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:59.414675 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81032e13-92d8-4b77-a22c-3dc395995524 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:59.419278 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9508df-83e8-4fc7-ad40-51362727d680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:59.419939 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9508df-83e8-4fc7-ad40-51362727d680 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:59.420076 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f44d5-636a-4650-aaa0-25233f5003fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:59.420236 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9508df-83e8-4fc7-ad40-51362727d680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:59.420487 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9508df-83e8-4fc7-ad40-51362727d680 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:59.420927 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f44d5-636a-4650-aaa0-25233f5003fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:59.421208 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f44d5-636a-4650-aaa0-25233f5003fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:59.421353 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9508df-83e8-4fc7-ad40-51362727d680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:59.421462 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f44d5-636a-4650-aaa0-25233f5003fc admin admin] PATH_INFO: `/v3/projects/223573e661c04ad7bbb685c8536c4cf8/users/cf64590002f0480f8653b2de3cd03482/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:59.422884 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9508df-83e8-4fc7-ad40-51362727d680 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:59.433974 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1277/2544] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:27:59.437828 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9508df-83e8-4fc7-ad40-51362727d680 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:59.438936 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5f44d5-636a-4650-aaa0-25233f5003fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=223573e661c04ad7bbb685c8536c4cf8, user_id=cf64590002f0480f8653b2de3cd03482, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:59.441916 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5f44d5-636a-4650-aaa0-25233f5003fc admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:59.448141 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9508df-83e8-4fc7-ad40-51362727d680 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:59.454294 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87712967-c673-4e24-9f85-785f2a7044fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:59.455181 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87712967-c673-4e24-9f85-785f2a7044fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:59.455622 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87712967-c673-4e24-9f85-785f2a7044fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:59.455897 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87712967-c673-4e24-9f85-785f2a7044fe admin admin] PATH_INFO: `/v3/projects/c595480b5abb4f1d8850295215e09531/users/38e4874643ce4b12a308a2857ed7c9c2/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:59.457094 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1268/2545] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:27:59 2022] PUT /identity/v3/projects/223573e661c04ad7bbb685c8536c4cf8/users/cf64590002f0480f8653b2de3cd03482/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:27:59.468519 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d682c51-4209-4db5-a798-d0696ee64a25 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:59.468811 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d682c51-4209-4db5-a798-d0696ee64a25 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:59.469131 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d682c51-4209-4db5-a798-d0696ee64a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:59.472412 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87712967-c673-4e24-9f85-785f2a7044fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=c595480b5abb4f1d8850295215e09531, user_id=38e4874643ce4b12a308a2857ed7c9c2, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:59.475125 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87712967-c673-4e24-9f85-785f2a7044fe admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:59.489516 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1278/2546] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:27:59 2022] PUT /identity/v3/projects/c595480b5abb4f1d8850295215e09531/users/38e4874643ce4b12a308a2857ed7c9c2/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:27:59.496327 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-4d682c51-4209-4db5-a798-d0696ee64a25 None None] MFA Rules not processed for user `cf64590002f0480f8653b2de3cd03482`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:27:59.497555 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-4d682c51-4209-4db5-a798-d0696ee64a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:27:59.501345 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c073c2-4843-450f-8243-75e8c6ad8df7 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:59.501627 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c073c2-4843-450f-8243-75e8c6ad8df7 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:59.502041 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c073c2-4843-450f-8243-75e8c6ad8df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:59.529152 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-41c073c2-4843-450f-8243-75e8c6ad8df7 None None] MFA Rules not processed for user `38e4874643ce4b12a308a2857ed7c9c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:27:59.530421 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-41c073c2-4843-450f-8243-75e8c6ad8df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:27:59.566504 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1269/2547] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:27:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:27:59.570944 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d682c51-4209-4db5-a798-d0696ee64a25 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:59.597370 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:27:59.602931 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1279/2548] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:27:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:27:59.613735 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c073c2-4843-450f-8243-75e8c6ad8df7 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:59.615169 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-41c073c2-4843-450f-8243-75e8c6ad8df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:27:59.636251 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d682c51-4209-4db5-a798-d0696ee64a25 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:59.641328 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac0e6f-3992-42b5-9273-e64422abe450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:59.642013 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac0e6f-3992-42b5-9273-e64422abe450 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:59.642290 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac0e6f-3992-42b5-9273-e64422abe450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:59.642561 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac0e6f-3992-42b5-9273-e64422abe450 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:59.643246 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ac0e6f-3992-42b5-9273-e64422abe450 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:59.645155 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ac0e6f-3992-42b5-9273-e64422abe450 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:59.672970 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1270/2549] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:27:59 2022] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:27:59.676959 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac0e6f-3992-42b5-9273-e64422abe450 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:59.692267 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c073c2-4843-450f-8243-75e8c6ad8df7 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:59.731322 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:27:59.742986 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac0e6f-3992-42b5-9273-e64422abe450 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:59.748613 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a370f-3452-4ba5-976e-d9648496491d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:59.749297 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a370f-3452-4ba5-976e-d9648496491d admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:59.749729 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a370f-3452-4ba5-976e-d9648496491d admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:59.750011 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a370f-3452-4ba5-976e-d9648496491d admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:59.750718 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493a370f-3452-4ba5-976e-d9648496491d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:59.752658 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493a370f-3452-4ba5-976e-d9648496491d admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:59.761805 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0351c9-6335-4743-9b90-1065082263de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7adaa2ef440941aa8214f2b2fd49b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:59.762885 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0351c9-6335-4743-9b90-1065082263de service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:59.763345 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0351c9-6335-4743-9b90-1065082263de service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:59.763623 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0351c9-6335-4743-9b90-1065082263de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:59.772934 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1271/2550] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:27:59 2022] POST /identity/v3/users => generated 297 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:27:59.776811 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a370f-3452-4ba5-976e-d9648496491d admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:59.787185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a370f-3452-4ba5-976e-d9648496491d admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:59.792519 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5a01b8-318c-40bd-ae1d-cdec2de5b3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:59.793318 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a01b8-318c-40bd-ae1d-cdec2de5b3f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:59.793610 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a01b8-318c-40bd-ae1d-cdec2de5b3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:59.793928 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a01b8-318c-40bd-ae1d-cdec2de5b3f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:59.794659 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5a01b8-318c-40bd-ae1d-cdec2de5b3f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:59.796273 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5a01b8-318c-40bd-ae1d-cdec2de5b3f4 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:59.810591 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1272/2551] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:27:59.811924 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5a01b8-318c-40bd-ae1d-cdec2de5b3f4 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:59.821951 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5a01b8-318c-40bd-ae1d-cdec2de5b3f4 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:59.826586 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0351c9-6335-4743-9b90-1065082263de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:59.826816 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf1590-0b86-4b31-afb2-22d3b25c1de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:59.827690 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf1590-0b86-4b31-afb2-22d3b25c1de0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:59.827978 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf1590-0b86-4b31-afb2-22d3b25c1de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:59.828232 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf1590-0b86-4b31-afb2-22d3b25c1de0 admin admin] PATH_INFO: `/v3/projects/14e722592ee64e6d9023293343b2f92b/users/c0a716433f8a4142b7d4645c8d83d691/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:59.828347 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0351c9-6335-4743-9b90-1065082263de service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:59.837982 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1280/2552] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:27:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:27:59.844954 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbf1590-0b86-4b31-afb2-22d3b25c1de0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14e722592ee64e6d9023293343b2f92b, user_id=c0a716433f8a4142b7d4645c8d83d691, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:59.847731 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbf1590-0b86-4b31-afb2-22d3b25c1de0 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:59.864454 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1273/2553] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:27:59 2022] PUT /identity/v3/projects/14e722592ee64e6d9023293343b2f92b/users/c0a716433f8a4142b7d4645c8d83d691/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:27:59.869941 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0351c9-6335-4743-9b90-1065082263de service nova] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:59.882471 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0351c9-6335-4743-9b90-1065082263de service nova] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:59.917714 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:27:59.950536 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154540ac-a1d8-4ae1-9837-460506b04ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:59.951218 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154540ac-a1d8-4ae1-9837-460506b04ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:59.951501 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154540ac-a1d8-4ae1-9837-460506b04ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:59.951772 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154540ac-a1d8-4ae1-9837-460506b04ce6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:59.952507 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154540ac-a1d8-4ae1-9837-460506b04ce6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:59.954151 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154540ac-a1d8-4ae1-9837-460506b04ce6 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:27:59.964634 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1281/2554] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:27:59.968767 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf1590-0b86-4b31-afb2-22d3b25c1de0 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:27:59.979934 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf1590-0b86-4b31-afb2-22d3b25c1de0 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:27:59.984972 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c14318-530d-4b92-9cc2-68876c054e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:27:59.986002 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c14318-530d-4b92-9cc2-68876c054e16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:27:59.986355 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c14318-530d-4b92-9cc2-68876c054e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:27:59.986698 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c14318-530d-4b92-9cc2-68876c054e16 admin admin] PATH_INFO: `/v3/projects/14e722592ee64e6d9023293343b2f92b/users/c0a716433f8a4142b7d4645c8d83d691/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:27:59.988776 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c14318-530d-4b92-9cc2-68876c054e16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14e722592ee64e6d9023293343b2f92b, user_id=c0a716433f8a4142b7d4645c8d83d691, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:27:59.991536 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c14318-530d-4b92-9cc2-68876c054e16 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:00.003506 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1274/2555] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:27:59 2022] PUT /identity/v3/projects/14e722592ee64e6d9023293343b2f92b/users/c0a716433f8a4142b7d4645c8d83d691/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:28:00.013585 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b23c69a-301d-4c9f-a811-f9ea785b6c34 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:00.013886 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b23c69a-301d-4c9f-a811-f9ea785b6c34 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:00.014188 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b23c69a-301d-4c9f-a811-f9ea785b6c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:00.046990 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-0b23c69a-301d-4c9f-a811-f9ea785b6c34 None None] MFA Rules not processed for user `c0a716433f8a4142b7d4645c8d83d691`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:28:00.048474 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0b23c69a-301d-4c9f-a811-f9ea785b6c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:00.053247 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c14318-530d-4b92-9cc2-68876c054e16 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:00.117832 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c14318-530d-4b92-9cc2-68876c054e16 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:00.119673 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1282/2556] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:28:00 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:28:00.123306 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a9f054-f55d-4498-86d7-9321088f3197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:00.124215 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9f054-f55d-4498-86d7-9321088f3197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:00.124495 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9f054-f55d-4498-86d7-9321088f3197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:00.124776 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9f054-f55d-4498-86d7-9321088f3197 admin admin] PATH_INFO: `/v3/users/38e4874643ce4b12a308a2857ed7c9c2` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:00.126030 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a9f054-f55d-4498-86d7-9321088f3197 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38e4874643ce4b12a308a2857ed7c9c2)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:00.127983 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a9f054-f55d-4498-86d7-9321088f3197 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:00.130876 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b23c69a-301d-4c9f-a811-f9ea785b6c34 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:00.132411 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0b23c69a-301d-4c9f-a811-f9ea785b6c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:00.182367 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-e7a9f054-f55d-4498-86d7-9321088f3197 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38e4874643ce4b12a308a2857ed7c9c2'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:00.196018 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-e7a9f054-f55d-4498-86d7-9321088f3197 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38e4874643ce4b12a308a2857ed7c9c2'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:00.196221 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b23c69a-301d-4c9f-a811-f9ea785b6c34 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:00.200669 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3544bd2a-4283-4530-8738-e23559435cba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:00.201329 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544bd2a-4283-4530-8738-e23559435cba service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:00.201596 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544bd2a-4283-4530-8738-e23559435cba service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:00.201900 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544bd2a-4283-4530-8738-e23559435cba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:00.203621 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-e7a9f054-f55d-4498-86d7-9321088f3197 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38e4874643ce4b12a308a2857ed7c9c2'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:00.204338 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-e7a9f054-f55d-4498-86d7-9321088f3197 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38e4874643ce4b12a308a2857ed7c9c2'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:00.213005 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3544bd2a-4283-4530-8738-e23559435cba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:00.213165 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-e7a9f054-f55d-4498-86d7-9321088f3197 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38e4874643ce4b12a308a2857ed7c9c2'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:00.214559 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3544bd2a-4283-4530-8738-e23559435cba service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:00.219183 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1275/2557] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:28:00 2022] DELETE /identity/v3/users/38e4874643ce4b12a308a2857ed7c9c2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:28:00.223675 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63080660-1662-4ee3-8003-335ac59bd55e None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:00.223965 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63080660-1662-4ee3-8003-335ac59bd55e None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:00.224244 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63080660-1662-4ee3-8003-335ac59bd55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:00.224946 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1283/2558] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:28:00 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:28:00.245289 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-63080660-1662-4ee3-8003-335ac59bd55e None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:28:00.246680 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-63080660-1662-4ee3-8003-335ac59bd55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:00.252540 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:28:00.316928 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1276/2559] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:28:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:28:00.326948 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3544bd2a-4283-4530-8738-e23559435cba service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:00.328197 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3544bd2a-4283-4530-8738-e23559435cba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:00.391509 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3544bd2a-4283-4530-8738-e23559435cba service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:00.400626 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:28:00.446011 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e6963-ab79-48b0-b5f6-c3d287e0007e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:00.446903 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e6963-ab79-48b0-b5f6-c3d287e0007e service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:00.447183 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e6963-ab79-48b0-b5f6-c3d287e0007e service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:00.447459 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e6963-ab79-48b0-b5f6-c3d287e0007e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:00.456914 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e6963-ab79-48b0-b5f6-c3d287e0007e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:00.458381 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e6963-ab79-48b0-b5f6-c3d287e0007e service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:00.468507 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1284/2560] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:28:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:28:00.648881 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63080660-1662-4ee3-8003-335ac59bd55e None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:00.651157 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-63080660-1662-4ee3-8003-335ac59bd55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:00.669174 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63080660-1662-4ee3-8003-335ac59bd55e None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:00.674498 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7349f138-9d24-4eaf-aa55-402135e2a29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:00.675426 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349f138-9d24-4eaf-aa55-402135e2a29e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:00.675715 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349f138-9d24-4eaf-aa55-402135e2a29e admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:00.675986 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349f138-9d24-4eaf-aa55-402135e2a29e admin admin] PATH_INFO: `/v3/users/cf64590002f0480f8653b2de3cd03482` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:00.677336 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7349f138-9d24-4eaf-aa55-402135e2a29e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf64590002f0480f8653b2de3cd03482)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:00.680009 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7349f138-9d24-4eaf-aa55-402135e2a29e admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:00.748784 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7349f138-9d24-4eaf-aa55-402135e2a29e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf64590002f0480f8653b2de3cd03482'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:00.762693 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7349f138-9d24-4eaf-aa55-402135e2a29e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf64590002f0480f8653b2de3cd03482'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:00.771364 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7349f138-9d24-4eaf-aa55-402135e2a29e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf64590002f0480f8653b2de3cd03482'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:00.772119 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7349f138-9d24-4eaf-aa55-402135e2a29e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf64590002f0480f8653b2de3cd03482'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:00.783715 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7349f138-9d24-4eaf-aa55-402135e2a29e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf64590002f0480f8653b2de3cd03482'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:00.793128 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1277/2561] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:28:00 2022] DELETE /identity/v3/users/cf64590002f0480f8653b2de3cd03482 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:28:00.799654 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41aa4c1-1939-42e9-bf9f-9297a6f94bb1 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:00.800412 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41aa4c1-1939-42e9-bf9f-9297a6f94bb1 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:00.800412 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41aa4c1-1939-42e9-bf9f-9297a6f94bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:00.805422 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7349f138-9d24-4eaf-aa55-402135e2a29e admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:00.807602 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-7349f138-9d24-4eaf-aa55-402135e2a29e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:00.829194 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c41aa4c1-1939-42e9-bf9f-9297a6f94bb1 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:28:00.830521 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c41aa4c1-1939-42e9-bf9f-9297a6f94bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:00.884759 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7349f138-9d24-4eaf-aa55-402135e2a29e admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:00.889684 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca280ba8-8953-4127-a3ee-2697be19785f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:00.890571 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca280ba8-8953-4127-a3ee-2697be19785f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:00.890856 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca280ba8-8953-4127-a3ee-2697be19785f admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:00.891135 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca280ba8-8953-4127-a3ee-2697be19785f admin admin] PATH_INFO: `/v3/projects/c595480b5abb4f1d8850295215e09531` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:00.892423 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca280ba8-8953-4127-a3ee-2697be19785f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c595480b5abb4f1d8850295215e09531)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:00.894570 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca280ba8-8953-4127-a3ee-2697be19785f admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:00.896937 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1285/2562] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:28:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:28:00.906865 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41aa4c1-1939-42e9-bf9f-9297a6f94bb1 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:00.908441 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c41aa4c1-1939-42e9-bf9f-9297a6f94bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:00.928019 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:28:00.948532 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-ca280ba8-8953-4127-a3ee-2697be19785f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c595480b5abb4f1d8850295215e09531', 'request_id': 'req-ca280ba8-8953-4127-a3ee-2697be19785f'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:00.954123 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-ca280ba8-8953-4127-a3ee-2697be19785f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c595480b5abb4f1d8850295215e09531', 'request_id': 'req-ca280ba8-8953-4127-a3ee-2697be19785f'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:00.961952 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-ca280ba8-8953-4127-a3ee-2697be19785f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c595480b5abb4f1d8850295215e09531', 'request_id': 'req-ca280ba8-8953-4127-a3ee-2697be19785f'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:00.969580 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41aa4c1-1939-42e9-bf9f-9297a6f94bb1 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:00.973628 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-ca280ba8-8953-4127-a3ee-2697be19785f admin admin] The token cache is being invalidate because project c595480b5abb4f1d8850295215e09531 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:28:00.973988 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-ca280ba8-8953-4127-a3ee-2697be19785f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:00.974621 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-ca280ba8-8953-4127-a3ee-2697be19785f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:00.976632 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1278/2563] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:28:00 2022] DELETE /identity/v3/projects/c595480b5abb4f1d8850295215e09531 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:28:00.981559 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842502c7-41ec-424f-bc44-88c19db315c0 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:00.981864 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842502c7-41ec-424f-bc44-88c19db315c0 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:00.982142 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842502c7-41ec-424f-bc44-88c19db315c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:01.004728 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-842502c7-41ec-424f-bc44-88c19db315c0 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:28:01.005922 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-842502c7-41ec-424f-bc44-88c19db315c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:01.024809 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e9ff3-1a30-4c01-8a17-7d13d593b0a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:01.025772 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e9ff3-1a30-4c01-8a17-7d13d593b0a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:01.026188 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e9ff3-1a30-4c01-8a17-7d13d593b0a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:01.026533 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e9ff3-1a30-4c01-8a17-7d13d593b0a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:01.028960 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9d9e9ff3-1a30-4c01-8a17-7d13d593b0a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:01.069780 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:28:01.088622 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1279/2564] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:28:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:28:01.097157 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38742438-6da0-4eb9-83f1-c421841206c1 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:01.097432 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38742438-6da0-4eb9-83f1-c421841206c1 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:01.097735 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38742438-6da0-4eb9-83f1-c421841206c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:01.108681 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e9ff3-1a30-4c01-8a17-7d13d593b0a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:01.110180 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e9ff3-1a30-4c01-8a17-7d13d593b0a2 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:01.116154 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-38742438-6da0-4eb9-83f1-c421841206c1 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:28:01.117376 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-38742438-6da0-4eb9-83f1-c421841206c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:01.120192 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1286/2565] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:28:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:28:01.125758 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1280/2566] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:28:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:28:01.130484 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e9ff3-1a30-4c01-8a17-7d13d593b0a2 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:01.140815 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e9ff3-1a30-4c01-8a17-7d13d593b0a2 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:01.145644 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0871f4e3-761a-4f84-ba7b-2586aa6bd3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:01.146337 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871f4e3-761a-4f84-ba7b-2586aa6bd3f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:01.146617 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871f4e3-761a-4f84-ba7b-2586aa6bd3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:01.146891 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871f4e3-761a-4f84-ba7b-2586aa6bd3f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:01.147743 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0871f4e3-761a-4f84-ba7b-2586aa6bd3f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:28:01.148071 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0871f4e3-761a-4f84-ba7b-2586aa6bd3f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:01.149735 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0871f4e3-761a-4f84-ba7b-2586aa6bd3f7 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:01.161827 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1287/2567] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:28:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:28:01.166405 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38742438-6da0-4eb9-83f1-c421841206c1 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:01.178089 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38742438-6da0-4eb9-83f1-c421841206c1 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:01.184063 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba35ee98-423e-4d7a-8ef6-359055f87544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:01.184866 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35ee98-423e-4d7a-8ef6-359055f87544 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:01.185172 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35ee98-423e-4d7a-8ef6-359055f87544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:01.185449 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35ee98-423e-4d7a-8ef6-359055f87544 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:01.186198 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba35ee98-423e-4d7a-8ef6-359055f87544 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:01.188209 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba35ee98-423e-4d7a-8ef6-359055f87544 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:01.219055 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1281/2568] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:28:01 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:28:01.223075 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0871f4e3-761a-4f84-ba7b-2586aa6bd3f7 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:01.234158 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0871f4e3-761a-4f84-ba7b-2586aa6bd3f7 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:01.292791 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f54a03-b902-49c5-a5cc-61f7c48f87d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:01.293603 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f54a03-b902-49c5-a5cc-61f7c48f87d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:01.293900 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f54a03-b902-49c5-a5cc-61f7c48f87d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:01.294206 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f54a03-b902-49c5-a5cc-61f7c48f87d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:01.294930 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f54a03-b902-49c5-a5cc-61f7c48f87d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:01.296890 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f54a03-b902-49c5-a5cc-61f7c48f87d9 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:01.322422 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1288/2569] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:28:01 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:28:01.323751 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba35ee98-423e-4d7a-8ef6-359055f87544 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:01.335254 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba35ee98-423e-4d7a-8ef6-359055f87544 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:01.340169 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c5808-0102-4e06-b565-12d77caf391a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:01.340916 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c5808-0102-4e06-b565-12d77caf391a admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:01.341224 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c5808-0102-4e06-b565-12d77caf391a admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:01.341517 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c5808-0102-4e06-b565-12d77caf391a admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:01.342377 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308c5808-0102-4e06-b565-12d77caf391a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:01.343991 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308c5808-0102-4e06-b565-12d77caf391a admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:01.355331 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1282/2570] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:28:01.360191 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f54a03-b902-49c5-a5cc-61f7c48f87d9 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:01.370592 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f54a03-b902-49c5-a5cc-61f7c48f87d9 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:01.375879 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff548e7-4d6b-46dd-ac17-7d8e8e945935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:01.376540 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff548e7-4d6b-46dd-ac17-7d8e8e945935 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:01.376819 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff548e7-4d6b-46dd-ac17-7d8e8e945935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:01.377091 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff548e7-4d6b-46dd-ac17-7d8e8e945935 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:01.377908 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff548e7-4d6b-46dd-ac17-7d8e8e945935 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:01.380046 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff548e7-4d6b-46dd-ac17-7d8e8e945935 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:01.392808 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1289/2571] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:28:01.396985 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c5808-0102-4e06-b565-12d77caf391a admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:01.409514 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c5808-0102-4e06-b565-12d77caf391a admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:01.414264 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff548e7-4d6b-46dd-ac17-7d8e8e945935 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:01.414560 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06920131-f1d7-41cd-a7a3-bc25afa91c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:01.415633 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06920131-f1d7-41cd-a7a3-bc25afa91c9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:01.415770 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06920131-f1d7-41cd-a7a3-bc25afa91c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:01.415998 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06920131-f1d7-41cd-a7a3-bc25afa91c9e admin admin] PATH_INFO: `/v3/projects/ac4dc714acc94019b4affaec62b9441c/users/e7ddf3eaa293404dab617487af0d8f6d/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:01.416107 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6ff548e7-4d6b-46dd-ac17-7d8e8e945935 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:01.431607 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff548e7-4d6b-46dd-ac17-7d8e8e945935 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:01.438639 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff70d1-ad6a-4dd7-9f99-c4b525fde078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:01.439604 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff70d1-ad6a-4dd7-9f99-c4b525fde078 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:01.439888 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff70d1-ad6a-4dd7-9f99-c4b525fde078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:01.440171 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff70d1-ad6a-4dd7-9f99-c4b525fde078 admin admin] PATH_INFO: `/v3/projects/223573e661c04ad7bbb685c8536c4cf8` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:01.441429 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff70d1-ad6a-4dd7-9f99-c4b525fde078 admin admin] RBAC: Authorizing `identity:delete_project(project_id=223573e661c04ad7bbb685c8536c4cf8)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:01.443459 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff70d1-ad6a-4dd7-9f99-c4b525fde078 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:01.445984 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06920131-f1d7-41cd-a7a3-bc25afa91c9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac4dc714acc94019b4affaec62b9441c, user_id=e7ddf3eaa293404dab617487af0d8f6d, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:01.451163 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06920131-f1d7-41cd-a7a3-bc25afa91c9e admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:01.464768 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1283/2572] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:28:01 2022] PUT /identity/v3/projects/ac4dc714acc94019b4affaec62b9441c/users/e7ddf3eaa293404dab617487af0d8f6d/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:28:01.475782 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1160082-0f4b-4ebb-88c6-c66f9c1ac488 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:01.476079 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1160082-0f4b-4ebb-88c6-c66f9c1ac488 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:01.476365 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1160082-0f4b-4ebb-88c6-c66f9c1ac488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:01.494661 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-bfff70d1-ad6a-4dd7-9f99-c4b525fde078 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '223573e661c04ad7bbb685c8536c4cf8', 'request_id': 'req-bfff70d1-ad6a-4dd7-9f99-c4b525fde078'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:01.501794 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-bfff70d1-ad6a-4dd7-9f99-c4b525fde078 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '223573e661c04ad7bbb685c8536c4cf8', 'request_id': 'req-bfff70d1-ad6a-4dd7-9f99-c4b525fde078'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:01.503401 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-c1160082-0f4b-4ebb-88c6-c66f9c1ac488 None None] MFA Rules not processed for user `e7ddf3eaa293404dab617487af0d8f6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:28:01.504631 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-c1160082-0f4b-4ebb-88c6-c66f9c1ac488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:01.510905 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-bfff70d1-ad6a-4dd7-9f99-c4b525fde078 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '223573e661c04ad7bbb685c8536c4cf8', 'request_id': 'req-bfff70d1-ad6a-4dd7-9f99-c4b525fde078'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:01.524042 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-bfff70d1-ad6a-4dd7-9f99-c4b525fde078 admin admin] The token cache is being invalidate because project 223573e661c04ad7bbb685c8536c4cf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:28:01.524330 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-bfff70d1-ad6a-4dd7-9f99-c4b525fde078 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:01.525038 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-bfff70d1-ad6a-4dd7-9f99-c4b525fde078 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:01.526646 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1290/2573] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:28:01 2022] DELETE /identity/v3/projects/223573e661c04ad7bbb685c8536c4cf8 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:28:01.530626 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff70d1-ad6a-4dd7-9f99-c4b525fde078 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:01.532105 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-bfff70d1-ad6a-4dd7-9f99-c4b525fde078 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:01.546058 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:28:01.549216 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:28:01.577897 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1284/2574] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:28:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:28:01.582465 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1160082-0f4b-4ebb-88c6-c66f9c1ac488 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:01.583882 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-c1160082-0f4b-4ebb-88c6-c66f9c1ac488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:01.601633 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff70d1-ad6a-4dd7-9f99-c4b525fde078 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:01.606684 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf797d5-7bdc-42e9-8456-3cf611f33990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:01.607567 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf797d5-7bdc-42e9-8456-3cf611f33990 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:01.607846 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf797d5-7bdc-42e9-8456-3cf611f33990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:01.608119 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf797d5-7bdc-42e9-8456-3cf611f33990 admin admin] PATH_INFO: `/v3/users/c0a716433f8a4142b7d4645c8d83d691` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:01.609388 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf797d5-7bdc-42e9-8456-3cf611f33990 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0a716433f8a4142b7d4645c8d83d691)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:01.611376 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf797d5-7bdc-42e9-8456-3cf611f33990 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:01.652999 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1160082-0f4b-4ebb-88c6-c66f9c1ac488 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:01.657868 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef340af-189c-457c-99a5-c3f433063d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:01.658560 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef340af-189c-457c-99a5-c3f433063d1a admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:01.658845 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef340af-189c-457c-99a5-c3f433063d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:01.659124 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef340af-189c-457c-99a5-c3f433063d1a admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:01.659815 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef340af-189c-457c-99a5-c3f433063d1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:01.661749 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef340af-189c-457c-99a5-c3f433063d1a admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:01.664216 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9bf797d5-7bdc-42e9-8456-3cf611f33990 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0a716433f8a4142b7d4645c8d83d691'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:01.664892 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9bf797d5-7bdc-42e9-8456-3cf611f33990 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0a716433f8a4142b7d4645c8d83d691'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:01.665643 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9bf797d5-7bdc-42e9-8456-3cf611f33990 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0a716433f8a4142b7d4645c8d83d691'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:01.678740 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9bf797d5-7bdc-42e9-8456-3cf611f33990 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0a716433f8a4142b7d4645c8d83d691'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:01.688798 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9bf797d5-7bdc-42e9-8456-3cf611f33990 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0a716433f8a4142b7d4645c8d83d691'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:01.692881 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1285/2575] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:28:01 2022] POST /identity/v3/projects => generated 387 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:28:01.697103 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef340af-189c-457c-99a5-c3f433063d1a admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:01.698841 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-2ef340af-189c-457c-99a5-c3f433063d1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:01.703868 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1291/2576] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:28:01 2022] DELETE /identity/v3/users/c0a716433f8a4142b7d4645c8d83d691 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:28:01.770725 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef340af-189c-457c-99a5-c3f433063d1a admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:01.833365 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ab4c22-d806-44d7-bf5a-94b41892fccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:01.834409 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab4c22-d806-44d7-bf5a-94b41892fccb admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:01.834409 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab4c22-d806-44d7-bf5a-94b41892fccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:01.834613 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab4c22-d806-44d7-bf5a-94b41892fccb admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:01.835277 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ab4c22-d806-44d7-bf5a-94b41892fccb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:01.837261 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ab4c22-d806-44d7-bf5a-94b41892fccb admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:01.859887 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1286/2577] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:28:01 2022] POST /identity/v3/users => generated 300 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:28:01.865687 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf797d5-7bdc-42e9-8456-3cf611f33990 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:01.877072 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf797d5-7bdc-42e9-8456-3cf611f33990 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:01.882681 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b73796-0c0c-4bdb-9c5d-a85e9ca3b769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:01.883365 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b73796-0c0c-4bdb-9c5d-a85e9ca3b769 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:01.883644 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b73796-0c0c-4bdb-9c5d-a85e9ca3b769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:01.883913 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b73796-0c0c-4bdb-9c5d-a85e9ca3b769 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:01.884642 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b73796-0c0c-4bdb-9c5d-a85e9ca3b769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:01.886293 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b73796-0c0c-4bdb-9c5d-a85e9ca3b769 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:01.897761 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1292/2578] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:28:01.901940 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ab4c22-d806-44d7-bf5a-94b41892fccb admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:01.908036 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:28:01.913680 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ab4c22-d806-44d7-bf5a-94b41892fccb admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:01.920473 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad40155b-3201-43c6-b5a3-b83912645f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:01.921357 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad40155b-3201-43c6-b5a3-b83912645f9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:01.921637 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad40155b-3201-43c6-b5a3-b83912645f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:01.921930 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad40155b-3201-43c6-b5a3-b83912645f9b admin admin] PATH_INFO: `/v3/projects/4c806b3982a7444d8d99802f6683252a/users/28b21d78a9fc4ed39ce4d48ec8b70074/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:01.938384 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad40155b-3201-43c6-b5a3-b83912645f9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c806b3982a7444d8d99802f6683252a, user_id=28b21d78a9fc4ed39ce4d48ec8b70074, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:01.941092 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad40155b-3201-43c6-b5a3-b83912645f9b admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:01.957431 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1287/2579] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:28:01 2022] PUT /identity/v3/projects/4c806b3982a7444d8d99802f6683252a/users/28b21d78a9fc4ed39ce4d48ec8b70074/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:28:01.961432 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b73796-0c0c-4bdb-9c5d-a85e9ca3b769 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:01.972068 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b73796-0c0c-4bdb-9c5d-a85e9ca3b769 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:01.999836 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad40155b-3201-43c6-b5a3-b83912645f9b admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:02.002605 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ad40155b-3201-43c6-b5a3-b83912645f9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:02.046318 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e568ea-f6ab-47c9-81a0-b83a0ad4e7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:02.047035 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e568ea-f6ab-47c9-81a0-b83a0ad4e7b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:02.047321 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e568ea-f6ab-47c9-81a0-b83a0ad4e7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:02.047592 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e568ea-f6ab-47c9-81a0-b83a0ad4e7b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:02.048335 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e568ea-f6ab-47c9-81a0-b83a0ad4e7b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:02.050212 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e568ea-f6ab-47c9-81a0-b83a0ad4e7b7 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:02.065092 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1293/2580] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:28:02.066121 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e568ea-f6ab-47c9-81a0-b83a0ad4e7b7 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:02.076555 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e568ea-f6ab-47c9-81a0-b83a0ad4e7b7 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:02.076731 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad40155b-3201-43c6-b5a3-b83912645f9b admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:02.081488 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99caa5b8-5c18-4e54-9ce1-1164ef6c6fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:02.081675 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b7b0f0-1560-4529-803a-4c26ac1dbefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:02.082578 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7b0f0-1560-4529-803a-4c26ac1dbefd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:02.082693 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99caa5b8-5c18-4e54-9ce1-1164ef6c6fa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:02.082850 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7b0f0-1560-4529-803a-4c26ac1dbefd admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:02.082958 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99caa5b8-5c18-4e54-9ce1-1164ef6c6fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:02.083133 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7b0f0-1560-4529-803a-4c26ac1dbefd admin admin] PATH_INFO: `/v3/projects/14e722592ee64e6d9023293343b2f92b` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:02.083239 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99caa5b8-5c18-4e54-9ce1-1164ef6c6fa5 admin admin] PATH_INFO: `/v3/projects/4c806b3982a7444d8d99802f6683252a/users/28b21d78a9fc4ed39ce4d48ec8b70074/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:02.084427 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b7b0f0-1560-4529-803a-4c26ac1dbefd admin admin] RBAC: Authorizing `identity:delete_project(project_id=14e722592ee64e6d9023293343b2f92b)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:02.085118 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99caa5b8-5c18-4e54-9ce1-1164ef6c6fa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c806b3982a7444d8d99802f6683252a, user_id=28b21d78a9fc4ed39ce4d48ec8b70074, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:02.086418 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b7b0f0-1560-4529-803a-4c26ac1dbefd admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:02.087750 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99caa5b8-5c18-4e54-9ce1-1164ef6c6fa5 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:02.098733 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1294/2581] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:28:02 2022] PUT /identity/v3/projects/4c806b3982a7444d8d99802f6683252a/users/28b21d78a9fc4ed39ce4d48ec8b70074/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:28:02.110650 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee917c7-c7e0-4bcc-9045-3df5703658d2 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:02.110956 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee917c7-c7e0-4bcc-9045-3df5703658d2 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:02.111230 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee917c7-c7e0-4bcc-9045-3df5703658d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:02.116919 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:28:02.138900 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b3b7b0f0-1560-4529-803a-4c26ac1dbefd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14e722592ee64e6d9023293343b2f92b', 'request_id': 'req-b3b7b0f0-1560-4529-803a-4c26ac1dbefd'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:02.140813 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-8ee917c7-c7e0-4bcc-9045-3df5703658d2 None None] MFA Rules not processed for user `28b21d78a9fc4ed39ce4d48ec8b70074`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:28:02.142072 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8ee917c7-c7e0-4bcc-9045-3df5703658d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:02.145649 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b3b7b0f0-1560-4529-803a-4c26ac1dbefd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14e722592ee64e6d9023293343b2f92b', 'request_id': 'req-b3b7b0f0-1560-4529-803a-4c26ac1dbefd'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:02.155925 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b3b7b0f0-1560-4529-803a-4c26ac1dbefd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14e722592ee64e6d9023293343b2f92b', 'request_id': 'req-b3b7b0f0-1560-4529-803a-4c26ac1dbefd'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:02.168211 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b3b7b0f0-1560-4529-803a-4c26ac1dbefd admin admin] The token cache is being invalidate because project 14e722592ee64e6d9023293343b2f92b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:28:02.168439 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b3b7b0f0-1560-4529-803a-4c26ac1dbefd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:02.169069 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b3b7b0f0-1560-4529-803a-4c26ac1dbefd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:02.170679 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1288/2582] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:28:01 2022] DELETE /identity/v3/projects/14e722592ee64e6d9023293343b2f92b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:28:02.175539 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac8feb-5a1a-42de-af9d-670cb3f684e2 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:02.175876 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac8feb-5a1a-42de-af9d-670cb3f684e2 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:02.176156 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac8feb-5a1a-42de-af9d-670cb3f684e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:02.195130 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-23ac8feb-5a1a-42de-af9d-670cb3f684e2 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:28:02.196365 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-23ac8feb-5a1a-42de-af9d-670cb3f684e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:02.211120 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1295/2583] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:28:02 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:28:02.222493 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee917c7-c7e0-4bcc-9045-3df5703658d2 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:02.223900 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8ee917c7-c7e0-4bcc-9045-3df5703658d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:02.259751 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1289/2584] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:28:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:28:02.267739 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f30e45-d35d-410d-bc6f-7dc757d92e9f None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:02.268034 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f30e45-d35d-410d-bc6f-7dc757d92e9f None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:02.268339 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f30e45-d35d-410d-bc6f-7dc757d92e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:02.283913 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee917c7-c7e0-4bcc-9045-3df5703658d2 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:02.287584 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de3ec6d-4659-438d-b9bd-5f0efa99ad79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:02.287753 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-a0f30e45-d35d-410d-bc6f-7dc757d92e9f None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:28:02.288237 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de3ec6d-4659-438d-b9bd-5f0efa99ad79 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:02.288518 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de3ec6d-4659-438d-b9bd-5f0efa99ad79 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:02.288790 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de3ec6d-4659-438d-b9bd-5f0efa99ad79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:02.288887 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a0f30e45-d35d-410d-bc6f-7dc757d92e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:02.297110 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1290/2585] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:28:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:28:02.298566 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de3ec6d-4659-438d-b9bd-5f0efa99ad79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:02.300107 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de3ec6d-4659-438d-b9bd-5f0efa99ad79 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:02.301357 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f30e45-d35d-410d-bc6f-7dc757d92e9f None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:02.307143 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:28:02.311133 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1296/2586] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:28:02 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:28:02.313074 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f30e45-d35d-410d-bc6f-7dc757d92e9f None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:02.320845 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72057f01-6e16-4593-be09-1a6e763db399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:02.321545 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72057f01-6e16-4593-be09-1a6e763db399 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:02.321875 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72057f01-6e16-4593-be09-1a6e763db399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:02.322151 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72057f01-6e16-4593-be09-1a6e763db399 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:02.322891 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72057f01-6e16-4593-be09-1a6e763db399 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:28:02.323197 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72057f01-6e16-4593-be09-1a6e763db399 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:02.324833 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72057f01-6e16-4593-be09-1a6e763db399 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:02.341339 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1291/2587] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:28:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:28:02.341505 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de3ec6d-4659-438d-b9bd-5f0efa99ad79 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:02.342484 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8de3ec6d-4659-438d-b9bd-5f0efa99ad79 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:02.342615 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72057f01-6e16-4593-be09-1a6e763db399 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:02.353239 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72057f01-6e16-4593-be09-1a6e763db399 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:02.357654 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de3ec6d-4659-438d-b9bd-5f0efa99ad79 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:02.358883 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e621458c-b764-45b1-a0c0-4f0a2c601a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:02.359542 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621458c-b764-45b1-a0c0-4f0a2c601a96 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:02.359826 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621458c-b764-45b1-a0c0-4f0a2c601a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:02.360100 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621458c-b764-45b1-a0c0-4f0a2c601a96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:02.360796 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e621458c-b764-45b1-a0c0-4f0a2c601a96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:02.362471 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c523499-97bf-43a2-b944-db1da48b45cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:02.362752 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e621458c-b764-45b1-a0c0-4f0a2c601a96 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:02.363339 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c523499-97bf-43a2-b944-db1da48b45cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:02.363623 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c523499-97bf-43a2-b944-db1da48b45cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:02.363899 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c523499-97bf-43a2-b944-db1da48b45cb admin admin] PATH_INFO: `/v3/users/e7ddf3eaa293404dab617487af0d8f6d` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:02.365137 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c523499-97bf-43a2-b944-db1da48b45cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7ddf3eaa293404dab617487af0d8f6d)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:02.367781 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c523499-97bf-43a2-b944-db1da48b45cb admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:02.391858 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1292/2588] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:28:02 2022] POST /identity/v3/projects => generated 363 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:28:02.396691 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e621458c-b764-45b1-a0c0-4f0a2c601a96 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:02.421335 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6c523499-97bf-43a2-b944-db1da48b45cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7ddf3eaa293404dab617487af0d8f6d'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:02.421971 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6c523499-97bf-43a2-b944-db1da48b45cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7ddf3eaa293404dab617487af0d8f6d'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:02.422613 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6c523499-97bf-43a2-b944-db1da48b45cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7ddf3eaa293404dab617487af0d8f6d'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:02.435875 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6c523499-97bf-43a2-b944-db1da48b45cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7ddf3eaa293404dab617487af0d8f6d'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:02.442908 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6c523499-97bf-43a2-b944-db1da48b45cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7ddf3eaa293404dab617487af0d8f6d'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:02.455858 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1297/2589] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:28:02 2022] DELETE /identity/v3/users/e7ddf3eaa293404dab617487af0d8f6d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:28:02.460217 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096bcefb-c4f6-4fd3-93e8-14c13669fba7 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:02.460511 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096bcefb-c4f6-4fd3-93e8-14c13669fba7 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:02.460789 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096bcefb-c4f6-4fd3-93e8-14c13669fba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:02.464076 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e621458c-b764-45b1-a0c0-4f0a2c601a96 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:02.466356 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:28:02.482621 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-096bcefb-c4f6-4fd3-93e8-14c13669fba7 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:28:02.483835 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-096bcefb-c4f6-4fd3-93e8-14c13669fba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:02.527787 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac7a89-9918-4d55-907a-82dad4da9ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:02.529067 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac7a89-9918-4d55-907a-82dad4da9ffa admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:02.529067 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac7a89-9918-4d55-907a-82dad4da9ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:02.529286 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac7a89-9918-4d55-907a-82dad4da9ffa admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:02.529874 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac7a89-9918-4d55-907a-82dad4da9ffa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:02.531804 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac7a89-9918-4d55-907a-82dad4da9ffa admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:02.546967 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1298/2590] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:28:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:28:02.553259 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1293/2591] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:28:02 2022] POST /identity/v3/users => generated 282 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:28:02.557477 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096bcefb-c4f6-4fd3-93e8-14c13669fba7 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:02.558963 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac7a89-9918-4d55-907a-82dad4da9ffa admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:02.559113 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-096bcefb-c4f6-4fd3-93e8-14c13669fba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:02.561163 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-6cac7a89-9918-4d55-907a-82dad4da9ffa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:02.571326 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096bcefb-c4f6-4fd3-93e8-14c13669fba7 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:02.576235 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc400e-a3c5-46b5-a429-9cf8c09324ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:02.576923 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc400e-a3c5-46b5-a429-9cf8c09324ca admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:02.577214 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc400e-a3c5-46b5-a429-9cf8c09324ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:02.577474 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc400e-a3c5-46b5-a429-9cf8c09324ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:02.578229 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdc400e-a3c5-46b5-a429-9cf8c09324ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:02.579841 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdc400e-a3c5-46b5-a429-9cf8c09324ca admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:02.590575 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1299/2592] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:28:02.594774 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc400e-a3c5-46b5-a429-9cf8c09324ca admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:02.604502 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc400e-a3c5-46b5-a429-9cf8c09324ca admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:02.609331 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492a5c0-4e36-4641-b730-e6b881f3b193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:02.610058 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492a5c0-4e36-4641-b730-e6b881f3b193 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:02.610433 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492a5c0-4e36-4641-b730-e6b881f3b193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:02.610699 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492a5c0-4e36-4641-b730-e6b881f3b193 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:02.611464 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a492a5c0-4e36-4641-b730-e6b881f3b193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:02.613050 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a492a5c0-4e36-4641-b730-e6b881f3b193 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:02.623270 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac7a89-9918-4d55-907a-82dad4da9ffa admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:02.623553 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1300/2593] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:28:02.627613 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389acc1f-2050-4818-8ec0-39e567bfca81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:02.627772 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492a5c0-4e36-4641-b730-e6b881f3b193 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:02.628255 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389acc1f-2050-4818-8ec0-39e567bfca81 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:02.628529 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389acc1f-2050-4818-8ec0-39e567bfca81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:02.628820 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389acc1f-2050-4818-8ec0-39e567bfca81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:02.637884 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492a5c0-4e36-4641-b730-e6b881f3b193 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:02.638854 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389acc1f-2050-4818-8ec0-39e567bfca81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:02.640543 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389acc1f-2050-4818-8ec0-39e567bfca81 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:02.643309 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320420b7-81a3-42d5-b32a-2da0bfac49c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:02.644185 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320420b7-81a3-42d5-b32a-2da0bfac49c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:02.644473 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320420b7-81a3-42d5-b32a-2da0bfac49c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:02.644749 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320420b7-81a3-42d5-b32a-2da0bfac49c9 admin admin] PATH_INFO: `/v3/projects/1161d0b7728740d88968d8226943e8fc/users/8d498c7f2d8d4454b0aa4b2d082b72cf/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:02.650466 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1294/2594] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:28:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:28:02.660415 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320420b7-81a3-42d5-b32a-2da0bfac49c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1161d0b7728740d88968d8226943e8fc, user_id=8d498c7f2d8d4454b0aa4b2d082b72cf, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:02.664936 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320420b7-81a3-42d5-b32a-2da0bfac49c9 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:02.679015 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1301/2595] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:28:02 2022] PUT /identity/v3/projects/1161d0b7728740d88968d8226943e8fc/users/8d498c7f2d8d4454b0aa4b2d082b72cf/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:28:02.691111 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9764b2-cf1b-4873-88df-9b9e7d83edf7 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:02.691685 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9764b2-cf1b-4873-88df-9b9e7d83edf7 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:02.691685 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9764b2-cf1b-4873-88df-9b9e7d83edf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:02.704500 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:28:02.722805 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-ea9764b2-cf1b-4873-88df-9b9e7d83edf7 None None] MFA Rules not processed for user `8d498c7f2d8d4454b0aa4b2d082b72cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:28:02.724216 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ea9764b2-cf1b-4873-88df-9b9e7d83edf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:02.795922 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1295/2596] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:28:02 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:28:02.807870 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320420b7-81a3-42d5-b32a-2da0bfac49c9 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:02.812326 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-320420b7-81a3-42d5-b32a-2da0bfac49c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:02.881474 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320420b7-81a3-42d5-b32a-2da0bfac49c9 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:02.894790 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd8e1f7-ab50-48a2-9c13-70dae802114a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:02.895610 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8e1f7-ab50-48a2-9c13-70dae802114a service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:02.895891 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8e1f7-ab50-48a2-9c13-70dae802114a service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:02.896298 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8e1f7-ab50-48a2-9c13-70dae802114a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:02.908933 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd8e1f7-ab50-48a2-9c13-70dae802114a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:02.910783 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd8e1f7-ab50-48a2-9c13-70dae802114a service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:02.933102 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1302/2597] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:28:02 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:28:02.959242 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9764b2-cf1b-4873-88df-9b9e7d83edf7 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:02.960814 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ea9764b2-cf1b-4873-88df-9b9e7d83edf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:03.038225 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9764b2-cf1b-4873-88df-9b9e7d83edf7 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:03.044276 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928abad-f120-4c8c-82b6-915f0a9310bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:03.045203 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928abad-f120-4c8c-82b6-915f0a9310bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:03.045424 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928abad-f120-4c8c-82b6-915f0a9310bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:03.045711 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928abad-f120-4c8c-82b6-915f0a9310bd admin admin] PATH_INFO: `/v3/projects/ac4dc714acc94019b4affaec62b9441c` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:03.050963 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5928abad-f120-4c8c-82b6-915f0a9310bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac4dc714acc94019b4affaec62b9441c)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:03.050963 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5928abad-f120-4c8c-82b6-915f0a9310bd admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:03.101933 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-5928abad-f120-4c8c-82b6-915f0a9310bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac4dc714acc94019b4affaec62b9441c', 'request_id': 'req-5928abad-f120-4c8c-82b6-915f0a9310bd'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:03.107995 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-5928abad-f120-4c8c-82b6-915f0a9310bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac4dc714acc94019b4affaec62b9441c', 'request_id': 'req-5928abad-f120-4c8c-82b6-915f0a9310bd'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:03.114758 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-5928abad-f120-4c8c-82b6-915f0a9310bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac4dc714acc94019b4affaec62b9441c', 'request_id': 'req-5928abad-f120-4c8c-82b6-915f0a9310bd'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:03.126588 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-5928abad-f120-4c8c-82b6-915f0a9310bd admin admin] The token cache is being invalidate because project ac4dc714acc94019b4affaec62b9441c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:28:03.126882 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-5928abad-f120-4c8c-82b6-915f0a9310bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:03.127640 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-5928abad-f120-4c8c-82b6-915f0a9310bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:03.129396 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1296/2598] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:28:02 2022] DELETE /identity/v3/projects/ac4dc714acc94019b4affaec62b9441c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:28:03.133852 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd8e1f7-ab50-48a2-9c13-70dae802114a service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:03.148059 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd8e1f7-ab50-48a2-9c13-70dae802114a service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:03.218518 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034dfbf6-e38c-4586-b727-df4f69eb325e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:03.219409 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034dfbf6-e38c-4586-b727-df4f69eb325e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:03.220148 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034dfbf6-e38c-4586-b727-df4f69eb325e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:03.220148 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034dfbf6-e38c-4586-b727-df4f69eb325e admin admin] PATH_INFO: `/v3/users/28b21d78a9fc4ed39ce4d48ec8b70074` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:03.221147 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034dfbf6-e38c-4586-b727-df4f69eb325e admin admin] RBAC: Authorizing `identity:delete_user(user_id=28b21d78a9fc4ed39ce4d48ec8b70074)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:03.223109 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034dfbf6-e38c-4586-b727-df4f69eb325e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:03.224819 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:28:03.282246 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-034dfbf6-e38c-4586-b727-df4f69eb325e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28b21d78a9fc4ed39ce4d48ec8b70074'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:03.282982 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-034dfbf6-e38c-4586-b727-df4f69eb325e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28b21d78a9fc4ed39ce4d48ec8b70074'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:03.283592 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-034dfbf6-e38c-4586-b727-df4f69eb325e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28b21d78a9fc4ed39ce4d48ec8b70074'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:03.296903 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-034dfbf6-e38c-4586-b727-df4f69eb325e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28b21d78a9fc4ed39ce4d48ec8b70074'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:03.306055 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-034dfbf6-e38c-4586-b727-df4f69eb325e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28b21d78a9fc4ed39ce4d48ec8b70074'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:03.319363 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1303/2599] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:28:03 2022] DELETE /identity/v3/users/28b21d78a9fc4ed39ce4d48ec8b70074 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:28:03.628779 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928abad-f120-4c8c-82b6-915f0a9310bd admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:03.630332 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-5928abad-f120-4c8c-82b6-915f0a9310bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:03.644981 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928abad-f120-4c8c-82b6-915f0a9310bd admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:03.674866 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:28:03.709854 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a104ea4-6ff6-484a-bfb3-515212add716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:03.710617 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a104ea4-6ff6-484a-bfb3-515212add716 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:03.710926 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a104ea4-6ff6-484a-bfb3-515212add716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:03.711194 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a104ea4-6ff6-484a-bfb3-515212add716 admin admin] PATH_INFO: `/v3/projects/4c806b3982a7444d8d99802f6683252a` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:03.712401 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a104ea4-6ff6-484a-bfb3-515212add716 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c806b3982a7444d8d99802f6683252a)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:03.714427 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a104ea4-6ff6-484a-bfb3-515212add716 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:03.766199 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9a104ea4-6ff6-484a-bfb3-515212add716 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c806b3982a7444d8d99802f6683252a', 'request_id': 'req-9a104ea4-6ff6-484a-bfb3-515212add716'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:03.772426 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9a104ea4-6ff6-484a-bfb3-515212add716 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c806b3982a7444d8d99802f6683252a', 'request_id': 'req-9a104ea4-6ff6-484a-bfb3-515212add716'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:03.782067 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9a104ea4-6ff6-484a-bfb3-515212add716 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c806b3982a7444d8d99802f6683252a', 'request_id': 'req-9a104ea4-6ff6-484a-bfb3-515212add716'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:03.794445 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9a104ea4-6ff6-484a-bfb3-515212add716 admin admin] The token cache is being invalidate because project 4c806b3982a7444d8d99802f6683252a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:28:03.794741 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9a104ea4-6ff6-484a-bfb3-515212add716 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:03.795501 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9a104ea4-6ff6-484a-bfb3-515212add716 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:03.797187 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1297/2600] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:28:03 2022] DELETE /identity/v3/projects/4c806b3982a7444d8d99802f6683252a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:28:03.802772 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0fe9a-5de1-43c1-9fca-eb78d2a72191 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:03.803063 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0fe9a-5de1-43c1-9fca-eb78d2a72191 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:03.803341 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0fe9a-5de1-43c1-9fca-eb78d2a72191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:03.825435 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-5af0fe9a-5de1-43c1-9fca-eb78d2a72191 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:28:03.826721 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5af0fe9a-5de1-43c1-9fca-eb78d2a72191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:03.890463 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1304/2601] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:28:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:28:03.899499 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d006f-79a6-4a19-802f-f129730e9a0d None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:03.899883 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d006f-79a6-4a19-802f-f129730e9a0d None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:03.900200 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d006f-79a6-4a19-802f-f129730e9a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:03.921208 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-049d006f-79a6-4a19-802f-f129730e9a0d None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:28:03.922454 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-049d006f-79a6-4a19-802f-f129730e9a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:03.932334 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1298/2602] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:28:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:28:03.937289 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0fe9a-5de1-43c1-9fca-eb78d2a72191 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:03.947736 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0fe9a-5de1-43c1-9fca-eb78d2a72191 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:03.953904 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ea5406-703b-4160-babd-e6e298f775bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:03.954606 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea5406-703b-4160-babd-e6e298f775bd admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:03.954888 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea5406-703b-4160-babd-e6e298f775bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:03.955158 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea5406-703b-4160-babd-e6e298f775bd admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:03.955921 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ea5406-703b-4160-babd-e6e298f775bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:28:03.956231 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ea5406-703b-4160-babd-e6e298f775bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:03.957910 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ea5406-703b-4160-babd-e6e298f775bd admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:03.971779 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1305/2603] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:28:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:28:03.976513 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d006f-79a6-4a19-802f-f129730e9a0d None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:03.991883 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d006f-79a6-4a19-802f-f129730e9a0d None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:04.000224 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406080b4-de79-4ea1-a96f-e75e29fd6208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:04.000892 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406080b4-de79-4ea1-a96f-e75e29fd6208 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:04.001189 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406080b4-de79-4ea1-a96f-e75e29fd6208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:04.001448 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406080b4-de79-4ea1-a96f-e75e29fd6208 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:04.002178 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406080b4-de79-4ea1-a96f-e75e29fd6208 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:04.004105 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406080b4-de79-4ea1-a96f-e75e29fd6208 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:04.036664 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1299/2604] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:28:03 2022] POST /identity/v3/projects => generated 383 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:28:04.041587 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ea5406-703b-4160-babd-e6e298f775bd admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:04.053867 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ea5406-703b-4160-babd-e6e298f775bd admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:04.114416 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00310d91-3420-48f5-a829-14084962fe3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:04.115099 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00310d91-3420-48f5-a829-14084962fe3c admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:04.115375 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00310d91-3420-48f5-a829-14084962fe3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:04.115644 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00310d91-3420-48f5-a829-14084962fe3c admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:04.116347 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00310d91-3420-48f5-a829-14084962fe3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:04.118303 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00310d91-3420-48f5-a829-14084962fe3c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:04.129117 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:28:04.141014 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1306/2605] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:28:04 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:28:04.145333 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406080b4-de79-4ea1-a96f-e75e29fd6208 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:04.155888 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406080b4-de79-4ea1-a96f-e75e29fd6208 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:04.161600 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac155458-fd5f-4a42-a856-a0d18492cc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:04.162292 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac155458-fd5f-4a42-a856-a0d18492cc7c admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:04.162565 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac155458-fd5f-4a42-a856-a0d18492cc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:04.162856 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac155458-fd5f-4a42-a856-a0d18492cc7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:04.163581 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac155458-fd5f-4a42-a856-a0d18492cc7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:04.165194 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac155458-fd5f-4a42-a856-a0d18492cc7c admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:04.176745 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1300/2606] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:28:04.183179 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00310d91-3420-48f5-a829-14084962fe3c admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:04.199428 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00310d91-3420-48f5-a829-14084962fe3c admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:04.205731 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a181bf-ce2d-4345-9fe3-682f98aa2640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:04.206387 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a181bf-ce2d-4345-9fe3-682f98aa2640 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:04.206674 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a181bf-ce2d-4345-9fe3-682f98aa2640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:04.206949 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a181bf-ce2d-4345-9fe3-682f98aa2640 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:04.207678 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a181bf-ce2d-4345-9fe3-682f98aa2640 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:04.209278 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a181bf-ce2d-4345-9fe3-682f98aa2640 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:04.219949 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1307/2607] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:28:04.224434 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac155458-fd5f-4a42-a856-a0d18492cc7c admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:04.235285 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac155458-fd5f-4a42-a856-a0d18492cc7c admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:04.240779 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da261c0a-04c6-4a35-98dc-d794ba7aa0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:04.241665 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da261c0a-04c6-4a35-98dc-d794ba7aa0f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:04.241966 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da261c0a-04c6-4a35-98dc-d794ba7aa0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:04.242234 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da261c0a-04c6-4a35-98dc-d794ba7aa0f1 admin admin] PATH_INFO: `/v3/projects/c27b4f5ef93f4ebab73c3fd4d0c8b044/users/ea9198e274034ffeb28ebf7a06f951e2/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:04.257915 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da261c0a-04c6-4a35-98dc-d794ba7aa0f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c27b4f5ef93f4ebab73c3fd4d0c8b044, user_id=ea9198e274034ffeb28ebf7a06f951e2, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:04.260553 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da261c0a-04c6-4a35-98dc-d794ba7aa0f1 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:04.275632 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1301/2608] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:28:04 2022] PUT /identity/v3/projects/c27b4f5ef93f4ebab73c3fd4d0c8b044/users/ea9198e274034ffeb28ebf7a06f951e2/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:28:04.285952 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1399d3f-11e9-4331-93cb-d817dda361fd None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:04.286248 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1399d3f-11e9-4331-93cb-d817dda361fd None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:04.286525 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1399d3f-11e9-4331-93cb-d817dda361fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:04.315937 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e1399d3f-11e9-4331-93cb-d817dda361fd None None] MFA Rules not processed for user `ea9198e274034ffeb28ebf7a06f951e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:28:04.317091 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e1399d3f-11e9-4331-93cb-d817dda361fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:04.390715 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1308/2609] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:28:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:28:04.395466 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da261c0a-04c6-4a35-98dc-d794ba7aa0f1 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:04.455380 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:28:04.466992 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da261c0a-04c6-4a35-98dc-d794ba7aa0f1 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:04.473005 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06399559-4641-4034-ab42-81d6c81f99db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:04.473723 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06399559-4641-4034-ab42-81d6c81f99db admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:04.474066 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06399559-4641-4034-ab42-81d6c81f99db admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:04.474349 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06399559-4641-4034-ab42-81d6c81f99db admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:04.475106 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06399559-4641-4034-ab42-81d6c81f99db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:04.477044 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06399559-4641-4034-ab42-81d6c81f99db admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:04.509001 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1302/2610] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:28:04 2022] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:28:04.510276 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1399d3f-11e9-4331-93cb-d817dda361fd None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:04.522289 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1399d3f-11e9-4331-93cb-d817dda361fd None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:04.583473 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f3e27-7ada-4ed1-ac9d-cea295549a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:04.584276 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f3e27-7ada-4ed1-ac9d-cea295549a3f admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:04.584629 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f3e27-7ada-4ed1-ac9d-cea295549a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:04.584988 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f3e27-7ada-4ed1-ac9d-cea295549a3f admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:04.585869 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701f3e27-7ada-4ed1-ac9d-cea295549a3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:04.587870 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701f3e27-7ada-4ed1-ac9d-cea295549a3f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:04.614438 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1309/2611] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:28:04 2022] POST /identity/v3/users => generated 298 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:28:04.615878 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06399559-4641-4034-ab42-81d6c81f99db admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:04.627822 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06399559-4641-4034-ab42-81d6c81f99db admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:04.633115 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a3bd9d-c198-4360-9ba0-cbe05e91d9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:04.633998 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3bd9d-c198-4360-9ba0-cbe05e91d9f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:04.634358 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3bd9d-c198-4360-9ba0-cbe05e91d9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:04.634709 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3bd9d-c198-4360-9ba0-cbe05e91d9f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:04.635582 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a3bd9d-c198-4360-9ba0-cbe05e91d9f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:04.637371 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a3bd9d-c198-4360-9ba0-cbe05e91d9f9 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:04.649891 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1303/2612] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:28:04.654469 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f3e27-7ada-4ed1-ac9d-cea295549a3f admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:04.665085 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f3e27-7ada-4ed1-ac9d-cea295549a3f admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:04.670350 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba2da0-9c47-4602-964d-e8aad4ebdae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:04.671248 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba2da0-9c47-4602-964d-e8aad4ebdae8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:04.671526 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba2da0-9c47-4602-964d-e8aad4ebdae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:04.671820 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba2da0-9c47-4602-964d-e8aad4ebdae8 admin admin] PATH_INFO: `/v3/projects/8035a0c0128141b38bf0e6b91813d0e7/users/1d26ba10d1eb4d2fb9ee66909a777808/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:04.689721 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba2da0-9c47-4602-964d-e8aad4ebdae8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8035a0c0128141b38bf0e6b91813d0e7, user_id=1d26ba10d1eb4d2fb9ee66909a777808, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:04.692414 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba2da0-9c47-4602-964d-e8aad4ebdae8 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:04.706495 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1310/2613] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:28:04 2022] PUT /identity/v3/projects/8035a0c0128141b38bf0e6b91813d0e7/users/1d26ba10d1eb4d2fb9ee66909a777808/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:28:04.710710 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a3bd9d-c198-4360-9ba0-cbe05e91d9f9 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:04.722060 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a3bd9d-c198-4360-9ba0-cbe05e91d9f9 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:04.806634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baab54c-557a-47cc-959c-7e3d5a4ad71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:04.807317 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baab54c-557a-47cc-959c-7e3d5a4ad71c admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:04.807605 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baab54c-557a-47cc-959c-7e3d5a4ad71c admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:04.807878 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baab54c-557a-47cc-959c-7e3d5a4ad71c admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:04.808709 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baab54c-557a-47cc-959c-7e3d5a4ad71c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:04.810608 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baab54c-557a-47cc-959c-7e3d5a4ad71c admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:04.821925 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1304/2614] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:28:04.826481 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba2da0-9c47-4602-964d-e8aad4ebdae8 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:04.837105 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba2da0-9c47-4602-964d-e8aad4ebdae8 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:04.842479 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d572d5-016d-412a-b2d4-aedd70c98a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:04.843374 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d572d5-016d-412a-b2d4-aedd70c98a9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:04.843655 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d572d5-016d-412a-b2d4-aedd70c98a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:04.843925 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d572d5-016d-412a-b2d4-aedd70c98a9a admin admin] PATH_INFO: `/v3/projects/8035a0c0128141b38bf0e6b91813d0e7/users/1d26ba10d1eb4d2fb9ee66909a777808/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:04.845915 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d572d5-016d-412a-b2d4-aedd70c98a9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8035a0c0128141b38bf0e6b91813d0e7, user_id=1d26ba10d1eb4d2fb9ee66909a777808, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:04.848592 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d572d5-016d-412a-b2d4-aedd70c98a9a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:04.859104 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1311/2615] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:28:04 2022] PUT /identity/v3/projects/8035a0c0128141b38bf0e6b91813d0e7/users/1d26ba10d1eb4d2fb9ee66909a777808/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:28:04.871739 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c7e95-e6cb-44ff-b894-5c95210ca753 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:04.872120 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c7e95-e6cb-44ff-b894-5c95210ca753 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:04.872426 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c7e95-e6cb-44ff-b894-5c95210ca753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:04.905445 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-421c7e95-e6cb-44ff-b894-5c95210ca753 None None] MFA Rules not processed for user `1d26ba10d1eb4d2fb9ee66909a777808`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:28:04.906693 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-421c7e95-e6cb-44ff-b894-5c95210ca753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:04.986298 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1305/2616] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:28:04 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:28:04.997955 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d572d5-016d-412a-b2d4-aedd70c98a9a admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:04.999910 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b6d572d5-016d-412a-b2d4-aedd70c98a9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:05.032844 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:28:05.065825 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d572d5-016d-412a-b2d4-aedd70c98a9a admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:05.070262 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bdbc44-80b8-4866-a9ae-1a0e610467da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:05.070917 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bdbc44-80b8-4866-a9ae-1a0e610467da service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:05.071199 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bdbc44-80b8-4866-a9ae-1a0e610467da service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:05.071476 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bdbc44-80b8-4866-a9ae-1a0e610467da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:05.081547 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bdbc44-80b8-4866-a9ae-1a0e610467da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:05.083026 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bdbc44-80b8-4866-a9ae-1a0e610467da service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:05.093242 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1312/2617] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:28:04 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:28:05.208124 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c7e95-e6cb-44ff-b894-5c95210ca753 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:05.218659 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c7e95-e6cb-44ff-b894-5c95210ca753 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:05.222708 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685530c9-4188-4292-8ff8-1aa7671d28b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:05.223349 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685530c9-4188-4292-8ff8-1aa7671d28b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:05.223675 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685530c9-4188-4292-8ff8-1aa7671d28b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:05.223940 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685530c9-4188-4292-8ff8-1aa7671d28b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:05.277933 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:28:05.292504 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685530c9-4188-4292-8ff8-1aa7671d28b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:05.293997 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685530c9-4188-4292-8ff8-1aa7671d28b9 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:05.303411 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1306/2618] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:28:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:28:07.940995 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bdbc44-80b8-4866-a9ae-1a0e610467da service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:08.006699 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bdbc44-80b8-4866-a9ae-1a0e610467da service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:08.011619 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e465da4-4961-4ccb-9750-eb69d9aa510d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:08.012489 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e465da4-4961-4ccb-9750-eb69d9aa510d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:08.012770 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e465da4-4961-4ccb-9750-eb69d9aa510d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:08.013042 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e465da4-4961-4ccb-9750-eb69d9aa510d admin admin] PATH_INFO: `/v3/users/ea9198e274034ffeb28ebf7a06f951e2` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:08.014782 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e465da4-4961-4ccb-9750-eb69d9aa510d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea9198e274034ffeb28ebf7a06f951e2)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:08.017013 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e465da4-4961-4ccb-9750-eb69d9aa510d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:08.066747 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3e465da4-4961-4ccb-9750-eb69d9aa510d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea9198e274034ffeb28ebf7a06f951e2'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:08.067444 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3e465da4-4961-4ccb-9750-eb69d9aa510d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea9198e274034ffeb28ebf7a06f951e2'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:08.068044 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3e465da4-4961-4ccb-9750-eb69d9aa510d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea9198e274034ffeb28ebf7a06f951e2'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:08.080342 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3e465da4-4961-4ccb-9750-eb69d9aa510d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea9198e274034ffeb28ebf7a06f951e2'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:08.088464 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3e465da4-4961-4ccb-9750-eb69d9aa510d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea9198e274034ffeb28ebf7a06f951e2'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:08.101558 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1313/2619] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:28:07 2022] DELETE /identity/v3/users/ea9198e274034ffeb28ebf7a06f951e2 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:28:08.106319 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09b8c6-4057-44db-a4d3-8ac51af0929b None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:08.106834 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09b8c6-4057-44db-a4d3-8ac51af0929b None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:08.106834 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09b8c6-4057-44db-a4d3-8ac51af0929b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:08.128536 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-6a09b8c6-4057-44db-a4d3-8ac51af0929b None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:28:08.129761 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-6a09b8c6-4057-44db-a4d3-8ac51af0929b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:08.199573 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1307/2620] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:28:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:28:08.209387 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e465da4-4961-4ccb-9750-eb69d9aa510d admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:08.211036 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3e465da4-4961-4ccb-9750-eb69d9aa510d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:08.268201 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:28:08.272499 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e465da4-4961-4ccb-9750-eb69d9aa510d admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:08.277294 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7391c5c-c813-471c-8209-9b30e569be03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:08.278318 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7391c5c-c813-471c-8209-9b30e569be03 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:08.278753 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7391c5c-c813-471c-8209-9b30e569be03 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:08.279028 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7391c5c-c813-471c-8209-9b30e569be03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:08.289362 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7391c5c-c813-471c-8209-9b30e569be03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:08.290847 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7391c5c-c813-471c-8209-9b30e569be03 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:08.301300 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1314/2621] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:28:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:28:08.610780 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a09b8c6-4057-44db-a4d3-8ac51af0929b None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:08.612306 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-6a09b8c6-4057-44db-a4d3-8ac51af0929b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:08.628320 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a09b8c6-4057-44db-a4d3-8ac51af0929b None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:08.634201 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c1253-dfb9-428a-91e6-9b7e6cccb7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:08.635014 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c1253-dfb9-428a-91e6-9b7e6cccb7de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:08.635288 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c1253-dfb9-428a-91e6-9b7e6cccb7de admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:08.635733 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c1253-dfb9-428a-91e6-9b7e6cccb7de admin admin] PATH_INFO: `/v3/projects/c27b4f5ef93f4ebab73c3fd4d0c8b044` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:08.637806 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5c1253-dfb9-428a-91e6-9b7e6cccb7de admin admin] RBAC: Authorizing `identity:delete_project(project_id=c27b4f5ef93f4ebab73c3fd4d0c8b044)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:08.639920 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5c1253-dfb9-428a-91e6-9b7e6cccb7de admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:08.693638 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-6b5c1253-dfb9-428a-91e6-9b7e6cccb7de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c27b4f5ef93f4ebab73c3fd4d0c8b044', 'request_id': 'req-6b5c1253-dfb9-428a-91e6-9b7e6cccb7de'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:08.702392 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-6b5c1253-dfb9-428a-91e6-9b7e6cccb7de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c27b4f5ef93f4ebab73c3fd4d0c8b044', 'request_id': 'req-6b5c1253-dfb9-428a-91e6-9b7e6cccb7de'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:08.712698 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-6b5c1253-dfb9-428a-91e6-9b7e6cccb7de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c27b4f5ef93f4ebab73c3fd4d0c8b044', 'request_id': 'req-6b5c1253-dfb9-428a-91e6-9b7e6cccb7de'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:08.726308 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-6b5c1253-dfb9-428a-91e6-9b7e6cccb7de admin admin] The token cache is being invalidate because project c27b4f5ef93f4ebab73c3fd4d0c8b044 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:28:08.726745 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-6b5c1253-dfb9-428a-91e6-9b7e6cccb7de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:08.727543 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-6b5c1253-dfb9-428a-91e6-9b7e6cccb7de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:08.729275 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1308/2622] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:28:08 2022] DELETE /identity/v3/projects/c27b4f5ef93f4ebab73c3fd4d0c8b044 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:28:08.734059 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7391c5c-c813-471c-8209-9b30e569be03 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:08.745129 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7391c5c-c813-471c-8209-9b30e569be03 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:08.813971 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1693ab-ba3f-46e9-9ab0-c9812f2d0072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:08.815240 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1693ab-ba3f-46e9-9ab0-c9812f2d0072 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:08.815650 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1693ab-ba3f-46e9-9ab0-c9812f2d0072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:08.816050 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1693ab-ba3f-46e9-9ab0-c9812f2d0072 admin admin] PATH_INFO: `/v3/users/1d26ba10d1eb4d2fb9ee66909a777808` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:08.818024 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1693ab-ba3f-46e9-9ab0-c9812f2d0072 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d26ba10d1eb4d2fb9ee66909a777808)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:08.821020 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1693ab-ba3f-46e9-9ab0-c9812f2d0072 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:08.879748 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3e1693ab-ba3f-46e9-9ab0-c9812f2d0072 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d26ba10d1eb4d2fb9ee66909a777808'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:08.880429 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3e1693ab-ba3f-46e9-9ab0-c9812f2d0072 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d26ba10d1eb4d2fb9ee66909a777808'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:08.881583 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3e1693ab-ba3f-46e9-9ab0-c9812f2d0072 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d26ba10d1eb4d2fb9ee66909a777808'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:08.896050 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3e1693ab-ba3f-46e9-9ab0-c9812f2d0072 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d26ba10d1eb4d2fb9ee66909a777808'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:08.905131 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3e1693ab-ba3f-46e9-9ab0-c9812f2d0072 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d26ba10d1eb4d2fb9ee66909a777808'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:08.922562 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1315/2623] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:28:08 2022] DELETE /identity/v3/users/1d26ba10d1eb4d2fb9ee66909a777808 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:28:09.239597 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c1253-dfb9-428a-91e6-9b7e6cccb7de admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:09.241271 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-6b5c1253-dfb9-428a-91e6-9b7e6cccb7de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:09.264102 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c1253-dfb9-428a-91e6-9b7e6cccb7de admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:09.327495 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a177eef-135b-45a5-9b26-1eb8a039a360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:09.328372 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a177eef-135b-45a5-9b26-1eb8a039a360 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:09.328648 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a177eef-135b-45a5-9b26-1eb8a039a360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:09.328920 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a177eef-135b-45a5-9b26-1eb8a039a360 admin admin] PATH_INFO: `/v3/projects/8035a0c0128141b38bf0e6b91813d0e7` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:09.330248 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a177eef-135b-45a5-9b26-1eb8a039a360 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8035a0c0128141b38bf0e6b91813d0e7)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:09.332168 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a177eef-135b-45a5-9b26-1eb8a039a360 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:09.344358 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:28:09.381859 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-5a177eef-135b-45a5-9b26-1eb8a039a360 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8035a0c0128141b38bf0e6b91813d0e7', 'request_id': 'req-5a177eef-135b-45a5-9b26-1eb8a039a360'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:09.387694 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-5a177eef-135b-45a5-9b26-1eb8a039a360 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8035a0c0128141b38bf0e6b91813d0e7', 'request_id': 'req-5a177eef-135b-45a5-9b26-1eb8a039a360'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:09.395988 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-5a177eef-135b-45a5-9b26-1eb8a039a360 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8035a0c0128141b38bf0e6b91813d0e7', 'request_id': 'req-5a177eef-135b-45a5-9b26-1eb8a039a360'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:09.407589 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-5a177eef-135b-45a5-9b26-1eb8a039a360 admin admin] The token cache is being invalidate because project 8035a0c0128141b38bf0e6b91813d0e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:28:09.407875 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-5a177eef-135b-45a5-9b26-1eb8a039a360 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:09.408534 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-5a177eef-135b-45a5-9b26-1eb8a039a360 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:09.410153 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1309/2624] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:28:09 2022] DELETE /identity/v3/projects/8035a0c0128141b38bf0e6b91813d0e7 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:28:09.415147 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826163c2-c364-48ac-9490-75b35aa6d1bc None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:09.415678 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826163c2-c364-48ac-9490-75b35aa6d1bc None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:09.415678 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826163c2-c364-48ac-9490-75b35aa6d1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:09.434726 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-826163c2-c364-48ac-9490-75b35aa6d1bc None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:28:09.435973 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-826163c2-c364-48ac-9490-75b35aa6d1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:09.504961 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1316/2625] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:28:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:28:09.512768 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f1308-7670-4b1b-b1bd-d0664ec427e0 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:09.513061 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f1308-7670-4b1b-b1bd-d0664ec427e0 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:09.513317 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f1308-7670-4b1b-b1bd-d0664ec427e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:09.533583 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-692f1308-7670-4b1b-b1bd-d0664ec427e0 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:28:09.535015 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-692f1308-7670-4b1b-b1bd-d0664ec427e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:09.543933 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1310/2626] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:28:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:28:09.549304 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826163c2-c364-48ac-9490-75b35aa6d1bc None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:09.560009 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826163c2-c364-48ac-9490-75b35aa6d1bc None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:09.565686 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd6075-a530-4ec4-8d8e-0016f5d691f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:09.566181 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd6075-a530-4ec4-8d8e-0016f5d691f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:09.566461 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd6075-a530-4ec4-8d8e-0016f5d691f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:09.566732 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd6075-a530-4ec4-8d8e-0016f5d691f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:09.567488 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd6075-a530-4ec4-8d8e-0016f5d691f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:28:09.567799 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd6075-a530-4ec4-8d8e-0016f5d691f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:09.569622 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd6075-a530-4ec4-8d8e-0016f5d691f7 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:09.577966 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:28:09.584951 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1317/2627] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:28:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:28:09.589468 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f1308-7670-4b1b-b1bd-d0664ec427e0 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:09.599780 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f1308-7670-4b1b-b1bd-d0664ec427e0 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:09.604732 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a8750d-8b6a-44b6-92fc-2640e6f772ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:09.605393 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8750d-8b6a-44b6-92fc-2640e6f772ca admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:09.605759 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8750d-8b6a-44b6-92fc-2640e6f772ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:09.606127 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8750d-8b6a-44b6-92fc-2640e6f772ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:09.606833 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a8750d-8b6a-44b6-92fc-2640e6f772ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:09.609604 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a8750d-8b6a-44b6-92fc-2640e6f772ca admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:09.638801 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1311/2628] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:28:09 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:28:09.644672 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd6075-a530-4ec4-8d8e-0016f5d691f7 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:09.657886 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd6075-a530-4ec4-8d8e-0016f5d691f7 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:09.720178 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe5f62-79d4-4c30-8d35-576fbd644d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:09.720866 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe5f62-79d4-4c30-8d35-576fbd644d75 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:09.721133 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe5f62-79d4-4c30-8d35-576fbd644d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:09.721411 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe5f62-79d4-4c30-8d35-576fbd644d75 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:09.722151 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fe5f62-79d4-4c30-8d35-576fbd644d75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:09.724109 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fe5f62-79d4-4c30-8d35-576fbd644d75 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:09.746920 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1318/2629] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:28:09 2022] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:28:09.752213 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a8750d-8b6a-44b6-92fc-2640e6f772ca admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:09.763668 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a8750d-8b6a-44b6-92fc-2640e6f772ca admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:09.768672 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d19488f-b7dd-41c3-93a8-c3c95b78e358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:09.769356 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19488f-b7dd-41c3-93a8-c3c95b78e358 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:09.769743 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19488f-b7dd-41c3-93a8-c3c95b78e358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:09.769954 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19488f-b7dd-41c3-93a8-c3c95b78e358 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:09.770698 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d19488f-b7dd-41c3-93a8-c3c95b78e358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:09.772344 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d19488f-b7dd-41c3-93a8-c3c95b78e358 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:09.784986 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1312/2630] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:28:09.788780 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe5f62-79d4-4c30-8d35-576fbd644d75 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:09.801355 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe5f62-79d4-4c30-8d35-576fbd644d75 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:09.806613 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a14f4f-98d8-4088-b8dc-03818fa2b444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:09.807322 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a14f4f-98d8-4088-b8dc-03818fa2b444 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:09.807605 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a14f4f-98d8-4088-b8dc-03818fa2b444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:09.807881 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a14f4f-98d8-4088-b8dc-03818fa2b444 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:09.808724 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a14f4f-98d8-4088-b8dc-03818fa2b444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:09.810574 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a14f4f-98d8-4088-b8dc-03818fa2b444 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:09.823693 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1319/2631] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:28:09.828423 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d19488f-b7dd-41c3-93a8-c3c95b78e358 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:09.839291 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d19488f-b7dd-41c3-93a8-c3c95b78e358 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:09.845545 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372079fb-66ad-438f-9380-7841220d0385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:09.846519 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372079fb-66ad-438f-9380-7841220d0385 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:09.846801 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372079fb-66ad-438f-9380-7841220d0385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:09.847076 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372079fb-66ad-438f-9380-7841220d0385 admin admin] PATH_INFO: `/v3/projects/7f3988b54045444298643180045b3164/users/2e3781c8fbe04bc2b217642eae61cfbb/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:09.864507 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372079fb-66ad-438f-9380-7841220d0385 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f3988b54045444298643180045b3164, user_id=2e3781c8fbe04bc2b217642eae61cfbb, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:09.867253 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372079fb-66ad-438f-9380-7841220d0385 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:09.881802 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1313/2632] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:28:09 2022] PUT /identity/v3/projects/7f3988b54045444298643180045b3164/users/2e3781c8fbe04bc2b217642eae61cfbb/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:28:09.893443 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9858eeed-d938-4081-82ae-d77ce2965c7d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:09.893762 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9858eeed-d938-4081-82ae-d77ce2965c7d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:09.894045 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9858eeed-d938-4081-82ae-d77ce2965c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:09.922829 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-9858eeed-d938-4081-82ae-d77ce2965c7d None None] MFA Rules not processed for user `2e3781c8fbe04bc2b217642eae61cfbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:28:09.924181 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9858eeed-d938-4081-82ae-d77ce2965c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:09.996736 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1320/2633] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:28:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:28:10.002539 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372079fb-66ad-438f-9380-7841220d0385 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:10.075885 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372079fb-66ad-438f-9380-7841220d0385 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:10.082570 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae40661d-44f2-4cad-831e-e44e1a2c7132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:10.083363 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40661d-44f2-4cad-831e-e44e1a2c7132 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:10.083688 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40661d-44f2-4cad-831e-e44e1a2c7132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:10.084035 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40661d-44f2-4cad-831e-e44e1a2c7132 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:10.084843 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae40661d-44f2-4cad-831e-e44e1a2c7132 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:10.087266 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae40661d-44f2-4cad-831e-e44e1a2c7132 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:10.118288 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1314/2634] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:28:10 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:28:10.123059 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9858eeed-d938-4081-82ae-d77ce2965c7d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:10.136291 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9858eeed-d938-4081-82ae-d77ce2965c7d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:10.196615 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e50ae-87a5-4533-b0e6-294e4f382224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:10.197315 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e50ae-87a5-4533-b0e6-294e4f382224 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:10.197600 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e50ae-87a5-4533-b0e6-294e4f382224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:10.197897 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e50ae-87a5-4533-b0e6-294e4f382224 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:10.198601 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e50ae-87a5-4533-b0e6-294e4f382224 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:10.200584 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e50ae-87a5-4533-b0e6-294e4f382224 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:10.210966 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:28:10.223328 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1321/2635] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:28:10 2022] POST /identity/v3/users => generated 299 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:28:10.227433 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae40661d-44f2-4cad-831e-e44e1a2c7132 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:10.239247 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae40661d-44f2-4cad-831e-e44e1a2c7132 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:10.244684 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f13e21-4b0f-4972-82f0-52f2c10e5f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:10.245395 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f13e21-4b0f-4972-82f0-52f2c10e5f33 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:10.245682 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f13e21-4b0f-4972-82f0-52f2c10e5f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:10.246012 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f13e21-4b0f-4972-82f0-52f2c10e5f33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:10.247347 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f13e21-4b0f-4972-82f0-52f2c10e5f33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:10.248592 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f13e21-4b0f-4972-82f0-52f2c10e5f33 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:10.261542 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1315/2636] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:28:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:28:10.266314 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e50ae-87a5-4533-b0e6-294e4f382224 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:10.279004 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e50ae-87a5-4533-b0e6-294e4f382224 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:10.287460 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265674b6-f8a8-45db-8f5d-ee75f6450d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:10.288368 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265674b6-f8a8-45db-8f5d-ee75f6450d7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:10.288649 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265674b6-f8a8-45db-8f5d-ee75f6450d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:10.289046 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265674b6-f8a8-45db-8f5d-ee75f6450d7b admin admin] PATH_INFO: `/v3/projects/950088b3a24f47b6a4ba42bde87aa068/users/8b6f6306ab53408b83e6797195189c79/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:10.308565 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265674b6-f8a8-45db-8f5d-ee75f6450d7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=950088b3a24f47b6a4ba42bde87aa068, user_id=8b6f6306ab53408b83e6797195189c79, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:10.311346 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265674b6-f8a8-45db-8f5d-ee75f6450d7b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:10.326138 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1322/2637] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:28:10 2022] PUT /identity/v3/projects/950088b3a24f47b6a4ba42bde87aa068/users/8b6f6306ab53408b83e6797195189c79/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:28:10.330452 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f13e21-4b0f-4972-82f0-52f2c10e5f33 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:10.342514 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f13e21-4b0f-4972-82f0-52f2c10e5f33 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:10.351703 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:28:10.406193 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9bbbad-21c0-4851-b78b-2bdfa43c496a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:10.406873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9bbbad-21c0-4851-b78b-2bdfa43c496a admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:10.407159 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9bbbad-21c0-4851-b78b-2bdfa43c496a admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:10.407434 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9bbbad-21c0-4851-b78b-2bdfa43c496a admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:10.408150 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9bbbad-21c0-4851-b78b-2bdfa43c496a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:10.409828 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9bbbad-21c0-4851-b78b-2bdfa43c496a admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:10.420764 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1316/2638] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:28:10 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:28:10.425279 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265674b6-f8a8-45db-8f5d-ee75f6450d7b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:10.436971 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265674b6-f8a8-45db-8f5d-ee75f6450d7b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:10.442816 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed36b87b-4690-4e20-8e38-09ab741b0d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:10.443721 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36b87b-4690-4e20-8e38-09ab741b0d59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:10.444107 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36b87b-4690-4e20-8e38-09ab741b0d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:10.444386 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36b87b-4690-4e20-8e38-09ab741b0d59 admin admin] PATH_INFO: `/v3/projects/950088b3a24f47b6a4ba42bde87aa068/users/8b6f6306ab53408b83e6797195189c79/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:10.446487 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed36b87b-4690-4e20-8e38-09ab741b0d59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=950088b3a24f47b6a4ba42bde87aa068, user_id=8b6f6306ab53408b83e6797195189c79, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:10.449151 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed36b87b-4690-4e20-8e38-09ab741b0d59 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:10.460717 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1323/2639] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:28:10 2022] PUT /identity/v3/projects/950088b3a24f47b6a4ba42bde87aa068/users/8b6f6306ab53408b83e6797195189c79/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:28:10.471340 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1785a7-4f4f-433d-acc3-1b36274c05e7 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:10.471630 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1785a7-4f4f-433d-acc3-1b36274c05e7 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:10.471910 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1785a7-4f4f-433d-acc3-1b36274c05e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:10.500926 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-5d1785a7-4f4f-433d-acc3-1b36274c05e7 None None] MFA Rules not processed for user `8b6f6306ab53408b83e6797195189c79`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:28:10.502102 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-5d1785a7-4f4f-433d-acc3-1b36274c05e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:10.576912 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1317/2640] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:28:10 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:28:10.590624 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed36b87b-4690-4e20-8e38-09ab741b0d59 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:10.592812 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ed36b87b-4690-4e20-8e38-09ab741b0d59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:10.660647 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed36b87b-4690-4e20-8e38-09ab741b0d59 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:10.669990 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666ca3f-fc3f-439a-b3ae-7a2191f79fe6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:10.670666 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666ca3f-fc3f-439a-b3ae-7a2191f79fe6 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:10.670950 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666ca3f-fc3f-439a-b3ae-7a2191f79fe6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:10.671228 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666ca3f-fc3f-439a-b3ae-7a2191f79fe6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:10.682657 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e666ca3f-fc3f-439a-b3ae-7a2191f79fe6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:10.684128 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e666ca3f-fc3f-439a-b3ae-7a2191f79fe6 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:10.694804 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1324/2641] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:28:10 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:28:11.278788 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1785a7-4f4f-433d-acc3-1b36274c05e7 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:11.356602 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1785a7-4f4f-433d-acc3-1b36274c05e7 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:11.361406 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa70fe-1fbe-44bf-b8b8-cf3b08dc29ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:11.362493 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa70fe-1fbe-44bf-b8b8-cf3b08dc29ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:11.362808 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa70fe-1fbe-44bf-b8b8-cf3b08dc29ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:11.363089 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa70fe-1fbe-44bf-b8b8-cf3b08dc29ee admin admin] PATH_INFO: `/v3/users/2e3781c8fbe04bc2b217642eae61cfbb` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:11.364315 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aa70fe-1fbe-44bf-b8b8-cf3b08dc29ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e3781c8fbe04bc2b217642eae61cfbb)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:11.366316 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aa70fe-1fbe-44bf-b8b8-cf3b08dc29ee admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:11.430224 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:28:11.445196 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-d4aa70fe-1fbe-44bf-b8b8-cf3b08dc29ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e3781c8fbe04bc2b217642eae61cfbb'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:11.458014 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-d4aa70fe-1fbe-44bf-b8b8-cf3b08dc29ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e3781c8fbe04bc2b217642eae61cfbb'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:11.465228 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-d4aa70fe-1fbe-44bf-b8b8-cf3b08dc29ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e3781c8fbe04bc2b217642eae61cfbb'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:11.465961 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-d4aa70fe-1fbe-44bf-b8b8-cf3b08dc29ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e3781c8fbe04bc2b217642eae61cfbb'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:11.474857 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-d4aa70fe-1fbe-44bf-b8b8-cf3b08dc29ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e3781c8fbe04bc2b217642eae61cfbb'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:11.480879 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1318/2642] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:28:11 2022] DELETE /identity/v3/users/2e3781c8fbe04bc2b217642eae61cfbb => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:28:11.485756 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4ad33-4b40-4f16-a925-4c20a219e936 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:11.486245 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4ad33-4b40-4f16-a925-4c20a219e936 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:11.486341 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4ad33-4b40-4f16-a925-4c20a219e936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:11.504138 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-bab4ad33-4b40-4f16-a925-4c20a219e936 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:28:11.505338 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-bab4ad33-4b40-4f16-a925-4c20a219e936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:11.571133 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1325/2643] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:28:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:28:11.581910 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa70fe-1fbe-44bf-b8b8-cf3b08dc29ee admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:11.583576 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-d4aa70fe-1fbe-44bf-b8b8-cf3b08dc29ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:11.647837 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa70fe-1fbe-44bf-b8b8-cf3b08dc29ee admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:11.651730 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60108b1-ed02-4bed-9cc5-3b54f4fb47c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:11.652383 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60108b1-ed02-4bed-9cc5-3b54f4fb47c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:11.652663 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60108b1-ed02-4bed-9cc5-3b54f4fb47c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:11.652943 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60108b1-ed02-4bed-9cc5-3b54f4fb47c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:11.663077 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60108b1-ed02-4bed-9cc5-3b54f4fb47c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:11.664544 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60108b1-ed02-4bed-9cc5-3b54f4fb47c0 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:11.676907 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1319/2644] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:28:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:28:11.959956 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab4ad33-4b40-4f16-a925-4c20a219e936 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:11.961484 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-bab4ad33-4b40-4f16-a925-4c20a219e936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:11.976018 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab4ad33-4b40-4f16-a925-4c20a219e936 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:11.981098 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4bf7a3-a685-4c31-824d-07f1fa5ff3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:11.982017 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4bf7a3-a685-4c31-824d-07f1fa5ff3df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:11.982336 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4bf7a3-a685-4c31-824d-07f1fa5ff3df admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:11.982679 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4bf7a3-a685-4c31-824d-07f1fa5ff3df admin admin] PATH_INFO: `/v3/projects/7f3988b54045444298643180045b3164` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:11.985064 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4bf7a3-a685-4c31-824d-07f1fa5ff3df admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f3988b54045444298643180045b3164)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:11.987238 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4bf7a3-a685-4c31-824d-07f1fa5ff3df admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:12.046852 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1d4bf7a3-a685-4c31-824d-07f1fa5ff3df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f3988b54045444298643180045b3164', 'request_id': 'req-1d4bf7a3-a685-4c31-824d-07f1fa5ff3df'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:12.052620 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:28:12.054145 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1d4bf7a3-a685-4c31-824d-07f1fa5ff3df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f3988b54045444298643180045b3164', 'request_id': 'req-1d4bf7a3-a685-4c31-824d-07f1fa5ff3df'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:12.066144 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1d4bf7a3-a685-4c31-824d-07f1fa5ff3df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f3988b54045444298643180045b3164', 'request_id': 'req-1d4bf7a3-a685-4c31-824d-07f1fa5ff3df'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:12.078073 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1d4bf7a3-a685-4c31-824d-07f1fa5ff3df admin admin] The token cache is being invalidate because project 7f3988b54045444298643180045b3164 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:28:12.078265 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1d4bf7a3-a685-4c31-824d-07f1fa5ff3df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:12.078972 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1d4bf7a3-a685-4c31-824d-07f1fa5ff3df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:12.080577 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1326/2645] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:28:11 2022] DELETE /identity/v3/projects/7f3988b54045444298643180045b3164 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:28:12.084650 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60108b1-ed02-4bed-9cc5-3b54f4fb47c0 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:12.094614 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60108b1-ed02-4bed-9cc5-3b54f4fb47c0 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:12.156589 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d603a27e-08b7-4f48-91ab-14c77bdc2a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:12.157504 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603a27e-08b7-4f48-91ab-14c77bdc2a98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:12.157810 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603a27e-08b7-4f48-91ab-14c77bdc2a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:12.158297 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603a27e-08b7-4f48-91ab-14c77bdc2a98 admin admin] PATH_INFO: `/v3/users/8b6f6306ab53408b83e6797195189c79` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:12.159426 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d603a27e-08b7-4f48-91ab-14c77bdc2a98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b6f6306ab53408b83e6797195189c79)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:12.161372 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d603a27e-08b7-4f48-91ab-14c77bdc2a98 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:12.214871 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-d603a27e-08b7-4f48-91ab-14c77bdc2a98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b6f6306ab53408b83e6797195189c79'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:12.222502 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:28:12.229318 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-d603a27e-08b7-4f48-91ab-14c77bdc2a98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b6f6306ab53408b83e6797195189c79'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:12.237646 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-d603a27e-08b7-4f48-91ab-14c77bdc2a98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b6f6306ab53408b83e6797195189c79'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:12.238405 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-d603a27e-08b7-4f48-91ab-14c77bdc2a98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b6f6306ab53408b83e6797195189c79'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:12.247792 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-d603a27e-08b7-4f48-91ab-14c77bdc2a98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b6f6306ab53408b83e6797195189c79'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:12.257251 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1320/2646] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:28:12 2022] DELETE /identity/v3/users/8b6f6306ab53408b83e6797195189c79 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:28:12.551423 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4bf7a3-a685-4c31-824d-07f1fa5ff3df admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:12.553378 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1d4bf7a3-a685-4c31-824d-07f1fa5ff3df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:12.580236 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4bf7a3-a685-4c31-824d-07f1fa5ff3df admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:12.641593 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c796fa03-653d-4d28-b81e-481e4fcedbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:12.642503 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796fa03-653d-4d28-b81e-481e4fcedbc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:12.642840 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796fa03-653d-4d28-b81e-481e4fcedbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:12.643133 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796fa03-653d-4d28-b81e-481e4fcedbc0 admin admin] PATH_INFO: `/v3/projects/950088b3a24f47b6a4ba42bde87aa068` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:12.644462 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c796fa03-653d-4d28-b81e-481e4fcedbc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=950088b3a24f47b6a4ba42bde87aa068)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:12.646477 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c796fa03-653d-4d28-b81e-481e4fcedbc0 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:12.697759 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c796fa03-653d-4d28-b81e-481e4fcedbc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '950088b3a24f47b6a4ba42bde87aa068', 'request_id': 'req-c796fa03-653d-4d28-b81e-481e4fcedbc0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:12.703750 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c796fa03-653d-4d28-b81e-481e4fcedbc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '950088b3a24f47b6a4ba42bde87aa068', 'request_id': 'req-c796fa03-653d-4d28-b81e-481e4fcedbc0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:12.711991 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c796fa03-653d-4d28-b81e-481e4fcedbc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '950088b3a24f47b6a4ba42bde87aa068', 'request_id': 'req-c796fa03-653d-4d28-b81e-481e4fcedbc0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:12.730841 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c796fa03-653d-4d28-b81e-481e4fcedbc0 admin admin] The token cache is being invalidate because project 950088b3a24f47b6a4ba42bde87aa068 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:28:12.731252 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c796fa03-653d-4d28-b81e-481e4fcedbc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:12.731968 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c796fa03-653d-4d28-b81e-481e4fcedbc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:12.734514 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1327/2647] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:28:12 2022] DELETE /identity/v3/projects/950088b3a24f47b6a4ba42bde87aa068 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:28:12.739475 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38a62c-9284-41c5-a2ad-e95ff970727e None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:12.740003 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38a62c-9284-41c5-a2ad-e95ff970727e None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:12.740003 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38a62c-9284-41c5-a2ad-e95ff970727e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:12.766329 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-4d38a62c-9284-41c5-a2ad-e95ff970727e None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:28:12.767610 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-4d38a62c-9284-41c5-a2ad-e95ff970727e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:12.848758 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1321/2648] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:28:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:28:12.851400 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909c097-6897-4192-b589-682225fb4ad6 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:12.851670 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909c097-6897-4192-b589-682225fb4ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:12.851975 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909c097-6897-4192-b589-682225fb4ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:12.873210 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-5909c097-6897-4192-b589-682225fb4ad6 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:28:12.874768 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5909c097-6897-4192-b589-682225fb4ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:12.884837 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1328/2649] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:28:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:28:12.889732 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d38a62c-9284-41c5-a2ad-e95ff970727e None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:12.900057 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d38a62c-9284-41c5-a2ad-e95ff970727e None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:12.906690 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28339c7-5c64-43ea-b848-8a2fd3a2a462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:12.907495 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28339c7-5c64-43ea-b848-8a2fd3a2a462 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:12.907845 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28339c7-5c64-43ea-b848-8a2fd3a2a462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:12.908190 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28339c7-5c64-43ea-b848-8a2fd3a2a462 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:12.909006 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28339c7-5c64-43ea-b848-8a2fd3a2a462 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:28:12.909384 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28339c7-5c64-43ea-b848-8a2fd3a2a462 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:12.911376 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28339c7-5c64-43ea-b848-8a2fd3a2a462 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:12.932427 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1322/2650] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:28:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:28:12.934167 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5909c097-6897-4192-b589-682225fb4ad6 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:12.945301 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5909c097-6897-4192-b589-682225fb4ad6 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:12.951092 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac05108-bfdb-4d7a-a936-50a46e76545b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:12.951875 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac05108-bfdb-4d7a-a936-50a46e76545b admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:12.952175 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac05108-bfdb-4d7a-a936-50a46e76545b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:12.952471 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac05108-bfdb-4d7a-a936-50a46e76545b admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:12.953160 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac05108-bfdb-4d7a-a936-50a46e76545b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:12.955085 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac05108-bfdb-4d7a-a936-50a46e76545b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:12.985397 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1329/2651] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:28:12 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:28:12.989709 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28339c7-5c64-43ea-b848-8a2fd3a2a462 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:13.001746 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28339c7-5c64-43ea-b848-8a2fd3a2a462 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:13.076903 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef94abc3-c59c-4971-875b-226b14ebf53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:13.077880 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94abc3-c59c-4971-875b-226b14ebf53a admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:13.078145 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94abc3-c59c-4971-875b-226b14ebf53a admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:13.078382 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94abc3-c59c-4971-875b-226b14ebf53a admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:13.079467 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef94abc3-c59c-4971-875b-226b14ebf53a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:13.081166 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef94abc3-c59c-4971-875b-226b14ebf53a admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:13.117984 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1323/2652] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:28:12 2022] POST /identity/v3/users => generated 293 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:28:13.121297 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac05108-bfdb-4d7a-a936-50a46e76545b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:13.133019 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac05108-bfdb-4d7a-a936-50a46e76545b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:13.142143 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d32a1b-d239-4afc-afe4-500ec6cc827d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:13.143806 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d32a1b-d239-4afc-afe4-500ec6cc827d admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:13.144151 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d32a1b-d239-4afc-afe4-500ec6cc827d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:13.144533 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d32a1b-d239-4afc-afe4-500ec6cc827d admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:13.145838 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d32a1b-d239-4afc-afe4-500ec6cc827d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:13.148295 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d32a1b-d239-4afc-afe4-500ec6cc827d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:13.166932 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1330/2653] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:28:13.168438 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef94abc3-c59c-4971-875b-226b14ebf53a admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:13.180527 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef94abc3-c59c-4971-875b-226b14ebf53a admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:13.185282 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef6137-ea4d-4df8-a886-3e5ad74acaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:13.186040 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef6137-ea4d-4df8-a886-3e5ad74acaca admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:13.186315 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef6137-ea4d-4df8-a886-3e5ad74acaca admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:13.186590 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef6137-ea4d-4df8-a886-3e5ad74acaca admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:13.187326 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef6137-ea4d-4df8-a886-3e5ad74acaca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:13.188915 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef6137-ea4d-4df8-a886-3e5ad74acaca admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:13.199654 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1324/2654] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:28:13.204157 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d32a1b-d239-4afc-afe4-500ec6cc827d admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:13.214889 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d32a1b-d239-4afc-afe4-500ec6cc827d admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:13.220141 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7025442c-539d-46f5-a6fb-5d15b44aca56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:13.221139 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025442c-539d-46f5-a6fb-5d15b44aca56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:13.221493 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025442c-539d-46f5-a6fb-5d15b44aca56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:13.221807 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025442c-539d-46f5-a6fb-5d15b44aca56 admin admin] PATH_INFO: `/v3/projects/c97df86bcff04be48843d0be3e164870/users/109320ddafd84f6591e3f09a8573ff1e/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:13.237118 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7025442c-539d-46f5-a6fb-5d15b44aca56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c97df86bcff04be48843d0be3e164870, user_id=109320ddafd84f6591e3f09a8573ff1e, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:13.239842 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7025442c-539d-46f5-a6fb-5d15b44aca56 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:13.254852 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1331/2655] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:28:13 2022] PUT /identity/v3/projects/c97df86bcff04be48843d0be3e164870/users/109320ddafd84f6591e3f09a8573ff1e/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:28:13.267340 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0236a4e-5bd6-48d3-9cea-c2841ec012e3 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:13.267630 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0236a4e-5bd6-48d3-9cea-c2841ec012e3 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:13.267984 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0236a4e-5bd6-48d3-9cea-c2841ec012e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:13.301163 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-c0236a4e-5bd6-48d3-9cea-c2841ec012e3 None None] MFA Rules not processed for user `109320ddafd84f6591e3f09a8573ff1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:28:13.303069 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-c0236a4e-5bd6-48d3-9cea-c2841ec012e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:13.333908 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:28:13.374576 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1325/2656] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:28:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:28:13.385286 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7025442c-539d-46f5-a6fb-5d15b44aca56 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:13.387223 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7025442c-539d-46f5-a6fb-5d15b44aca56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:13.403746 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:28:13.459348 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7025442c-539d-46f5-a6fb-5d15b44aca56 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:13.463379 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf07785f-4120-4087-bb5e-5c92e5324683 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:13.464032 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07785f-4120-4087-bb5e-5c92e5324683 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:13.464312 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07785f-4120-4087-bb5e-5c92e5324683 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:13.464558 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07785f-4120-4087-bb5e-5c92e5324683 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:13.474218 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf07785f-4120-4087-bb5e-5c92e5324683 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:13.475660 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf07785f-4120-4087-bb5e-5c92e5324683 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:13.486088 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1332/2657] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:28:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:28:18.996014 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0236a4e-5bd6-48d3-9cea-c2841ec012e3 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:19.088518 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0236a4e-5bd6-48d3-9cea-c2841ec012e3 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:19.093280 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4465f5-8fa6-4199-8b8f-8ab38511c1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:19.094619 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4465f5-8fa6-4199-8b8f-8ab38511c1d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:19.094619 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4465f5-8fa6-4199-8b8f-8ab38511c1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:19.094818 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4465f5-8fa6-4199-8b8f-8ab38511c1d6 admin admin] PATH_INFO: `/v3/users/109320ddafd84f6591e3f09a8573ff1e` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:19.095998 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4465f5-8fa6-4199-8b8f-8ab38511c1d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=109320ddafd84f6591e3f09a8573ff1e)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:19.097984 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4465f5-8fa6-4199-8b8f-8ab38511c1d6 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:19.153958 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-db4465f5-8fa6-4199-8b8f-8ab38511c1d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '109320ddafd84f6591e3f09a8573ff1e'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:19.176302 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-db4465f5-8fa6-4199-8b8f-8ab38511c1d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '109320ddafd84f6591e3f09a8573ff1e'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:19.191882 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-db4465f5-8fa6-4199-8b8f-8ab38511c1d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '109320ddafd84f6591e3f09a8573ff1e'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:19.192930 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-db4465f5-8fa6-4199-8b8f-8ab38511c1d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '109320ddafd84f6591e3f09a8573ff1e'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:19.205173 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-db4465f5-8fa6-4199-8b8f-8ab38511c1d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '109320ddafd84f6591e3f09a8573ff1e'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:19.216842 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1326/2658] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:28:18 2022] DELETE /identity/v3/users/109320ddafd84f6591e3f09a8573ff1e => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:28:19.220304 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e506b-f394-4dbe-b52d-54a592fbb2ea None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:19.221028 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e506b-f394-4dbe-b52d-54a592fbb2ea None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:19.221533 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e506b-f394-4dbe-b52d-54a592fbb2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:19.240777 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-b25e506b-f394-4dbe-b52d-54a592fbb2ea None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:28:19.242025 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b25e506b-f394-4dbe-b52d-54a592fbb2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:19.321069 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1333/2659] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:28:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:28:19.335756 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4465f5-8fa6-4199-8b8f-8ab38511c1d6 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:19.337679 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-db4465f5-8fa6-4199-8b8f-8ab38511c1d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:19.399409 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:28:19.403408 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4465f5-8fa6-4199-8b8f-8ab38511c1d6 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:19.409089 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728287f-489b-4b1e-9664-3c340cb3b64f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:19.409953 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728287f-489b-4b1e-9664-3c340cb3b64f service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:19.410143 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728287f-489b-4b1e-9664-3c340cb3b64f service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:19.410636 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728287f-489b-4b1e-9664-3c340cb3b64f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:19.421926 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8728287f-489b-4b1e-9664-3c340cb3b64f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:19.423584 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8728287f-489b-4b1e-9664-3c340cb3b64f service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:19.440000 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1327/2660] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:28:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:28:19.930171 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e506b-f394-4dbe-b52d-54a592fbb2ea None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:19.931649 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b25e506b-f394-4dbe-b52d-54a592fbb2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:19.948412 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e506b-f394-4dbe-b52d-54a592fbb2ea None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:19.955685 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d4ddc0-930b-4380-8413-10d5a106fad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:19.956634 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d4ddc0-930b-4380-8413-10d5a106fad9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:19.956930 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d4ddc0-930b-4380-8413-10d5a106fad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:19.957208 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d4ddc0-930b-4380-8413-10d5a106fad9 admin admin] PATH_INFO: `/v3/projects/c97df86bcff04be48843d0be3e164870` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:19.959067 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d4ddc0-930b-4380-8413-10d5a106fad9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c97df86bcff04be48843d0be3e164870)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:19.961035 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d4ddc0-930b-4380-8413-10d5a106fad9 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:20.020478 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a8d4ddc0-930b-4380-8413-10d5a106fad9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c97df86bcff04be48843d0be3e164870', 'request_id': 'req-a8d4ddc0-930b-4380-8413-10d5a106fad9'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:20.026307 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a8d4ddc0-930b-4380-8413-10d5a106fad9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c97df86bcff04be48843d0be3e164870', 'request_id': 'req-a8d4ddc0-930b-4380-8413-10d5a106fad9'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:20.040218 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a8d4ddc0-930b-4380-8413-10d5a106fad9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c97df86bcff04be48843d0be3e164870', 'request_id': 'req-a8d4ddc0-930b-4380-8413-10d5a106fad9'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:20.058251 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a8d4ddc0-930b-4380-8413-10d5a106fad9 admin admin] The token cache is being invalidate because project c97df86bcff04be48843d0be3e164870 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:28:20.058746 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a8d4ddc0-930b-4380-8413-10d5a106fad9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:20.059805 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a8d4ddc0-930b-4380-8413-10d5a106fad9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:20.062649 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1334/2661] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:28:19 2022] DELETE /identity/v3/projects/c97df86bcff04be48843d0be3e164870 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:28:20.068686 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7b131-b560-406f-afab-df8bbb4bc12a None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:20.069192 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7b131-b560-406f-afab-df8bbb4bc12a None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:20.069285 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7b131-b560-406f-afab-df8bbb4bc12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:20.088977 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-8cf7b131-b560-406f-afab-df8bbb4bc12a None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:28:20.090349 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-8cf7b131-b560-406f-afab-df8bbb4bc12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:20.184968 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1328/2662] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:28:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:28:20.193545 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b9614-b885-43d4-aac2-7303fdfab1f5 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:20.193869 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b9614-b885-43d4-aac2-7303fdfab1f5 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:20.194185 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b9614-b885-43d4-aac2-7303fdfab1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:20.214803 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c42b9614-b885-43d4-aac2-7303fdfab1f5 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:28:20.216051 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c42b9614-b885-43d4-aac2-7303fdfab1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:20.224874 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1335/2663] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:28:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:28:20.229164 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf7b131-b560-406f-afab-df8bbb4bc12a None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:20.240279 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf7b131-b560-406f-afab-df8bbb4bc12a None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:20.246653 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542be0a3-fa6d-45cb-8c6b-0d09d8fc2c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:20.247428 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542be0a3-fa6d-45cb-8c6b-0d09d8fc2c60 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:20.247815 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542be0a3-fa6d-45cb-8c6b-0d09d8fc2c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:20.248092 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542be0a3-fa6d-45cb-8c6b-0d09d8fc2c60 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:20.249200 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542be0a3-fa6d-45cb-8c6b-0d09d8fc2c60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:28:20.249600 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542be0a3-fa6d-45cb-8c6b-0d09d8fc2c60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:20.251289 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542be0a3-fa6d-45cb-8c6b-0d09d8fc2c60 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:20.255342 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa0070-a4d5-4f1f-90f9-2f2f06df182b None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:20.255718 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa0070-a4d5-4f1f-90f9-2f2f06df182b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:20.256006 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa0070-a4d5-4f1f-90f9-2f2f06df182b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:20.265784 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1329/2664] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:28:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:28:20.270079 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542be0a3-fa6d-45cb-8c6b-0d09d8fc2c60 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:20.280293 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-9cfa0070-a4d5-4f1f-90f9-2f2f06df182b None None] MFA Rules not processed for user `cf7d4c2c41494b62a9dea6a1d850d18c`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:28:20.280863 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542be0a3-fa6d-45cb-8c6b-0d09d8fc2c60 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:20.281746 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9cfa0070-a4d5-4f1f-90f9-2f2f06df182b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:20.286024 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef86de3-b555-43a7-a293-bf9cbeb15f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:20.286677 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef86de3-b555-43a7-a293-bf9cbeb15f7a admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:20.286961 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef86de3-b555-43a7-a293-bf9cbeb15f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:20.287238 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef86de3-b555-43a7-a293-bf9cbeb15f7a admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:20.287945 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef86de3-b555-43a7-a293-bf9cbeb15f7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:20.289931 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef86de3-b555-43a7-a293-bf9cbeb15f7a admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:20.309947 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:28:20.328019 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1330/2665] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:28:20 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:28:20.329400 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef86de3-b555-43a7-a293-bf9cbeb15f7a admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:20.348594 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1336/2666] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:28:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:28:20.407994 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef86de3-b555-43a7-a293-bf9cbeb15f7a admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:20.413640 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b5add-f936-4fbf-abd1-47dcee37d995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:20.414353 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b5add-f936-4fbf-abd1-47dcee37d995 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:20.414642 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b5add-f936-4fbf-abd1-47dcee37d995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:20.416189 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b5add-f936-4fbf-abd1-47dcee37d995 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:20.417276 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8b5add-f936-4fbf-abd1-47dcee37d995 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:20.419246 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8b5add-f936-4fbf-abd1-47dcee37d995 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:20.442609 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1331/2667] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:28:20 2022] POST /identity/v3/users => generated 288 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:28:20.446938 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfa0070-a4d5-4f1f-90f9-2f2f06df182b None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:20.460914 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfa0070-a4d5-4f1f-90f9-2f2f06df182b None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:20.465612 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed334012-b6b5-444d-af81-fe5c2fec4a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:20.466340 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed334012-b6b5-444d-af81-fe5c2fec4a89 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:20.466628 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed334012-b6b5-444d-af81-fe5c2fec4a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:20.466904 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed334012-b6b5-444d-af81-fe5c2fec4a89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:20.467977 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed334012-b6b5-444d-af81-fe5c2fec4a89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:20.469617 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed334012-b6b5-444d-af81-fe5c2fec4a89 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:20.483730 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1337/2668] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:28:20.485208 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b5add-f936-4fbf-abd1-47dcee37d995 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:20.495673 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b5add-f936-4fbf-abd1-47dcee37d995 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:20.501797 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b24339-9f2a-4451-9fee-f4f5d1eb41d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:20.502763 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b24339-9f2a-4451-9fee-f4f5d1eb41d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:20.503165 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b24339-9f2a-4451-9fee-f4f5d1eb41d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:20.503563 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b24339-9f2a-4451-9fee-f4f5d1eb41d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:20.504657 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b24339-9f2a-4451-9fee-f4f5d1eb41d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:20.506508 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b24339-9f2a-4451-9fee-f4f5d1eb41d4 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:20.519626 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1332/2669] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:28:20.523548 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed334012-b6b5-444d-af81-fe5c2fec4a89 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:20.536346 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed334012-b6b5-444d-af81-fe5c2fec4a89 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:20.542576 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca117999-b646-4933-b5f4-ca9c7ec4ddff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:20.543480 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca117999-b646-4933-b5f4-ca9c7ec4ddff admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:20.543796 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca117999-b646-4933-b5f4-ca9c7ec4ddff admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:20.544107 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca117999-b646-4933-b5f4-ca9c7ec4ddff admin admin] PATH_INFO: `/v3/projects/9908bcbeb64c497181f10cf3d0b96118/users/b191f31731b8448597bd13ba96d913de/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:20.565739 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca117999-b646-4933-b5f4-ca9c7ec4ddff admin admin] RBAC: Authorizing `identity:create_grant(project_id=9908bcbeb64c497181f10cf3d0b96118, user_id=b191f31731b8448597bd13ba96d913de, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:20.568405 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca117999-b646-4933-b5f4-ca9c7ec4ddff admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:20.588887 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1338/2670] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:28:20 2022] PUT /identity/v3/projects/9908bcbeb64c497181f10cf3d0b96118/users/b191f31731b8448597bd13ba96d913de/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:28:20.597145 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c713fd-aa0f-4620-8d2c-46c71f615f0e None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:20.597450 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c713fd-aa0f-4620-8d2c-46c71f615f0e None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:20.597746 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c713fd-aa0f-4620-8d2c-46c71f615f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:20.625348 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-04c713fd-aa0f-4620-8d2c-46c71f615f0e None None] MFA Rules not processed for user `b191f31731b8448597bd13ba96d913de`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:28:20.626678 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-04c713fd-aa0f-4620-8d2c-46c71f615f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:20.661559 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:28:20.708699 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1333/2671] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:28:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:28:20.719854 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca117999-b646-4933-b5f4-ca9c7ec4ddff admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:20.721805 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ca117999-b646-4933-b5f4-ca9c7ec4ddff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:20.790236 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca117999-b646-4933-b5f4-ca9c7ec4ddff admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:20.794180 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef8438-2424-4d32-98e9-6a9ab03749e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:20.794940 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef8438-2424-4d32-98e9-6a9ab03749e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:20.795986 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef8438-2424-4d32-98e9-6a9ab03749e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:20.796315 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef8438-2424-4d32-98e9-6a9ab03749e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:20.806005 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ef8438-2424-4d32-98e9-6a9ab03749e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:20.807468 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ef8438-2424-4d32-98e9-6a9ab03749e9 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:20.820425 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1339/2672] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:28:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:28:22.316435 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf122ad-4402-4448-bdf8-353ee31c9a43 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:22.317055 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf122ad-4402-4448-bdf8-353ee31c9a43 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:22.317055 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf122ad-4402-4448-bdf8-353ee31c9a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:22.348664 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-ebf122ad-4402-4448-bdf8-353ee31c9a43 None None] MFA Rules not processed for user `b191f31731b8448597bd13ba96d913de`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:28:22.350984 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ebf122ad-4402-4448-bdf8-353ee31c9a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:22.359351 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1334/2673] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:28:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:28:30.813680 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=52,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:28:32.337840 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=19 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:28:33.095004 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef8438-2424-4d32-98e9-6a9ab03749e9 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:33.096715 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-61ef8438-2424-4d32-98e9-6a9ab03749e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:33.174715 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef8438-2424-4d32-98e9-6a9ab03749e9 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:33.180107 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efe8608-60f6-4b4d-bfd3-bfd4667d6351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:33.180998 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe8608-60f6-4b4d-bfd3-bfd4667d6351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:33.181279 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe8608-60f6-4b4d-bfd3-bfd4667d6351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:33.181558 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe8608-60f6-4b4d-bfd3-bfd4667d6351 admin admin] PATH_INFO: `/v3/users/8d498c7f2d8d4454b0aa4b2d082b72cf` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:33.182809 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efe8608-60f6-4b4d-bfd3-bfd4667d6351 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d498c7f2d8d4454b0aa4b2d082b72cf)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:33.184747 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efe8608-60f6-4b4d-bfd3-bfd4667d6351 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:33.236299 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2efe8608-60f6-4b4d-bfd3-bfd4667d6351 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d498c7f2d8d4454b0aa4b2d082b72cf'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:33.237098 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2efe8608-60f6-4b4d-bfd3-bfd4667d6351 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d498c7f2d8d4454b0aa4b2d082b72cf'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:33.237829 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2efe8608-60f6-4b4d-bfd3-bfd4667d6351 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d498c7f2d8d4454b0aa4b2d082b72cf'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:33.255368 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2efe8608-60f6-4b4d-bfd3-bfd4667d6351 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d498c7f2d8d4454b0aa4b2d082b72cf'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:33.264979 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2efe8608-60f6-4b4d-bfd3-bfd4667d6351 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d498c7f2d8d4454b0aa4b2d082b72cf'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:33.279769 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1340/2674] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:28:33 2022] DELETE /identity/v3/users/8d498c7f2d8d4454b0aa4b2d082b72cf => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:28:33.286528 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7306bf0-0c62-4bbc-897c-4fc15880496c None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:33.287049 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7306bf0-0c62-4bbc-897c-4fc15880496c None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:33.287491 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7306bf0-0c62-4bbc-897c-4fc15880496c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:33.308102 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-c7306bf0-0c62-4bbc-897c-4fc15880496c None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:28:33.309595 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-c7306bf0-0c62-4bbc-897c-4fc15880496c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:33.390774 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1335/2675] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:28:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:28:33.396359 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efe8608-60f6-4b4d-bfd3-bfd4667d6351 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:33.397896 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2efe8608-60f6-4b4d-bfd3-bfd4667d6351 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:33.472885 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efe8608-60f6-4b4d-bfd3-bfd4667d6351 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:33.477048 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c07086f-4d79-40a0-a88e-f4d7eda0ee3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:33.477858 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07086f-4d79-40a0-a88e-f4d7eda0ee3c service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:33.478310 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07086f-4d79-40a0-a88e-f4d7eda0ee3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:33.478834 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07086f-4d79-40a0-a88e-f4d7eda0ee3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:33.491616 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c07086f-4d79-40a0-a88e-f4d7eda0ee3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:33.493081 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c07086f-4d79-40a0-a88e-f4d7eda0ee3c service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:33.505054 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1341/2676] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:28:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:28:33.927520 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7306bf0-0c62-4bbc-897c-4fc15880496c None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:33.929973 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-c7306bf0-0c62-4bbc-897c-4fc15880496c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:33.944436 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7306bf0-0c62-4bbc-897c-4fc15880496c None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:33.949211 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d2400-3e24-4427-8a6b-c45d532f805e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:33.950114 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d2400-3e24-4427-8a6b-c45d532f805e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:33.950400 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d2400-3e24-4427-8a6b-c45d532f805e admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:33.950681 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d2400-3e24-4427-8a6b-c45d532f805e admin admin] PATH_INFO: `/v3/projects/1161d0b7728740d88968d8226943e8fc` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:33.951938 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51d2400-3e24-4427-8a6b-c45d532f805e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1161d0b7728740d88968d8226943e8fc)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:33.953880 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51d2400-3e24-4427-8a6b-c45d532f805e admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:34.028195 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-c51d2400-3e24-4427-8a6b-c45d532f805e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1161d0b7728740d88968d8226943e8fc', 'request_id': 'req-c51d2400-3e24-4427-8a6b-c45d532f805e'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:34.038959 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-c51d2400-3e24-4427-8a6b-c45d532f805e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1161d0b7728740d88968d8226943e8fc', 'request_id': 'req-c51d2400-3e24-4427-8a6b-c45d532f805e'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:34.052189 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-c51d2400-3e24-4427-8a6b-c45d532f805e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1161d0b7728740d88968d8226943e8fc', 'request_id': 'req-c51d2400-3e24-4427-8a6b-c45d532f805e'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:34.067818 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-c51d2400-3e24-4427-8a6b-c45d532f805e admin admin] The token cache is being invalidate because project 1161d0b7728740d88968d8226943e8fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:28:34.068077 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-c51d2400-3e24-4427-8a6b-c45d532f805e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:34.068815 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-c51d2400-3e24-4427-8a6b-c45d532f805e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:34.070703 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1336/2677] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:28:33 2022] DELETE /identity/v3/projects/1161d0b7728740d88968d8226943e8fc => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:28:36.566388 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3ea1b-5c5e-498b-9b2b-fcc7005a8d39 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:36.566860 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3ea1b-5c5e-498b-9b2b-fcc7005a8d39 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:36.567206 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3ea1b-5c5e-498b-9b2b-fcc7005a8d39 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:36.568836 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1342/2678] 10.222.0.27 () {54 vars in 921 bytes} [Wed Jun 29 12:28:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:28:36.575287 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03ea47-48ec-4ad0-aa21-1aa9af3ac3c1 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:36.575807 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03ea47-48ec-4ad0-aa21-1aa9af3ac3c1 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:36.576204 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03ea47-48ec-4ad0-aa21-1aa9af3ac3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:36.595971 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-5a03ea47-48ec-4ad0-aa21-1aa9af3ac3c1 None None] MFA Rules not processed for user `e94618bb382d46f7aaa2ef8f5d690bf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:28:36.597327 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-5a03ea47-48ec-4ad0-aa21-1aa9af3ac3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:36.657849 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1337/2679] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Jun 29 12:28:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:28:36.670460 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef3ea1b-5c5e-498b-9b2b-fcc7005a8d39 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:36.672987 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4ef3ea1b-5c5e-498b-9b2b-fcc7005a8d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:36.687131 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef3ea1b-5c5e-498b-9b2b-fcc7005a8d39 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:36.691041 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37985642-6ecd-4d20-a800-c350b6fbeae0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:36.691807 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37985642-6ecd-4d20-a800-c350b6fbeae0 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:36.692097 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37985642-6ecd-4d20-a800-c350b6fbeae0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:36.692388 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37985642-6ecd-4d20-a800-c350b6fbeae0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:36.700303 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37985642-6ecd-4d20-a800-c350b6fbeae0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:36.701804 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37985642-6ecd-4d20-a800-c350b6fbeae0 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:36.710733 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1343/2680] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:28:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:28:36.792769 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c1524-49cd-4f61-ac31-d478b85bbc88 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:36.793063 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c1524-49cd-4f61-ac31-d478b85bbc88 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:36.793345 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c1524-49cd-4f61-ac31-d478b85bbc88 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:36.794823 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1338/2681] 10.222.0.27 () {54 vars in 921 bytes} [Wed Jun 29 12:28:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:28:36.800373 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea16121-95b3-4a3b-9ed0-6b2853fdacda None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:36.800661 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea16121-95b3-4a3b-9ed0-6b2853fdacda None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:36.800938 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea16121-95b3-4a3b-9ed0-6b2853fdacda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:36.820605 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-5ea16121-95b3-4a3b-9ed0-6b2853fdacda None None] MFA Rules not processed for user `7adaa2ef440941aa8214f2b2fd49b54e`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:28:36.821854 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5ea16121-95b3-4a3b-9ed0-6b2853fdacda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:36.826226 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:28:36.901868 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1344/2682] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Jun 29 12:28:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:28:36.917618 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c1524-49cd-4f61-ac31-d478b85bbc88 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:36.921104 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-5f1c1524-49cd-4f61-ac31-d478b85bbc88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:36.942639 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c1524-49cd-4f61-ac31-d478b85bbc88 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:36.949301 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b1ce6-1971-43ab-af01-b9b8eba845cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:36.950089 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b1ce6-1971-43ab-af01-b9b8eba845cb service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:36.950494 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b1ce6-1971-43ab-af01-b9b8eba845cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:36.950984 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b1ce6-1971-43ab-af01-b9b8eba845cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:36.967842 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070b1ce6-1971-43ab-af01-b9b8eba845cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:36.969300 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070b1ce6-1971-43ab-af01-b9b8eba845cb service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:36.980966 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1339/2683] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:28:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:28:37.299473 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb00f7-4553-4db1-a4cb-20ed7067af6b None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:37.299871 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb00f7-4553-4db1-a4cb-20ed7067af6b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:37.300348 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb00f7-4553-4db1-a4cb-20ed7067af6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:37.321540 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-0ceb00f7-4553-4db1-a4cb-20ed7067af6b None None] MFA Rules not processed for user `cad33601754a462c828566fb54c6e100`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:28:37.322802 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0ceb00f7-4553-4db1-a4cb-20ed7067af6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:37.385310 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1345/2684] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Jun 29 12:28:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:28:37.407434 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b1ce6-1971-43ab-af01-b9b8eba845cb service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:37.409266 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-070b1ce6-1971-43ab-af01-b9b8eba845cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:37.432683 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:28:37.485378 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b1ce6-1971-43ab-af01-b9b8eba845cb service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:37.491025 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d323f2-9566-41fa-8c79-d84ee0652bd7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc92f8232bda407c84365eb10ede737f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:37.491890 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d323f2-9566-41fa-8c79-d84ee0652bd7 service swift] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:37.492029 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d323f2-9566-41fa-8c79-d84ee0652bd7 service swift] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:37.492309 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d323f2-9566-41fa-8c79-d84ee0652bd7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:37.501505 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d323f2-9566-41fa-8c79-d84ee0652bd7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:37.503150 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d323f2-9566-41fa-8c79-d84ee0652bd7 service swift] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:37.511752 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1340/2685] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Jun 29 12:28:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 12:28:38.121980 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11bd32-67c7-44fa-b26c-e305a9b62583 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:38.122501 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11bd32-67c7-44fa-b26c-e305a9b62583 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:38.122501 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11bd32-67c7-44fa-b26c-e305a9b62583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:38.141426 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-9f11bd32-67c7-44fa-b26c-e305a9b62583 None None] MFA Rules not processed for user `cad33601754a462c828566fb54c6e100`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:28:38.143065 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9f11bd32-67c7-44fa-b26c-e305a9b62583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:38.151912 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1346/2686] 10.222.0.27 () {58 vars in 967 bytes} [Wed Jun 29 12:28:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:28:38.166163 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d323f2-9566-41fa-8c79-d84ee0652bd7 service swift] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:38.179676 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d323f2-9566-41fa-8c79-d84ee0652bd7 service swift] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:38.189445 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe68045-0f94-4538-a7b9-1b4a939ec3d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc92f8232bda407c84365eb10ede737f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:38.190124 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe68045-0f94-4538-a7b9-1b4a939ec3d6 service swift] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:38.190409 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe68045-0f94-4538-a7b9-1b4a939ec3d6 service swift] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:38.190688 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe68045-0f94-4538-a7b9-1b4a939ec3d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:38.200038 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe68045-0f94-4538-a7b9-1b4a939ec3d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:38.201624 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe68045-0f94-4538-a7b9-1b4a939ec3d6 service swift] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:38.210840 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1341/2687] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Jun 29 12:28:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 12:28:38.440069 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196f0ac-1e9c-4933-a8ed-2f3c8fdd36a4 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:38.440362 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196f0ac-1e9c-4933-a8ed-2f3c8fdd36a4 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:38.440649 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196f0ac-1e9c-4933-a8ed-2f3c8fdd36a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:38.461455 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-1196f0ac-1e9c-4933-a8ed-2f3c8fdd36a4 None None] MFA Rules not processed for user `cad33601754a462c828566fb54c6e100`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:28:38.462731 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1196f0ac-1e9c-4933-a8ed-2f3c8fdd36a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:38.476395 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1347/2688] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Jun 29 12:28:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:28:38.486913 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe68045-0f94-4538-a7b9-1b4a939ec3d6 service swift] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:38.505123 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe68045-0f94-4538-a7b9-1b4a939ec3d6 service swift] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:38.512921 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600b12b2-5179-4f92-ba1b-9a787237a34e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc92f8232bda407c84365eb10ede737f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:38.513681 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b12b2-5179-4f92-ba1b-9a787237a34e service swift] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:38.514065 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b12b2-5179-4f92-ba1b-9a787237a34e service swift] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:38.514428 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b12b2-5179-4f92-ba1b-9a787237a34e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:38.525400 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600b12b2-5179-4f92-ba1b-9a787237a34e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:38.527047 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600b12b2-5179-4f92-ba1b-9a787237a34e service swift] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:38.544936 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1342/2689] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Jun 29 12:28:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 29 12:28:38.928120 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23ea47-1323-4bff-ab33-fd779baf6005 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:38.928541 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23ea47-1323-4bff-ab33-fd779baf6005 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:38.928937 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23ea47-1323-4bff-ab33-fd779baf6005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:38.949873 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-fa23ea47-1323-4bff-ab33-fd779baf6005 None None] MFA Rules not processed for user `cad33601754a462c828566fb54c6e100`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:28:38.951092 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-fa23ea47-1323-4bff-ab33-fd779baf6005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:38.964647 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1348/2690] 10.222.0.27 () {58 vars in 967 bytes} [Wed Jun 29 12:28:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:28:38.978815 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600b12b2-5179-4f92-ba1b-9a787237a34e service swift] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:38.990865 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600b12b2-5179-4f92-ba1b-9a787237a34e service swift] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:38.996971 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b792b05-27bd-4eed-879e-753b42973481 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc92f8232bda407c84365eb10ede737f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:38.997785 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b792b05-27bd-4eed-879e-753b42973481 service swift] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:38.998286 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b792b05-27bd-4eed-879e-753b42973481 service swift] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:38.998535 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b792b05-27bd-4eed-879e-753b42973481 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:39.007351 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b792b05-27bd-4eed-879e-753b42973481 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:39.009172 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b792b05-27bd-4eed-879e-753b42973481 service swift] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:39.017605 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1343/2691] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Jun 29 12:28:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 12:28:41.188058 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23ea47-1323-4bff-ab33-fd779baf6005 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:41.189748 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-fa23ea47-1323-4bff-ab33-fd779baf6005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:41.264866 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23ea47-1323-4bff-ab33-fd779baf6005 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:41.270424 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8fead5-43e9-4680-8bd6-32604ae8ada8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:41.271299 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fead5-43e9-4680-8bd6-32604ae8ada8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:41.271576 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fead5-43e9-4680-8bd6-32604ae8ada8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:41.271844 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fead5-43e9-4680-8bd6-32604ae8ada8 admin admin] PATH_INFO: `/v3/users/b191f31731b8448597bd13ba96d913de` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:41.273070 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8fead5-43e9-4680-8bd6-32604ae8ada8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b191f31731b8448597bd13ba96d913de)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:41.275138 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8fead5-43e9-4680-8bd6-32604ae8ada8 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:41.309757 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:28:41.331824 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7f8fead5-43e9-4680-8bd6-32604ae8ada8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b191f31731b8448597bd13ba96d913de'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:41.333168 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7f8fead5-43e9-4680-8bd6-32604ae8ada8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b191f31731b8448597bd13ba96d913de'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:41.333168 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7f8fead5-43e9-4680-8bd6-32604ae8ada8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b191f31731b8448597bd13ba96d913de'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:41.347873 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7f8fead5-43e9-4680-8bd6-32604ae8ada8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b191f31731b8448597bd13ba96d913de'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:41.357798 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7f8fead5-43e9-4680-8bd6-32604ae8ada8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b191f31731b8448597bd13ba96d913de'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:41.371194 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1349/2692] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:28:41 2022] DELETE /identity/v3/users/b191f31731b8448597bd13ba96d913de => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:28:41.375653 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983098e0-e7d7-43e1-b6ae-83565dfe9b83 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:41.376168 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983098e0-e7d7-43e1-b6ae-83565dfe9b83 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:41.376267 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983098e0-e7d7-43e1-b6ae-83565dfe9b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:41.396405 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-983098e0-e7d7-43e1-b6ae-83565dfe9b83 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:28:41.397614 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-983098e0-e7d7-43e1-b6ae-83565dfe9b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:41.460894 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1344/2693] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:28:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:28:41.470712 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8fead5-43e9-4680-8bd6-32604ae8ada8 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:41.472155 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7f8fead5-43e9-4680-8bd6-32604ae8ada8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:41.542484 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8fead5-43e9-4680-8bd6-32604ae8ada8 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:41.550756 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28b4f37-c4c6-4994-a591-7844f88c1d1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:41.552445 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b4f37-c4c6-4994-a591-7844f88c1d1c service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:41.552792 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b4f37-c4c6-4994-a591-7844f88c1d1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:41.553277 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b4f37-c4c6-4994-a591-7844f88c1d1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:41.567195 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28b4f37-c4c6-4994-a591-7844f88c1d1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:41.568673 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28b4f37-c4c6-4994-a591-7844f88c1d1c service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:41.582164 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1350/2694] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:28:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:28:41.782810 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983098e0-e7d7-43e1-b6ae-83565dfe9b83 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:41.784794 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-983098e0-e7d7-43e1-b6ae-83565dfe9b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:41.799813 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983098e0-e7d7-43e1-b6ae-83565dfe9b83 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:41.807888 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de64433-5bea-4648-b862-abdd32a54ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:41.809488 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de64433-5bea-4648-b862-abdd32a54ca7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:41.809955 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de64433-5bea-4648-b862-abdd32a54ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:41.810456 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de64433-5bea-4648-b862-abdd32a54ca7 admin admin] PATH_INFO: `/v3/projects/9908bcbeb64c497181f10cf3d0b96118` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:41.812553 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de64433-5bea-4648-b862-abdd32a54ca7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9908bcbeb64c497181f10cf3d0b96118)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:41.815885 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de64433-5bea-4648-b862-abdd32a54ca7 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:41.870879 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2de64433-5bea-4648-b862-abdd32a54ca7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9908bcbeb64c497181f10cf3d0b96118', 'request_id': 'req-2de64433-5bea-4648-b862-abdd32a54ca7'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:41.877025 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2de64433-5bea-4648-b862-abdd32a54ca7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9908bcbeb64c497181f10cf3d0b96118', 'request_id': 'req-2de64433-5bea-4648-b862-abdd32a54ca7'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:41.887185 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2de64433-5bea-4648-b862-abdd32a54ca7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9908bcbeb64c497181f10cf3d0b96118', 'request_id': 'req-2de64433-5bea-4648-b862-abdd32a54ca7'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:41.887998 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:28:41.900690 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2de64433-5bea-4648-b862-abdd32a54ca7 admin admin] The token cache is being invalidate because project 9908bcbeb64c497181f10cf3d0b96118 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:28:41.900976 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2de64433-5bea-4648-b862-abdd32a54ca7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:41.901679 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2de64433-5bea-4648-b862-abdd32a54ca7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:41.903358 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1345/2695] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:28:41 2022] DELETE /identity/v3/projects/9908bcbeb64c497181f10cf3d0b96118 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:28:41.909075 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24840de-ccd0-4800-ac72-08635c4e462b None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:41.909364 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24840de-ccd0-4800-ac72-08635c4e462b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:41.909666 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24840de-ccd0-4800-ac72-08635c4e462b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:41.928634 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-b24840de-ccd0-4800-ac72-08635c4e462b None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:28:41.929871 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b24840de-ccd0-4800-ac72-08635c4e462b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:41.996450 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1351/2696] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:28:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:28:42.006505 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6dc3d1-f8e0-4108-8ebf-67b59c7dc4df None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:42.006796 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6dc3d1-f8e0-4108-8ebf-67b59c7dc4df None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:42.007073 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6dc3d1-f8e0-4108-8ebf-67b59c7dc4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:42.026862 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-1b6dc3d1-f8e0-4108-8ebf-67b59c7dc4df None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:28:42.028089 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-1b6dc3d1-f8e0-4108-8ebf-67b59c7dc4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:42.036767 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1346/2697] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:28:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:28:42.041812 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24840de-ccd0-4800-ac72-08635c4e462b None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:42.055038 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24840de-ccd0-4800-ac72-08635c4e462b None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:42.061301 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00255e8-42b8-47d2-9272-3c779de886d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:42.061996 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00255e8-42b8-47d2-9272-3c779de886d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:42.062275 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00255e8-42b8-47d2-9272-3c779de886d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:42.062579 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00255e8-42b8-47d2-9272-3c779de886d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:42.063315 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00255e8-42b8-47d2-9272-3c779de886d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:28:42.063620 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00255e8-42b8-47d2-9272-3c779de886d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:42.065679 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00255e8-42b8-47d2-9272-3c779de886d1 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:42.078331 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1352/2698] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:28:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:28:42.083107 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6dc3d1-f8e0-4108-8ebf-67b59c7dc4df None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:42.093108 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6dc3d1-f8e0-4108-8ebf-67b59c7dc4df None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:42.099644 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ac898c-a0ad-4f1c-8bd9-5c4030f9e0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:42.100312 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac898c-a0ad-4f1c-8bd9-5c4030f9e0eb admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:42.100624 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac898c-a0ad-4f1c-8bd9-5c4030f9e0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:42.100910 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac898c-a0ad-4f1c-8bd9-5c4030f9e0eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:42.101603 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ac898c-a0ad-4f1c-8bd9-5c4030f9e0eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:42.103576 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ac898c-a0ad-4f1c-8bd9-5c4030f9e0eb admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:42.142234 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1347/2699] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:28:42 2022] POST /identity/v3/projects => generated 397 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:28:42.147006 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00255e8-42b8-47d2-9272-3c779de886d1 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:42.158074 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00255e8-42b8-47d2-9272-3c779de886d1 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:42.193683 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:28:42.221334 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50dfa61-13ac-4aba-9150-05d781eaba3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:42.221781 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50dfa61-13ac-4aba-9150-05d781eaba3d admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:42.222057 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50dfa61-13ac-4aba-9150-05d781eaba3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:42.222306 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50dfa61-13ac-4aba-9150-05d781eaba3d admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:42.223009 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50dfa61-13ac-4aba-9150-05d781eaba3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:42.224914 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50dfa61-13ac-4aba-9150-05d781eaba3d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:42.251646 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1353/2700] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:28:42 2022] POST /identity/v3/users => generated 299 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:28:42.253055 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ac898c-a0ad-4f1c-8bd9-5c4030f9e0eb admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:42.264548 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ac898c-a0ad-4f1c-8bd9-5c4030f9e0eb admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:42.270343 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c69d8d-fb2a-4d5e-bc89-506d1848d023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:42.271146 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c69d8d-fb2a-4d5e-bc89-506d1848d023 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:42.271424 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c69d8d-fb2a-4d5e-bc89-506d1848d023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:42.271695 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c69d8d-fb2a-4d5e-bc89-506d1848d023 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:42.272439 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c69d8d-fb2a-4d5e-bc89-506d1848d023 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:42.274077 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c69d8d-fb2a-4d5e-bc89-506d1848d023 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:42.285737 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1348/2701] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:28:42.290750 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50dfa61-13ac-4aba-9150-05d781eaba3d admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:42.303763 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50dfa61-13ac-4aba-9150-05d781eaba3d admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:42.309169 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e8a57f-6d30-43b7-9a3a-f9c555cb0fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:42.309870 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e8a57f-6d30-43b7-9a3a-f9c555cb0fd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:42.310153 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e8a57f-6d30-43b7-9a3a-f9c555cb0fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:42.310427 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e8a57f-6d30-43b7-9a3a-f9c555cb0fd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:42.311165 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e8a57f-6d30-43b7-9a3a-f9c555cb0fd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:42.312784 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e8a57f-6d30-43b7-9a3a-f9c555cb0fd8 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:42.323737 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1354/2702] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:28:42.328277 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c69d8d-fb2a-4d5e-bc89-506d1848d023 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:42.340008 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c69d8d-fb2a-4d5e-bc89-506d1848d023 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:42.346144 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3278fb-c03d-4aec-93d3-c29825c72c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:42.347042 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3278fb-c03d-4aec-93d3-c29825c72c7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:42.347357 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3278fb-c03d-4aec-93d3-c29825c72c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:42.347629 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3278fb-c03d-4aec-93d3-c29825c72c7d admin admin] PATH_INFO: `/v3/projects/bd5934f2cbf1497ebfc5be4ca85513c8/users/be0a5d3281bd4426b02f99cfde661284/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:42.365134 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3278fb-c03d-4aec-93d3-c29825c72c7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd5934f2cbf1497ebfc5be4ca85513c8, user_id=be0a5d3281bd4426b02f99cfde661284, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:42.367829 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3278fb-c03d-4aec-93d3-c29825c72c7d admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:42.383659 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1349/2703] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:28:42 2022] PUT /identity/v3/projects/bd5934f2cbf1497ebfc5be4ca85513c8/users/be0a5d3281bd4426b02f99cfde661284/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:28:42.394613 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cea994-2128-4f67-adf6-479a4d33cb44 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:42.394910 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cea994-2128-4f67-adf6-479a4d33cb44 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:42.395184 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cea994-2128-4f67-adf6-479a4d33cb44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:42.423661 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-22cea994-2128-4f67-adf6-479a4d33cb44 None None] MFA Rules not processed for user `be0a5d3281bd4426b02f99cfde661284`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:28:42.424838 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-22cea994-2128-4f67-adf6-479a4d33cb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:42.494621 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1355/2704] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:28:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:28:42.506815 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3278fb-c03d-4aec-93d3-c29825c72c7d admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:42.508550 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-0d3278fb-c03d-4aec-93d3-c29825c72c7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:42.577436 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3278fb-c03d-4aec-93d3-c29825c72c7d admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:42.582542 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae762438-a829-4ecf-b6e3-ec8c90b2f8c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:42.583207 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae762438-a829-4ecf-b6e3-ec8c90b2f8c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:42.583487 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae762438-a829-4ecf-b6e3-ec8c90b2f8c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:42.583754 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae762438-a829-4ecf-b6e3-ec8c90b2f8c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:42.601263 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae762438-a829-4ecf-b6e3-ec8c90b2f8c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:42.602777 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae762438-a829-4ecf-b6e3-ec8c90b2f8c3 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:42.616670 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1350/2705] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:28:42 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:28:47.687830 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cea994-2128-4f67-adf6-479a4d33cb44 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:47.756330 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cea994-2128-4f67-adf6-479a4d33cb44 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:47.761779 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507d941-c087-40bc-b843-fe51433badab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:47.762643 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507d941-c087-40bc-b843-fe51433badab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:47.762919 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507d941-c087-40bc-b843-fe51433badab admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:47.763190 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507d941-c087-40bc-b843-fe51433badab admin admin] PATH_INFO: `/v3/users/be0a5d3281bd4426b02f99cfde661284` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:47.764381 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c507d941-c087-40bc-b843-fe51433badab admin admin] RBAC: Authorizing `identity:delete_user(user_id=be0a5d3281bd4426b02f99cfde661284)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:47.766354 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c507d941-c087-40bc-b843-fe51433badab admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:47.816417 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:28:47.818512 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c507d941-c087-40bc-b843-fe51433badab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be0a5d3281bd4426b02f99cfde661284'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:47.819245 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c507d941-c087-40bc-b843-fe51433badab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be0a5d3281bd4426b02f99cfde661284'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:47.820089 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c507d941-c087-40bc-b843-fe51433badab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be0a5d3281bd4426b02f99cfde661284'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:47.834138 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c507d941-c087-40bc-b843-fe51433badab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be0a5d3281bd4426b02f99cfde661284'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:47.842839 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c507d941-c087-40bc-b843-fe51433badab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be0a5d3281bd4426b02f99cfde661284'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:47.855331 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1356/2706] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:28:47 2022] DELETE /identity/v3/users/be0a5d3281bd4426b02f99cfde661284 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:28:47.860160 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b01bec-5bd3-4930-a6ee-81081af6a63a None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:47.860702 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b01bec-5bd3-4930-a6ee-81081af6a63a None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:47.860823 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b01bec-5bd3-4930-a6ee-81081af6a63a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:47.881313 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-e4b01bec-5bd3-4930-a6ee-81081af6a63a None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:28:47.882565 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e4b01bec-5bd3-4930-a6ee-81081af6a63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:47.950790 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1351/2707] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:28:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:28:47.962210 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507d941-c087-40bc-b843-fe51433badab admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:47.964066 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c507d941-c087-40bc-b843-fe51433badab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:48.026002 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507d941-c087-40bc-b843-fe51433badab admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:48.029955 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d16afe-b9c0-46b6-a8a8-2f75d93c1645 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:48.030615 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d16afe-b9c0-46b6-a8a8-2f75d93c1645 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:48.030897 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d16afe-b9c0-46b6-a8a8-2f75d93c1645 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:48.031173 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d16afe-b9c0-46b6-a8a8-2f75d93c1645 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:48.041326 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d16afe-b9c0-46b6-a8a8-2f75d93c1645 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:48.042826 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d16afe-b9c0-46b6-a8a8-2f75d93c1645 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:48.053155 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1357/2708] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:28:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:28:48.350220 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b01bec-5bd3-4930-a6ee-81081af6a63a None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:48.351705 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e4b01bec-5bd3-4930-a6ee-81081af6a63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:48.364607 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b01bec-5bd3-4930-a6ee-81081af6a63a None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:48.370297 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3e1f51-540e-4c69-a977-33c45c7e2423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:48.371238 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e1f51-540e-4c69-a977-33c45c7e2423 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:48.371608 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e1f51-540e-4c69-a977-33c45c7e2423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:48.371950 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e1f51-540e-4c69-a977-33c45c7e2423 admin admin] PATH_INFO: `/v3/projects/bd5934f2cbf1497ebfc5be4ca85513c8` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:48.373762 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3e1f51-540e-4c69-a977-33c45c7e2423 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd5934f2cbf1497ebfc5be4ca85513c8)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:48.375629 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3e1f51-540e-4c69-a977-33c45c7e2423 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:48.412641 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:28:48.431414 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-5d3e1f51-540e-4c69-a977-33c45c7e2423 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd5934f2cbf1497ebfc5be4ca85513c8', 'request_id': 'req-5d3e1f51-540e-4c69-a977-33c45c7e2423'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:48.438046 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-5d3e1f51-540e-4c69-a977-33c45c7e2423 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd5934f2cbf1497ebfc5be4ca85513c8', 'request_id': 'req-5d3e1f51-540e-4c69-a977-33c45c7e2423'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:48.450103 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-5d3e1f51-540e-4c69-a977-33c45c7e2423 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd5934f2cbf1497ebfc5be4ca85513c8', 'request_id': 'req-5d3e1f51-540e-4c69-a977-33c45c7e2423'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:48.466076 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-5d3e1f51-540e-4c69-a977-33c45c7e2423 admin admin] The token cache is being invalidate because project bd5934f2cbf1497ebfc5be4ca85513c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:28:48.466294 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-5d3e1f51-540e-4c69-a977-33c45c7e2423 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:48.467028 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-5d3e1f51-540e-4c69-a977-33c45c7e2423 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:28:48.468675 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1352/2709] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:28:48 2022] DELETE /identity/v3/projects/bd5934f2cbf1497ebfc5be4ca85513c8 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:28:48.473984 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487cf831-4ed7-4e9a-9a64-21fad83fd4eb None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:48.474368 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487cf831-4ed7-4e9a-9a64-21fad83fd4eb None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:48.474769 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487cf831-4ed7-4e9a-9a64-21fad83fd4eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:48.496571 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-487cf831-4ed7-4e9a-9a64-21fad83fd4eb None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:28:48.497789 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-487cf831-4ed7-4e9a-9a64-21fad83fd4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:48.564299 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1358/2710] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:28:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:28:48.573795 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d139eb1-bf39-43e6-9221-38a7282013e8 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:48.574232 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d139eb1-bf39-43e6-9221-38a7282013e8 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:48.574603 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d139eb1-bf39-43e6-9221-38a7282013e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:48.602140 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-2d139eb1-bf39-43e6-9221-38a7282013e8 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:28:48.603358 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-2d139eb1-bf39-43e6-9221-38a7282013e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:48.613390 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1353/2711] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:28:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:28:48.618226 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487cf831-4ed7-4e9a-9a64-21fad83fd4eb None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:48.629131 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487cf831-4ed7-4e9a-9a64-21fad83fd4eb None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:48.635093 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90215235-e6c5-42e0-9f5e-44a50c077e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:48.635753 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90215235-e6c5-42e0-9f5e-44a50c077e06 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:48.636034 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90215235-e6c5-42e0-9f5e-44a50c077e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:48.636295 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90215235-e6c5-42e0-9f5e-44a50c077e06 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:48.637025 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90215235-e6c5-42e0-9f5e-44a50c077e06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:28:48.637330 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90215235-e6c5-42e0-9f5e-44a50c077e06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:48.638977 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90215235-e6c5-42e0-9f5e-44a50c077e06 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:48.652180 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1359/2712] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:28:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:28:48.658671 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d139eb1-bf39-43e6-9221-38a7282013e8 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:48.668679 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d139eb1-bf39-43e6-9221-38a7282013e8 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:48.674310 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf64e8cf-f47d-4976-8a7d-69dfeea070c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:48.674991 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64e8cf-f47d-4976-8a7d-69dfeea070c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:48.675260 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64e8cf-f47d-4976-8a7d-69dfeea070c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:48.675532 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64e8cf-f47d-4976-8a7d-69dfeea070c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:48.676667 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf64e8cf-f47d-4976-8a7d-69dfeea070c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:48.678549 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf64e8cf-f47d-4976-8a7d-69dfeea070c0 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:48.708446 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1354/2713] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:28:48 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:28:48.714866 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90215235-e6c5-42e0-9f5e-44a50c077e06 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:48.728596 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90215235-e6c5-42e0-9f5e-44a50c077e06 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:48.781197 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:28:48.792884 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf83a6-a426-4fb7-b4d4-8170fb87931b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:48.793572 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf83a6-a426-4fb7-b4d4-8170fb87931b admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:48.793889 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf83a6-a426-4fb7-b4d4-8170fb87931b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:48.794171 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf83a6-a426-4fb7-b4d4-8170fb87931b admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:48.794873 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdf83a6-a426-4fb7-b4d4-8170fb87931b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:48.796803 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdf83a6-a426-4fb7-b4d4-8170fb87931b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:48.819810 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1360/2714] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:28:48 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:28:48.824645 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf64e8cf-f47d-4976-8a7d-69dfeea070c0 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:48.840482 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf64e8cf-f47d-4976-8a7d-69dfeea070c0 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:48.848424 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc78ba-5160-4c7a-a859-01aa01d69fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:48.849099 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc78ba-5160-4c7a-a859-01aa01d69fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:48.849378 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc78ba-5160-4c7a-a859-01aa01d69fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:48.849653 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc78ba-5160-4c7a-a859-01aa01d69fe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:48.850432 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc78ba-5160-4c7a-a859-01aa01d69fe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:48.852085 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc78ba-5160-4c7a-a859-01aa01d69fe5 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:48.863467 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1355/2715] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:28:48.868836 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf83a6-a426-4fb7-b4d4-8170fb87931b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:48.879427 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf83a6-a426-4fb7-b4d4-8170fb87931b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:48.885258 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c8686-8965-488b-92e2-1a101dbf652b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:48.886039 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c8686-8965-488b-92e2-1a101dbf652b admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:48.886636 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c8686-8965-488b-92e2-1a101dbf652b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:48.886636 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c8686-8965-488b-92e2-1a101dbf652b admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:48.887288 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4c8686-8965-488b-92e2-1a101dbf652b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:48.888881 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4c8686-8965-488b-92e2-1a101dbf652b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:48.899763 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1361/2716] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:28:48.904094 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc78ba-5160-4c7a-a859-01aa01d69fe5 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:48.915409 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc78ba-5160-4c7a-a859-01aa01d69fe5 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:48.920221 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca5825-11aa-4eb1-8d0a-702fa83a0fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:48.921113 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca5825-11aa-4eb1-8d0a-702fa83a0fb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:48.921394 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca5825-11aa-4eb1-8d0a-702fa83a0fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:48.921666 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca5825-11aa-4eb1-8d0a-702fa83a0fb4 admin admin] PATH_INFO: `/v3/projects/7e4bc047d3c941d2b6e23b6ca56e995f/users/2310114acbaa46e0b93827dd3dde92f6/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:48.937016 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ca5825-11aa-4eb1-8d0a-702fa83a0fb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e4bc047d3c941d2b6e23b6ca56e995f, user_id=2310114acbaa46e0b93827dd3dde92f6, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:48.940004 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ca5825-11aa-4eb1-8d0a-702fa83a0fb4 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:48.958829 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1356/2717] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:28:48 2022] PUT /identity/v3/projects/7e4bc047d3c941d2b6e23b6ca56e995f/users/2310114acbaa46e0b93827dd3dde92f6/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:28:48.964190 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88670e9-1cbf-4d60-bc4b-05d930e63b46 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:48.964484 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88670e9-1cbf-4d60-bc4b-05d930e63b46 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:48.964761 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88670e9-1cbf-4d60-bc4b-05d930e63b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:48.984075 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f88670e9-1cbf-4d60-bc4b-05d930e63b46 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:28:48.985228 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f88670e9-1cbf-4d60-bc4b-05d930e63b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:49.058801 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1362/2718] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:28:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:28:49.069043 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca5825-11aa-4eb1-8d0a-702fa83a0fb4 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:49.070960 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-37ca5825-11aa-4eb1-8d0a-702fa83a0fb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:49.133653 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca5825-11aa-4eb1-8d0a-702fa83a0fb4 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:49.137596 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ec8b2-0c15-4bb6-8e9d-576143deefd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:49.138276 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ec8b2-0c15-4bb6-8e9d-576143deefd5 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:49.138558 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ec8b2-0c15-4bb6-8e9d-576143deefd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:49.138828 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ec8b2-0c15-4bb6-8e9d-576143deefd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:49.148439 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3ec8b2-0c15-4bb6-8e9d-576143deefd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:49.149907 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3ec8b2-0c15-4bb6-8e9d-576143deefd5 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:49.159748 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1357/2719] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:28:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:28:53.214862 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef910ab7-8844-42f7-873b-c2f6e8d73e6a None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:53.215415 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef910ab7-8844-42f7-873b-c2f6e8d73e6a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:53.215605 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef910ab7-8844-42f7-873b-c2f6e8d73e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:53.244772 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-ef910ab7-8844-42f7-873b-c2f6e8d73e6a None None] MFA Rules not processed for user `2310114acbaa46e0b93827dd3dde92f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:28:53.246148 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ef910ab7-8844-42f7-873b-c2f6e8d73e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:53.348027 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1363/2720] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:28:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:28:53.352882 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ec8b2-0c15-4bb6-8e9d-576143deefd5 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:53.363453 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ec8b2-0c15-4bb6-8e9d-576143deefd5 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:53.369087 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c09c1f-4601-4e2a-b24f-25ebda39935b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:53.369807 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c09c1f-4601-4e2a-b24f-25ebda39935b admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:53.370084 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c09c1f-4601-4e2a-b24f-25ebda39935b admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:53.370359 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c09c1f-4601-4e2a-b24f-25ebda39935b admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:53.371032 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c09c1f-4601-4e2a-b24f-25ebda39935b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:53.372970 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c09c1f-4601-4e2a-b24f-25ebda39935b admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:53.406150 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1358/2721] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:28:53 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:28:53.410556 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef910ab7-8844-42f7-873b-c2f6e8d73e6a None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:53.422112 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef910ab7-8844-42f7-873b-c2f6e8d73e6a None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:53.485653 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe873599-692c-4435-ab8d-1957765d5b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:53.486383 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe873599-692c-4435-ab8d-1957765d5b48 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:53.486663 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe873599-692c-4435-ab8d-1957765d5b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:53.486937 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe873599-692c-4435-ab8d-1957765d5b48 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:53.487657 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe873599-692c-4435-ab8d-1957765d5b48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:53.489767 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe873599-692c-4435-ab8d-1957765d5b48 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:53.498410 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:28:53.514899 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1364/2722] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:28:53 2022] POST /identity/v3/users => generated 298 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:28:53.518949 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c09c1f-4601-4e2a-b24f-25ebda39935b admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:53.530494 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c09c1f-4601-4e2a-b24f-25ebda39935b admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:53.535334 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b3817-d2ce-4b28-9be4-6865d43c54fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:53.536011 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b3817-d2ce-4b28-9be4-6865d43c54fa admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:53.536375 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b3817-d2ce-4b28-9be4-6865d43c54fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:53.536658 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b3817-d2ce-4b28-9be4-6865d43c54fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:53.537568 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54b3817-d2ce-4b28-9be4-6865d43c54fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:53.539280 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54b3817-d2ce-4b28-9be4-6865d43c54fa admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:53.551735 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1359/2723] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:28:53.556358 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe873599-692c-4435-ab8d-1957765d5b48 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:53.567088 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe873599-692c-4435-ab8d-1957765d5b48 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:53.572428 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeaec4e-dd3f-4837-9cb1-5ffbe37bcb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:53.573339 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeaec4e-dd3f-4837-9cb1-5ffbe37bcb34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:53.573731 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeaec4e-dd3f-4837-9cb1-5ffbe37bcb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:53.574021 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeaec4e-dd3f-4837-9cb1-5ffbe37bcb34 admin admin] PATH_INFO: `/v3/projects/17c15317ea8a46529f8c839886968a34/users/01ecbdef89384d76bfdca85b71d24527/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:53.590502 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeaec4e-dd3f-4837-9cb1-5ffbe37bcb34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17c15317ea8a46529f8c839886968a34, user_id=01ecbdef89384d76bfdca85b71d24527, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:53.593495 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeaec4e-dd3f-4837-9cb1-5ffbe37bcb34 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:53.609191 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1365/2724] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:28:53 2022] PUT /identity/v3/projects/17c15317ea8a46529f8c839886968a34/users/01ecbdef89384d76bfdca85b71d24527/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:28:53.613290 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b3817-d2ce-4b28-9be4-6865d43c54fa admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:53.624680 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b3817-d2ce-4b28-9be4-6865d43c54fa admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:53.644340 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:28:53.686871 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a91b7-cb53-4df7-9cd1-3c0a40e23a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:53.687554 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a91b7-cb53-4df7-9cd1-3c0a40e23a61 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:53.687836 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a91b7-cb53-4df7-9cd1-3c0a40e23a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:53.688114 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a91b7-cb53-4df7-9cd1-3c0a40e23a61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:53.688872 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a91b7-cb53-4df7-9cd1-3c0a40e23a61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:53.690545 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a91b7-cb53-4df7-9cd1-3c0a40e23a61 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:53.701925 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1360/2725] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:28:53.706183 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeaec4e-dd3f-4837-9cb1-5ffbe37bcb34 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:53.718015 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeaec4e-dd3f-4837-9cb1-5ffbe37bcb34 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:53.722949 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67389a98-ef32-43ce-ac5b-4a85f4d5cd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:53.723869 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67389a98-ef32-43ce-ac5b-4a85f4d5cd77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:53.724157 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67389a98-ef32-43ce-ac5b-4a85f4d5cd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:53.724456 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67389a98-ef32-43ce-ac5b-4a85f4d5cd77 admin admin] PATH_INFO: `/v3/projects/17c15317ea8a46529f8c839886968a34/users/01ecbdef89384d76bfdca85b71d24527/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:53.726547 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67389a98-ef32-43ce-ac5b-4a85f4d5cd77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17c15317ea8a46529f8c839886968a34, user_id=01ecbdef89384d76bfdca85b71d24527, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:53.729268 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67389a98-ef32-43ce-ac5b-4a85f4d5cd77 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:53.741294 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1366/2726] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:28:53 2022] PUT /identity/v3/projects/17c15317ea8a46529f8c839886968a34/users/01ecbdef89384d76bfdca85b71d24527/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:28:58.118913 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d829b8a-59cb-4630-bb29-c80e185d6177 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:58.119406 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d829b8a-59cb-4630-bb29-c80e185d6177 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:58.119585 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d829b8a-59cb-4630-bb29-c80e185d6177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:58.147459 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-6d829b8a-59cb-4630-bb29-c80e185d6177 None None] MFA Rules not processed for user `01ecbdef89384d76bfdca85b71d24527`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:28:58.148604 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-6d829b8a-59cb-4630-bb29-c80e185d6177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:58.226166 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1361/2727] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:28:58 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:28:58.238542 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67389a98-ef32-43ce-ac5b-4a85f4d5cd77 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:58.240745 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-67389a98-ef32-43ce-ac5b-4a85f4d5cd77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:58.309244 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67389a98-ef32-43ce-ac5b-4a85f4d5cd77 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:58.313072 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478db4c6-2bda-4f40-abf3-520758ea06eb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd865d1b935a54ca2b44beda5b0277336', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:58.313792 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478db4c6-2bda-4f40-abf3-520758ea06eb service glance] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:58.314076 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478db4c6-2bda-4f40-abf3-520758ea06eb service glance] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:58.314351 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478db4c6-2bda-4f40-abf3-520758ea06eb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:58.374531 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478db4c6-2bda-4f40-abf3-520758ea06eb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:58.375903 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478db4c6-2bda-4f40-abf3-520758ea06eb service glance] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:58.386851 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1367/2728] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:28:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:28:58.497332 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd13199-1db1-4ab7-a0ed-c55cceeb68d4 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:58.497629 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd13199-1db1-4ab7-a0ed-c55cceeb68d4 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:58.497960 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd13199-1db1-4ab7-a0ed-c55cceeb68d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:58.515851 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-afd13199-1db1-4ab7-a0ed-c55cceeb68d4 None None] MFA Rules not processed for user `cad33601754a462c828566fb54c6e100`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:28:58.517070 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-afd13199-1db1-4ab7-a0ed-c55cceeb68d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:58.581303 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1362/2729] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Jun 29 12:28:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:28:58.594172 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478db4c6-2bda-4f40-abf3-520758ea06eb service glance] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:28:58.595778 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-478db4c6-2bda-4f40-abf3-520758ea06eb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:28:58.674274 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478db4c6-2bda-4f40-abf3-520758ea06eb service glance] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:28:58.679866 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf58068-fa2e-46ed-ba65-15eff7872057 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc92f8232bda407c84365eb10ede737f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:28:58.680473 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf58068-fa2e-46ed-ba65-15eff7872057 service swift] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:28:58.680752 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf58068-fa2e-46ed-ba65-15eff7872057 service swift] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:28:58.681021 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf58068-fa2e-46ed-ba65-15eff7872057 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:28:58.692582 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf58068-fa2e-46ed-ba65-15eff7872057 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:28:58.697361 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf58068-fa2e-46ed-ba65-15eff7872057 service swift] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:28:58.701546 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:28:58.708555 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1368/2730] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Jun 29 12:28:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 12:29:07.530241 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6e34a-f9b3-4cd0-aec4-fde0d35aef31 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:29:07.530823 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6e34a-f9b3-4cd0-aec4-fde0d35aef31 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:29:07.530823 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6e34a-f9b3-4cd0-aec4-fde0d35aef31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:29:07.549300 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-99a6e34a-f9b3-4cd0-aec4-fde0d35aef31 None None] MFA Rules not processed for user `2310114acbaa46e0b93827dd3dde92f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:29:07.550918 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-99a6e34a-f9b3-4cd0-aec4-fde0d35aef31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:29:07.558966 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1363/2731] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:29:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:29:08.658721 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf58068-fa2e-46ed-ba65-15eff7872057 service swift] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:29:08.660585 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5cf58068-fa2e-46ed-ba65-15eff7872057 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:29:08.736502 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf58068-fa2e-46ed-ba65-15eff7872057 service swift] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:29:08.743864 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd4d32-5a4c-45db-b439-3ad02595a788 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '286a99b42d9246db909040bf8ab18ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:29:08.744782 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd4d32-5a4c-45db-b439-3ad02595a788 service placement] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:29:08.745224 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd4d32-5a4c-45db-b439-3ad02595a788 service placement] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:29:08.745570 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd4d32-5a4c-45db-b439-3ad02595a788 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:29:08.747581 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e9bd4d32-5a4c-45db-b439-3ad02595a788 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:29:08.761224 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bd4d32-5a4c-45db-b439-3ad02595a788 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:29:08.764454 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bd4d32-5a4c-45db-b439-3ad02595a788 service placement] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:29:08.775432 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1369/2732] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:29:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:29:09.598331 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d63c6-9dc6-4238-b919-b389909daa2f None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:29:09.598889 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d63c6-9dc6-4238-b919-b389909daa2f None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:29:09.598889 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d63c6-9dc6-4238-b919-b389909daa2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:29:09.619321 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-ad3d63c6-9dc6-4238-b919-b389909daa2f None None] MFA Rules not processed for user `cad33601754a462c828566fb54c6e100`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:29:09.620590 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ad3d63c6-9dc6-4238-b919-b389909daa2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:29:09.628918 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1364/2733] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Jun 29 12:29:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:29:09.641629 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd4d32-5a4c-45db-b439-3ad02595a788 service placement] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:29:09.653382 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd4d32-5a4c-45db-b439-3ad02595a788 service placement] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:29:09.658599 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1033f3de-ce36-452c-89fa-06f20f53ebd0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc92f8232bda407c84365eb10ede737f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:29:09.659271 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033f3de-ce36-452c-89fa-06f20f53ebd0 service swift] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:29:09.659839 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033f3de-ce36-452c-89fa-06f20f53ebd0 service swift] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:29:09.659839 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033f3de-ce36-452c-89fa-06f20f53ebd0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:29:09.669179 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1033f3de-ce36-452c-89fa-06f20f53ebd0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:29:09.670805 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1033f3de-ce36-452c-89fa-06f20f53ebd0 service swift] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:29:09.679588 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1370/2734] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Jun 29 12:29:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 12:29:19.613427 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=84 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:29:19.677384 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=39 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:29:30.114972 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3d63c6-9dc6-4238-b919-b389909daa2f None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:29:30.172224 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3d63c6-9dc6-4238-b919-b389909daa2f None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:29:30.177276 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce80d1-76a2-4f67-8122-42577d0dfb3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:29:30.177965 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce80d1-76a2-4f67-8122-42577d0dfb3d service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:29:30.178248 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce80d1-76a2-4f67-8122-42577d0dfb3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:29:30.178515 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce80d1-76a2-4f67-8122-42577d0dfb3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:29:30.189144 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce80d1-76a2-4f67-8122-42577d0dfb3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:29:30.190638 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce80d1-76a2-4f67-8122-42577d0dfb3d service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:29:30.200882 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1365/2735] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:29:30 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:29:35.983562 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447e6f0-97e0-4153-9415-b117153ce553 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:29:35.984088 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447e6f0-97e0-4153-9415-b117153ce553 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:29:35.984196 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447e6f0-97e0-4153-9415-b117153ce553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:29:36.003722 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-4447e6f0-97e0-4153-9415-b117153ce553 None None] MFA Rules not processed for user `cad33601754a462c828566fb54c6e100`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:29:36.005038 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4447e6f0-97e0-4153-9415-b117153ce553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:29:36.012822 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1371/2736] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Jun 29 12:29:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:29:36.027590 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce80d1-76a2-4f67-8122-42577d0dfb3d service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:29:36.042128 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce80d1-76a2-4f67-8122-42577d0dfb3d service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:29:36.048699 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c594213-9665-465b-8e0b-1233495033ee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc92f8232bda407c84365eb10ede737f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:29:36.049727 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c594213-9665-465b-8e0b-1233495033ee service swift] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:29:36.050042 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c594213-9665-465b-8e0b-1233495033ee service swift] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:29:36.050309 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c594213-9665-465b-8e0b-1233495033ee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:29:36.061935 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c594213-9665-465b-8e0b-1233495033ee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:29:36.063568 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c594213-9665-465b-8e0b-1233495033ee service swift] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:29:36.072665 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1366/2737] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Jun 29 12:29:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 12:29:45.997876 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:29:46.068904 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=32 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:29:49.358591 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11695a9b-874b-4b2e-8026-4c29a8dab669 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:29:49.359186 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11695a9b-874b-4b2e-8026-4c29a8dab669 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:29:49.359186 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11695a9b-874b-4b2e-8026-4c29a8dab669 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:29:49.360545 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1372/2738] 10.222.0.27 () {54 vars in 921 bytes} [Wed Jun 29 12:29:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 12:29:49.365402 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb781ad4-b4da-465e-9586-08fe93a5192a None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:29:49.365925 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb781ad4-b4da-465e-9586-08fe93a5192a None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:29:49.366150 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb781ad4-b4da-465e-9586-08fe93a5192a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:29:49.385092 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-cb781ad4-b4da-465e-9586-08fe93a5192a None None] MFA Rules not processed for user `7adaa2ef440941aa8214f2b2fd49b54e`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:29:49.386611 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-cb781ad4-b4da-465e-9586-08fe93a5192a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:29:49.458261 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1367/2739] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Jun 29 12:29:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:29:49.470808 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11695a9b-874b-4b2e-8026-4c29a8dab669 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:29:49.482192 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11695a9b-874b-4b2e-8026-4c29a8dab669 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:29:49.485851 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca8be00-a68c-436e-b764-89f255501753 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd865d1b935a54ca2b44beda5b0277336', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:29:49.486512 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8be00-a68c-436e-b764-89f255501753 service glance] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:29:49.486795 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8be00-a68c-436e-b764-89f255501753 service glance] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:29:49.487065 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8be00-a68c-436e-b764-89f255501753 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:29:49.501956 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca8be00-a68c-436e-b764-89f255501753 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:29:49.503408 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca8be00-a68c-436e-b764-89f255501753 service glance] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:29:49.514538 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1373/2740] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:29:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:29:51.241882 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad13df-0189-4d92-8565-9c672ac98f56 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:29:51.242415 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad13df-0189-4d92-8565-9c672ac98f56 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:29:51.242415 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad13df-0189-4d92-8565-9c672ac98f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:29:51.261222 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-a3ad13df-0189-4d92-8565-9c672ac98f56 None None] MFA Rules not processed for user `cad33601754a462c828566fb54c6e100`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:29:51.262496 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a3ad13df-0189-4d92-8565-9c672ac98f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:29:51.270462 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1368/2741] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Jun 29 12:29:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:29:51.285895 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca8be00-a68c-436e-b764-89f255501753 service glance] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:29:51.298052 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca8be00-a68c-436e-b764-89f255501753 service glance] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:29:51.304435 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c615a-884b-41de-83e1-4da0abc01006 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc92f8232bda407c84365eb10ede737f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:29:51.305081 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c615a-884b-41de-83e1-4da0abc01006 service swift] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:29:51.305383 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c615a-884b-41de-83e1-4da0abc01006 service swift] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:29:51.305661 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c615a-884b-41de-83e1-4da0abc01006 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:29:51.315852 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26c615a-884b-41de-83e1-4da0abc01006 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:29:51.318446 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26c615a-884b-41de-83e1-4da0abc01006 service swift] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:29:51.332023 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1374/2742] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Jun 29 12:29:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 12:30:01.255738 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=34 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:30:01.325949 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=12 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:30:05.071212 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7deb38-c2b7-4945-aea9-16504bf61560 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:05.071869 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7deb38-c2b7-4945-aea9-16504bf61560 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:05.071869 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7deb38-c2b7-4945-aea9-16504bf61560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:05.091092 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-5d7deb38-c2b7-4945-aea9-16504bf61560 None None] MFA Rules not processed for user `cad33601754a462c828566fb54c6e100`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:30:05.092777 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-5d7deb38-c2b7-4945-aea9-16504bf61560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:30:05.101590 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1369/2743] 10.222.0.27 () {58 vars in 967 bytes} [Wed Jun 29 12:30:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:30:05.115790 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c615a-884b-41de-83e1-4da0abc01006 service swift] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:30:05.127306 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c615a-884b-41de-83e1-4da0abc01006 service swift] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:30:05.134688 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f133bf30-9d39-4745-9df4-188586ee92e3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc92f8232bda407c84365eb10ede737f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:30:05.135418 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133bf30-9d39-4745-9df4-188586ee92e3 service swift] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:05.135702 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133bf30-9d39-4745-9df4-188586ee92e3 service swift] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:05.135975 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133bf30-9d39-4745-9df4-188586ee92e3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:05.146899 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f133bf30-9d39-4745-9df4-188586ee92e3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:30:05.149402 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f133bf30-9d39-4745-9df4-188586ee92e3 service swift] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:30:05.160926 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1375/2744] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Jun 29 12:30:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 12:30:12.815906 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7deb38-c2b7-4945-aea9-16504bf61560 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:30:12.817457 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-5d7deb38-c2b7-4945-aea9-16504bf61560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:30:12.911775 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7deb38-c2b7-4945-aea9-16504bf61560 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:30:12.917467 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8cb4e-8af5-40bb-a5db-419fb16131f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:30:12.918562 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8cb4e-8af5-40bb-a5db-419fb16131f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:12.919002 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8cb4e-8af5-40bb-a5db-419fb16131f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:12.919281 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8cb4e-8af5-40bb-a5db-419fb16131f7 admin admin] PATH_INFO: `/v3/users/097db64718d54e54ba05712930f21810` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:12.920613 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8cb4e-8af5-40bb-a5db-419fb16131f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=097db64718d54e54ba05712930f21810)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:30:12.924204 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8cb4e-8af5-40bb-a5db-419fb16131f7 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:30:12.987083 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-66a8cb4e-8af5-40bb-a5db-419fb16131f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '097db64718d54e54ba05712930f21810'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:30:13.002142 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-66a8cb4e-8af5-40bb-a5db-419fb16131f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '097db64718d54e54ba05712930f21810'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:30:13.009088 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-66a8cb4e-8af5-40bb-a5db-419fb16131f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '097db64718d54e54ba05712930f21810'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:30:13.009909 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-66a8cb4e-8af5-40bb-a5db-419fb16131f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '097db64718d54e54ba05712930f21810'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:30:13.018312 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-66a8cb4e-8af5-40bb-a5db-419fb16131f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '097db64718d54e54ba05712930f21810'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:30:13.025181 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1370/2745] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:30:12 2022] DELETE /identity/v3/users/097db64718d54e54ba05712930f21810 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:30:13.228244 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f133bf30-9d39-4745-9df4-188586ee92e3 service swift] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:30:13.242063 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f133bf30-9d39-4745-9df4-188586ee92e3 service swift] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:30:13.308751 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b4ee1-3fb0-4238-bcd1-0a8504104b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:30:13.309765 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b4ee1-3fb0-4238-bcd1-0a8504104b33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:13.310059 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b4ee1-3fb0-4238-bcd1-0a8504104b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:13.310335 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b4ee1-3fb0-4238-bcd1-0a8504104b33 admin admin] PATH_INFO: `/v3/projects/d4945631025f4741ad5cb9f0a4332133` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:13.312421 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4b4ee1-3fb0-4238-bcd1-0a8504104b33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4945631025f4741ad5cb9f0a4332133)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:30:13.314680 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4b4ee1-3fb0-4238-bcd1-0a8504104b33 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:30:13.362637 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8f4b4ee1-3fb0-4238-bcd1-0a8504104b33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4945631025f4741ad5cb9f0a4332133', 'request_id': 'req-8f4b4ee1-3fb0-4238-bcd1-0a8504104b33'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:30:13.368367 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8f4b4ee1-3fb0-4238-bcd1-0a8504104b33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4945631025f4741ad5cb9f0a4332133', 'request_id': 'req-8f4b4ee1-3fb0-4238-bcd1-0a8504104b33'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:30:13.377884 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8f4b4ee1-3fb0-4238-bcd1-0a8504104b33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4945631025f4741ad5cb9f0a4332133', 'request_id': 'req-8f4b4ee1-3fb0-4238-bcd1-0a8504104b33'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:30:13.391467 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8f4b4ee1-3fb0-4238-bcd1-0a8504104b33 admin admin] The token cache is being invalidate because project d4945631025f4741ad5cb9f0a4332133 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:30:13.391834 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8f4b4ee1-3fb0-4238-bcd1-0a8504104b33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:30:13.392669 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8f4b4ee1-3fb0-4238-bcd1-0a8504104b33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:30:13.395035 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1376/2746] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:30:13 2022] DELETE /identity/v3/projects/d4945631025f4741ad5cb9f0a4332133 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:30:13.399263 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8cb4e-8af5-40bb-a5db-419fb16131f7 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:30:13.400897 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-66a8cb4e-8af5-40bb-a5db-419fb16131f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:30:13.414953 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8cb4e-8af5-40bb-a5db-419fb16131f7 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:30:13.483001 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f264256b-aaa5-444a-b60a-3ef036b91f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:30:13.483884 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264256b-aaa5-444a-b60a-3ef036b91f72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:13.484170 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264256b-aaa5-444a-b60a-3ef036b91f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:13.484451 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264256b-aaa5-444a-b60a-3ef036b91f72 admin admin] PATH_INFO: `/v3/users/f69b32b32a144f6eb6a9a2d2af4dd74f` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:13.485757 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f264256b-aaa5-444a-b60a-3ef036b91f72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f69b32b32a144f6eb6a9a2d2af4dd74f)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:30:13.487869 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f264256b-aaa5-444a-b60a-3ef036b91f72 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:30:13.507013 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:30:13.549306 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f264256b-aaa5-444a-b60a-3ef036b91f72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f69b32b32a144f6eb6a9a2d2af4dd74f'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:30:13.562936 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f264256b-aaa5-444a-b60a-3ef036b91f72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f69b32b32a144f6eb6a9a2d2af4dd74f'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:30:13.570352 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f264256b-aaa5-444a-b60a-3ef036b91f72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f69b32b32a144f6eb6a9a2d2af4dd74f'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:30:13.571138 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f264256b-aaa5-444a-b60a-3ef036b91f72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f69b32b32a144f6eb6a9a2d2af4dd74f'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:30:13.581827 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f264256b-aaa5-444a-b60a-3ef036b91f72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f69b32b32a144f6eb6a9a2d2af4dd74f'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:30:13.588641 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1371/2747] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:30:13 2022] DELETE /identity/v3/users/f69b32b32a144f6eb6a9a2d2af4dd74f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:30:13.773846 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b4ee1-3fb0-4238-bcd1-0a8504104b33 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:30:13.775394 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8f4b4ee1-3fb0-4238-bcd1-0a8504104b33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:30:13.789394 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b4ee1-3fb0-4238-bcd1-0a8504104b33 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:30:13.867871 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd58b61-ed15-40d1-9fe9-d02687195c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:30:13.868806 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd58b61-ed15-40d1-9fe9-d02687195c96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:13.869081 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd58b61-ed15-40d1-9fe9-d02687195c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:13.869352 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd58b61-ed15-40d1-9fe9-d02687195c96 admin admin] PATH_INFO: `/v3/projects/33d13c6f301f401e8284d7b17a4312e5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:13.870869 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd58b61-ed15-40d1-9fe9-d02687195c96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33d13c6f301f401e8284d7b17a4312e5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:30:13.873760 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd58b61-ed15-40d1-9fe9-d02687195c96 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:30:13.901300 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:30:13.931791 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1cd58b61-ed15-40d1-9fe9-d02687195c96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33d13c6f301f401e8284d7b17a4312e5', 'request_id': 'req-1cd58b61-ed15-40d1-9fe9-d02687195c96'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:30:13.938122 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1cd58b61-ed15-40d1-9fe9-d02687195c96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33d13c6f301f401e8284d7b17a4312e5', 'request_id': 'req-1cd58b61-ed15-40d1-9fe9-d02687195c96'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:30:13.950592 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1cd58b61-ed15-40d1-9fe9-d02687195c96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33d13c6f301f401e8284d7b17a4312e5', 'request_id': 'req-1cd58b61-ed15-40d1-9fe9-d02687195c96'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:30:13.965137 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1cd58b61-ed15-40d1-9fe9-d02687195c96 admin admin] The token cache is being invalidate because project 33d13c6f301f401e8284d7b17a4312e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:30:13.965331 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1cd58b61-ed15-40d1-9fe9-d02687195c96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:30:13.965972 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1cd58b61-ed15-40d1-9fe9-d02687195c96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:30:13.967836 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1377/2748] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:30:13 2022] DELETE /identity/v3/projects/33d13c6f301f401e8284d7b17a4312e5 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:30:23.584643 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=21,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:30:23.960701 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:30:45.549287 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f264256b-aaa5-444a-b60a-3ef036b91f72 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:30:45.550825 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-f264256b-aaa5-444a-b60a-3ef036b91f72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:30:45.564498 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f264256b-aaa5-444a-b60a-3ef036b91f72 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:30:45.632180 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8de3eb-bcba-4f07-bcfa-4cf15d33b070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:30:45.633223 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8de3eb-bcba-4f07-bcfa-4cf15d33b070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:45.633494 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8de3eb-bcba-4f07-bcfa-4cf15d33b070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:45.633961 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8de3eb-bcba-4f07-bcfa-4cf15d33b070 admin admin] PATH_INFO: `/v3/users/cf7d4c2c41494b62a9dea6a1d850d18c` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:45.635064 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8de3eb-bcba-4f07-bcfa-4cf15d33b070 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf7d4c2c41494b62a9dea6a1d850d18c)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:30:45.637027 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8de3eb-bcba-4f07-bcfa-4cf15d33b070 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:30:45.686090 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-cb8de3eb-bcba-4f07-bcfa-4cf15d33b070 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf7d4c2c41494b62a9dea6a1d850d18c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:30:45.698614 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-cb8de3eb-bcba-4f07-bcfa-4cf15d33b070 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf7d4c2c41494b62a9dea6a1d850d18c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:30:45.705724 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-cb8de3eb-bcba-4f07-bcfa-4cf15d33b070 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf7d4c2c41494b62a9dea6a1d850d18c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:30:45.706493 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-cb8de3eb-bcba-4f07-bcfa-4cf15d33b070 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf7d4c2c41494b62a9dea6a1d850d18c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:30:45.715242 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-cb8de3eb-bcba-4f07-bcfa-4cf15d33b070 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf7d4c2c41494b62a9dea6a1d850d18c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:30:45.721757 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1372/2749] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:30:45 2022] DELETE /identity/v3/users/cf7d4c2c41494b62a9dea6a1d850d18c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:30:45.920787 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd58b61-ed15-40d1-9fe9-d02687195c96 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:30:45.923846 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1cd58b61-ed15-40d1-9fe9-d02687195c96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:30:45.940519 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd58b61-ed15-40d1-9fe9-d02687195c96 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:30:46.004291 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e7150-b4fa-4092-aec6-7f5811cf3609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:30:46.005168 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e7150-b4fa-4092-aec6-7f5811cf3609 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:46.005444 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e7150-b4fa-4092-aec6-7f5811cf3609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:46.005744 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e7150-b4fa-4092-aec6-7f5811cf3609 admin admin] PATH_INFO: `/v3/projects/e314253d6a1c4669a77072312b5377f7` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:46.007026 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e7150-b4fa-4092-aec6-7f5811cf3609 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e314253d6a1c4669a77072312b5377f7)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:30:46.009211 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e7150-b4fa-4092-aec6-7f5811cf3609 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:30:46.064129 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e98e7150-b4fa-4092-aec6-7f5811cf3609 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e314253d6a1c4669a77072312b5377f7', 'request_id': 'req-e98e7150-b4fa-4092-aec6-7f5811cf3609'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:30:46.070520 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e98e7150-b4fa-4092-aec6-7f5811cf3609 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e314253d6a1c4669a77072312b5377f7', 'request_id': 'req-e98e7150-b4fa-4092-aec6-7f5811cf3609'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:30:46.077969 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e98e7150-b4fa-4092-aec6-7f5811cf3609 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e314253d6a1c4669a77072312b5377f7', 'request_id': 'req-e98e7150-b4fa-4092-aec6-7f5811cf3609'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:30:46.089140 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e98e7150-b4fa-4092-aec6-7f5811cf3609 admin admin] The token cache is being invalidate because project e314253d6a1c4669a77072312b5377f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:30:46.089422 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e98e7150-b4fa-4092-aec6-7f5811cf3609 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:30:46.090060 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e98e7150-b4fa-4092-aec6-7f5811cf3609 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:30:46.091604 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1378/2750] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:30:45 2022] DELETE /identity/v3/projects/e314253d6a1c4669a77072312b5377f7 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:30:46.096914 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b67c1-f73c-4e8d-b613-5bb6a09dcc41 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:46.097238 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b67c1-f73c-4e8d-b613-5bb6a09dcc41 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:46.097519 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b67c1-f73c-4e8d-b613-5bb6a09dcc41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:46.116635 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-d89b67c1-f73c-4e8d-b613-5bb6a09dcc41 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:30:46.117908 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-d89b67c1-f73c-4e8d-b613-5bb6a09dcc41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:30:46.200314 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1373/2751] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:30:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:30:46.211845 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b4f85-7829-4a73-b78c-a617b3bd6e7c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:46.212126 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b4f85-7829-4a73-b78c-a617b3bd6e7c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:46.212402 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b4f85-7829-4a73-b78c-a617b3bd6e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:46.234445 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-205b4f85-7829-4a73-b78c-a617b3bd6e7c None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:30:46.235679 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-205b4f85-7829-4a73-b78c-a617b3bd6e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:30:46.245960 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1379/2752] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:30:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:30:46.250375 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89b67c1-f73c-4e8d-b613-5bb6a09dcc41 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:30:46.261231 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89b67c1-f73c-4e8d-b613-5bb6a09dcc41 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:30:46.267264 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a62e5d-1faa-440c-8a05-911d98c86d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:30:46.267931 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a62e5d-1faa-440c-8a05-911d98c86d13 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:46.268218 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a62e5d-1faa-440c-8a05-911d98c86d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:46.268503 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a62e5d-1faa-440c-8a05-911d98c86d13 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:46.269243 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a62e5d-1faa-440c-8a05-911d98c86d13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:30:46.269553 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a62e5d-1faa-440c-8a05-911d98c86d13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:30:46.271244 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a62e5d-1faa-440c-8a05-911d98c86d13 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:30:46.287047 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1374/2753] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:30:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:30:46.292076 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b4f85-7829-4a73-b78c-a617b3bd6e7c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:30:46.302299 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b4f85-7829-4a73-b78c-a617b3bd6e7c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:30:46.308189 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef830c-7f47-491d-bfd9-4a35ed74294c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:30:46.308849 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef830c-7f47-491d-bfd9-4a35ed74294c admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:46.309133 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef830c-7f47-491d-bfd9-4a35ed74294c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:46.309403 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef830c-7f47-491d-bfd9-4a35ed74294c admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:46.310135 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eef830c-7f47-491d-bfd9-4a35ed74294c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:30:46.312132 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eef830c-7f47-491d-bfd9-4a35ed74294c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:30:46.340184 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1380/2754] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:30:46 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:30:46.346570 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a62e5d-1faa-440c-8a05-911d98c86d13 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:30:46.359280 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a62e5d-1faa-440c-8a05-911d98c86d13 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:30:46.363561 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:30:46.425354 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648f8d7-22d4-4d90-b00e-33e290c5d899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:30:46.426056 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648f8d7-22d4-4d90-b00e-33e290c5d899 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:46.426340 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648f8d7-22d4-4d90-b00e-33e290c5d899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:46.426617 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648f8d7-22d4-4d90-b00e-33e290c5d899 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:46.427316 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a648f8d7-22d4-4d90-b00e-33e290c5d899 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:30:46.429233 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a648f8d7-22d4-4d90-b00e-33e290c5d899 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:30:46.453877 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1375/2755] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:30:46 2022] POST /identity/v3/users => generated 290 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:30:46.459843 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef830c-7f47-491d-bfd9-4a35ed74294c admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:30:46.472852 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef830c-7f47-491d-bfd9-4a35ed74294c admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:30:46.478579 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c39881-49da-42f0-8c02-99f9d62c4ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:30:46.479408 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c39881-49da-42f0-8c02-99f9d62c4ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:46.479757 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c39881-49da-42f0-8c02-99f9d62c4ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:46.480097 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c39881-49da-42f0-8c02-99f9d62c4ee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:46.480902 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c39881-49da-42f0-8c02-99f9d62c4ee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:30:46.482635 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c39881-49da-42f0-8c02-99f9d62c4ee5 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:30:46.496191 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1381/2756] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:30:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:30:46.500660 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648f8d7-22d4-4d90-b00e-33e290c5d899 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:30:46.512394 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648f8d7-22d4-4d90-b00e-33e290c5d899 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:30:46.519039 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc504bdd-d4ec-4fcd-b847-4cc22d0390a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:30:46.519729 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc504bdd-d4ec-4fcd-b847-4cc22d0390a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:46.520013 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc504bdd-d4ec-4fcd-b847-4cc22d0390a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:46.520287 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc504bdd-d4ec-4fcd-b847-4cc22d0390a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:46.521247 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc504bdd-d4ec-4fcd-b847-4cc22d0390a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:30:46.522681 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc504bdd-d4ec-4fcd-b847-4cc22d0390a9 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:30:46.533966 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1376/2757] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:30:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:30:46.538084 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c39881-49da-42f0-8c02-99f9d62c4ee5 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:30:46.553650 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c39881-49da-42f0-8c02-99f9d62c4ee5 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:30:46.559444 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973cef1a-0cf9-4be9-bbf2-590cf64998d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:30:46.560353 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973cef1a-0cf9-4be9-bbf2-590cf64998d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:46.560634 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973cef1a-0cf9-4be9-bbf2-590cf64998d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:46.560913 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973cef1a-0cf9-4be9-bbf2-590cf64998d2 admin admin] PATH_INFO: `/v3/projects/433511f768bd40a5a6448d2823b558b4/users/d07fa48f091242098f832999862be6be/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:46.579112 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973cef1a-0cf9-4be9-bbf2-590cf64998d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=433511f768bd40a5a6448d2823b558b4, user_id=d07fa48f091242098f832999862be6be, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:30:46.581895 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973cef1a-0cf9-4be9-bbf2-590cf64998d2 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:30:46.596615 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1382/2758] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:30:46 2022] PUT /identity/v3/projects/433511f768bd40a5a6448d2823b558b4/users/d07fa48f091242098f832999862be6be/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:30:46.607431 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be946cc5-ecf3-446e-ba4c-4b1861ca1b7b None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:46.607933 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be946cc5-ecf3-446e-ba4c-4b1861ca1b7b None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:46.608048 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be946cc5-ecf3-446e-ba4c-4b1861ca1b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:46.634821 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-be946cc5-ecf3-446e-ba4c-4b1861ca1b7b None None] MFA Rules not processed for user `d07fa48f091242098f832999862be6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:30:46.636025 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-be946cc5-ecf3-446e-ba4c-4b1861ca1b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:30:46.702325 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1377/2759] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:30:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:30:46.707406 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973cef1a-0cf9-4be9-bbf2-590cf64998d2 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:30:46.740842 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:30:46.778216 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973cef1a-0cf9-4be9-bbf2-590cf64998d2 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:30:46.783609 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96662bfd-fd5e-4f6c-8c53-c0adac21737d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:30:46.784270 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96662bfd-fd5e-4f6c-8c53-c0adac21737d admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:46.784547 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96662bfd-fd5e-4f6c-8c53-c0adac21737d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:46.784819 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96662bfd-fd5e-4f6c-8c53-c0adac21737d admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:46.785525 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96662bfd-fd5e-4f6c-8c53-c0adac21737d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:30:46.787462 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96662bfd-fd5e-4f6c-8c53-c0adac21737d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:30:46.817245 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1383/2760] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:30:46 2022] POST /identity/v3/projects => generated 377 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:30:46.822348 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be946cc5-ecf3-446e-ba4c-4b1861ca1b7b None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:30:46.833464 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be946cc5-ecf3-446e-ba4c-4b1861ca1b7b None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:30:46.889470 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf5f76f-bddc-4584-b395-775d7e29a234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:30:46.890171 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5f76f-bddc-4584-b395-775d7e29a234 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:46.890451 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5f76f-bddc-4584-b395-775d7e29a234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:46.890722 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5f76f-bddc-4584-b395-775d7e29a234 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:46.891410 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf5f76f-bddc-4584-b395-775d7e29a234 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:30:46.893317 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf5f76f-bddc-4584-b395-775d7e29a234 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:30:46.913394 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1378/2761] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:30:46 2022] POST /identity/v3/users => generated 295 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:30:46.918471 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96662bfd-fd5e-4f6c-8c53-c0adac21737d admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:30:46.935320 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96662bfd-fd5e-4f6c-8c53-c0adac21737d admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:30:46.943242 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475129d8-efa2-4b21-bf44-f277c73c705e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:30:46.944130 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475129d8-efa2-4b21-bf44-f277c73c705e admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:46.944481 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475129d8-efa2-4b21-bf44-f277c73c705e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:46.944795 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475129d8-efa2-4b21-bf44-f277c73c705e admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:46.946335 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475129d8-efa2-4b21-bf44-f277c73c705e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:30:46.947939 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475129d8-efa2-4b21-bf44-f277c73c705e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:30:46.959814 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1384/2762] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:30:46 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:30:46.964913 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf5f76f-bddc-4584-b395-775d7e29a234 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:30:46.971723 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:30:46.975554 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf5f76f-bddc-4584-b395-775d7e29a234 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:30:46.981725 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ef998-08e7-4c54-a1a3-b5efafe92acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:30:46.982652 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ef998-08e7-4c54-a1a3-b5efafe92acc admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:46.982932 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ef998-08e7-4c54-a1a3-b5efafe92acc admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:46.983187 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ef998-08e7-4c54-a1a3-b5efafe92acc admin admin] PATH_INFO: `/v3/projects/a628a6619f064f9a95a3059baaabe36d/users/c3b7654cda2c42da8a134a5668d947ea/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:46.999347 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7ef998-08e7-4c54-a1a3-b5efafe92acc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a628a6619f064f9a95a3059baaabe36d, user_id=c3b7654cda2c42da8a134a5668d947ea, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:30:47.002208 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7ef998-08e7-4c54-a1a3-b5efafe92acc admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:30:47.016564 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1379/2763] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:30:46 2022] PUT /identity/v3/projects/a628a6619f064f9a95a3059baaabe36d/users/c3b7654cda2c42da8a134a5668d947ea/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:30:47.020652 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475129d8-efa2-4b21-bf44-f277c73c705e admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:30:47.033121 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475129d8-efa2-4b21-bf44-f277c73c705e admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:30:47.096710 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d84f6-6b9d-4de2-bd36-502d76214eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:30:47.097386 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d84f6-6b9d-4de2-bd36-502d76214eba admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:47.097668 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d84f6-6b9d-4de2-bd36-502d76214eba admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:47.097992 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d84f6-6b9d-4de2-bd36-502d76214eba admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:47.098726 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131d84f6-6b9d-4de2-bd36-502d76214eba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:30:47.100369 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131d84f6-6b9d-4de2-bd36-502d76214eba admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:30:47.111871 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1385/2764] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:30:47 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:30:47.116170 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ef998-08e7-4c54-a1a3-b5efafe92acc admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:30:47.126702 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ef998-08e7-4c54-a1a3-b5efafe92acc admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:30:47.131828 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9f4b9-dac0-4d05-b880-f6f3f39d8901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:30:47.132871 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9f4b9-dac0-4d05-b880-f6f3f39d8901 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:47.133155 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9f4b9-dac0-4d05-b880-f6f3f39d8901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:47.133421 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9f4b9-dac0-4d05-b880-f6f3f39d8901 admin admin] PATH_INFO: `/v3/projects/a628a6619f064f9a95a3059baaabe36d/users/c3b7654cda2c42da8a134a5668d947ea/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:47.135657 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e9f4b9-dac0-4d05-b880-f6f3f39d8901 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a628a6619f064f9a95a3059baaabe36d, user_id=c3b7654cda2c42da8a134a5668d947ea, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:30:47.138343 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e9f4b9-dac0-4d05-b880-f6f3f39d8901 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:30:47.149252 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1380/2765] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:30:47 2022] PUT /identity/v3/projects/a628a6619f064f9a95a3059baaabe36d/users/c3b7654cda2c42da8a134a5668d947ea/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:30:47.159571 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce4fca-1f75-4e07-8b1f-15eeabdc99a1 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:47.159944 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce4fca-1f75-4e07-8b1f-15eeabdc99a1 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:47.160202 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce4fca-1f75-4e07-8b1f-15eeabdc99a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:47.195844 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-25ce4fca-1f75-4e07-8b1f-15eeabdc99a1 None None] MFA Rules not processed for user `c3b7654cda2c42da8a134a5668d947ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:30:47.197105 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-25ce4fca-1f75-4e07-8b1f-15eeabdc99a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:30:47.269763 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1386/2766] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:30:47 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:30:47.281376 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9f4b9-dac0-4d05-b880-f6f3f39d8901 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:30:47.283242 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-49e9f4b9-dac0-4d05-b880-f6f3f39d8901 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:30:47.352491 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9f4b9-dac0-4d05-b880-f6f3f39d8901 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:30:47.356924 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2be0b4-d78b-4c69-a89e-59932a4c7a39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:30:47.357585 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2be0b4-d78b-4c69-a89e-59932a4c7a39 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:47.357977 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2be0b4-d78b-4c69-a89e-59932a4c7a39 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:47.358255 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2be0b4-d78b-4c69-a89e-59932a4c7a39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:47.420792 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2be0b4-d78b-4c69-a89e-59932a4c7a39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:30:47.422764 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2be0b4-d78b-4c69-a89e-59932a4c7a39 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:30:47.433442 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1381/2767] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:30:47 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:30:48.820044 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce4fca-1f75-4e07-8b1f-15eeabdc99a1 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:30:48.821962 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-25ce4fca-1f75-4e07-8b1f-15eeabdc99a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:30:48.840765 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce4fca-1f75-4e07-8b1f-15eeabdc99a1 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:30:48.844794 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d171d-8a23-435b-81de-c14772e013cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:30:48.845458 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d171d-8a23-435b-81de-c14772e013cd service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:48.845773 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d171d-8a23-435b-81de-c14772e013cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:48.846055 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d171d-8a23-435b-81de-c14772e013cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:48.856976 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0d171d-8a23-435b-81de-c14772e013cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:30:48.858491 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0d171d-8a23-435b-81de-c14772e013cd service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:30:48.869204 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1387/2768] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:30:48 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:30:52.680695 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2be0b4-d78b-4c69-a89e-59932a4c7a39 service cinder] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:30:52.759823 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2be0b4-d78b-4c69-a89e-59932a4c7a39 service cinder] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:30:52.765889 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff8421b-c34a-42d4-a104-a28e1dc95f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:30:52.766786 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8421b-c34a-42d4-a104-a28e1dc95f2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:52.767071 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8421b-c34a-42d4-a104-a28e1dc95f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:52.767348 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8421b-c34a-42d4-a104-a28e1dc95f2c admin admin] PATH_INFO: `/v3/users/d07fa48f091242098f832999862be6be` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:52.768632 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff8421b-c34a-42d4-a104-a28e1dc95f2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d07fa48f091242098f832999862be6be)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:30:52.770606 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff8421b-c34a-42d4-a104-a28e1dc95f2c admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:30:52.798634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:30:52.826301 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-6ff8421b-c34a-42d4-a104-a28e1dc95f2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd07fa48f091242098f832999862be6be'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:30:52.840873 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-6ff8421b-c34a-42d4-a104-a28e1dc95f2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd07fa48f091242098f832999862be6be'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:30:52.848141 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-6ff8421b-c34a-42d4-a104-a28e1dc95f2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd07fa48f091242098f832999862be6be'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:30:52.848892 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-6ff8421b-c34a-42d4-a104-a28e1dc95f2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd07fa48f091242098f832999862be6be'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:30:52.858256 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-6ff8421b-c34a-42d4-a104-a28e1dc95f2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd07fa48f091242098f832999862be6be'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:30:52.864875 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1382/2769] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:30:52 2022] DELETE /identity/v3/users/d07fa48f091242098f832999862be6be => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:30:52.871694 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fdffc8-4de1-4589-ad3a-ac8c5940d3af None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:52.872484 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fdffc8-4de1-4589-ad3a-ac8c5940d3af None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:52.872682 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fdffc8-4de1-4589-ad3a-ac8c5940d3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:52.896032 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c5fdffc8-4de1-4589-ad3a-ac8c5940d3af None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:30:52.897286 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c5fdffc8-4de1-4589-ad3a-ac8c5940d3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:30:52.903017 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:30:52.964811 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1388/2770] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:30:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:30:52.977341 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff8421b-c34a-42d4-a104-a28e1dc95f2c admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:30:52.979086 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-6ff8421b-c34a-42d4-a104-a28e1dc95f2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:30:53.045104 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff8421b-c34a-42d4-a104-a28e1dc95f2c admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:30:53.049534 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0016760-36f5-4da7-80b1-434501dedbae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:30:53.050224 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0016760-36f5-4da7-80b1-434501dedbae service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:53.050510 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0016760-36f5-4da7-80b1-434501dedbae service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:53.050786 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0016760-36f5-4da7-80b1-434501dedbae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:53.061253 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0016760-36f5-4da7-80b1-434501dedbae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:30:53.062752 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0016760-36f5-4da7-80b1-434501dedbae service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:30:53.073126 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1383/2771] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:30:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:30:53.368019 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fdffc8-4de1-4589-ad3a-ac8c5940d3af None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:30:53.369945 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c5fdffc8-4de1-4589-ad3a-ac8c5940d3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:30:53.385519 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fdffc8-4de1-4589-ad3a-ac8c5940d3af None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:30:53.392829 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0374f50b-ee82-4d08-978e-3ab480a66d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:30:53.393650 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374f50b-ee82-4d08-978e-3ab480a66d6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:53.393955 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374f50b-ee82-4d08-978e-3ab480a66d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:53.394222 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374f50b-ee82-4d08-978e-3ab480a66d6c admin admin] PATH_INFO: `/v3/projects/433511f768bd40a5a6448d2823b558b4` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:53.395685 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0374f50b-ee82-4d08-978e-3ab480a66d6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=433511f768bd40a5a6448d2823b558b4)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:30:53.397538 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0374f50b-ee82-4d08-978e-3ab480a66d6c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:30:53.449875 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0374f50b-ee82-4d08-978e-3ab480a66d6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '433511f768bd40a5a6448d2823b558b4', 'request_id': 'req-0374f50b-ee82-4d08-978e-3ab480a66d6c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:30:53.457471 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0374f50b-ee82-4d08-978e-3ab480a66d6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '433511f768bd40a5a6448d2823b558b4', 'request_id': 'req-0374f50b-ee82-4d08-978e-3ab480a66d6c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:30:53.467536 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0374f50b-ee82-4d08-978e-3ab480a66d6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '433511f768bd40a5a6448d2823b558b4', 'request_id': 'req-0374f50b-ee82-4d08-978e-3ab480a66d6c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:30:53.480072 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0374f50b-ee82-4d08-978e-3ab480a66d6c admin admin] The token cache is being invalidate because project 433511f768bd40a5a6448d2823b558b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:30:53.480361 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0374f50b-ee82-4d08-978e-3ab480a66d6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:30:53.481066 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0374f50b-ee82-4d08-978e-3ab480a66d6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:30:53.482689 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1389/2772] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:30:53 2022] DELETE /identity/v3/projects/433511f768bd40a5a6448d2823b558b4 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:30:53.487025 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0016760-36f5-4da7-80b1-434501dedbae service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:30:53.498868 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0016760-36f5-4da7-80b1-434501dedbae service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:30:53.570196 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bbf0f2-c589-462a-8575-74be060d0cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:30:53.571157 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bbf0f2-c589-462a-8575-74be060d0cb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:53.571439 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bbf0f2-c589-462a-8575-74be060d0cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:53.571711 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bbf0f2-c589-462a-8575-74be060d0cb9 admin admin] PATH_INFO: `/v3/users/c3b7654cda2c42da8a134a5668d947ea` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:53.573038 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bbf0f2-c589-462a-8575-74be060d0cb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3b7654cda2c42da8a134a5668d947ea)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:30:53.574994 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bbf0f2-c589-462a-8575-74be060d0cb9 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:30:53.626417 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:30:53.628032 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-44bbf0f2-c589-462a-8575-74be060d0cb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3b7654cda2c42da8a134a5668d947ea'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:30:53.643425 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-44bbf0f2-c589-462a-8575-74be060d0cb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3b7654cda2c42da8a134a5668d947ea'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:30:53.650668 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-44bbf0f2-c589-462a-8575-74be060d0cb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3b7654cda2c42da8a134a5668d947ea'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:30:53.651471 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-44bbf0f2-c589-462a-8575-74be060d0cb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3b7654cda2c42da8a134a5668d947ea'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:30:53.662636 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-44bbf0f2-c589-462a-8575-74be060d0cb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3b7654cda2c42da8a134a5668d947ea'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:30:53.669902 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1384/2773] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:30:53 2022] DELETE /identity/v3/users/c3b7654cda2c42da8a134a5668d947ea => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:30:53.972927 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0374f50b-ee82-4d08-978e-3ab480a66d6c admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:30:53.974419 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0374f50b-ee82-4d08-978e-3ab480a66d6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:30:53.991475 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0374f50b-ee82-4d08-978e-3ab480a66d6c admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:30:54.052323 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6306d5d6-fa22-45be-8ae8-29cc5a9c9d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:30:54.053235 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306d5d6-fa22-45be-8ae8-29cc5a9c9d2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:54.053516 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306d5d6-fa22-45be-8ae8-29cc5a9c9d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:54.053792 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306d5d6-fa22-45be-8ae8-29cc5a9c9d2b admin admin] PATH_INFO: `/v3/projects/a628a6619f064f9a95a3059baaabe36d` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:54.055182 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6306d5d6-fa22-45be-8ae8-29cc5a9c9d2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a628a6619f064f9a95a3059baaabe36d)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:30:54.057225 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6306d5d6-fa22-45be-8ae8-29cc5a9c9d2b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:30:54.105891 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:30:54.118791 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6306d5d6-fa22-45be-8ae8-29cc5a9c9d2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a628a6619f064f9a95a3059baaabe36d', 'request_id': 'req-6306d5d6-fa22-45be-8ae8-29cc5a9c9d2b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:30:54.124541 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6306d5d6-fa22-45be-8ae8-29cc5a9c9d2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a628a6619f064f9a95a3059baaabe36d', 'request_id': 'req-6306d5d6-fa22-45be-8ae8-29cc5a9c9d2b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:30:54.132809 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6306d5d6-fa22-45be-8ae8-29cc5a9c9d2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a628a6619f064f9a95a3059baaabe36d', 'request_id': 'req-6306d5d6-fa22-45be-8ae8-29cc5a9c9d2b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:30:54.144704 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6306d5d6-fa22-45be-8ae8-29cc5a9c9d2b admin admin] The token cache is being invalidate because project a628a6619f064f9a95a3059baaabe36d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:30:54.144990 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6306d5d6-fa22-45be-8ae8-29cc5a9c9d2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:30:54.145660 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6306d5d6-fa22-45be-8ae8-29cc5a9c9d2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:30:54.147269 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1390/2774] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:30:53 2022] DELETE /identity/v3/projects/a628a6619f064f9a95a3059baaabe36d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:30:54.153202 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a8e71-8061-4245-8bbe-af5b337b6dae None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:54.153771 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a8e71-8061-4245-8bbe-af5b337b6dae None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:54.153905 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a8e71-8061-4245-8bbe-af5b337b6dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:54.182353 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-411a8e71-8061-4245-8bbe-af5b337b6dae None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:30:54.184328 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-411a8e71-8061-4245-8bbe-af5b337b6dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:30:54.250303 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1385/2775] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:30:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:30:54.262420 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b3daf-8a75-4638-9d70-621a7a97b389 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:54.262687 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b3daf-8a75-4638-9d70-621a7a97b389 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:54.262965 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b3daf-8a75-4638-9d70-621a7a97b389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:54.284429 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e88b3daf-8a75-4638-9d70-621a7a97b389 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:30:54.285655 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e88b3daf-8a75-4638-9d70-621a7a97b389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:30:54.294571 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1391/2776] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:30:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:30:54.300176 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a8e71-8061-4245-8bbe-af5b337b6dae None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:30:54.310907 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a8e71-8061-4245-8bbe-af5b337b6dae None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:30:54.315961 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e5f453-1455-4ca5-a4d6-f3214c6754ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:30:54.316628 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5f453-1455-4ca5-a4d6-f3214c6754ad admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:54.316912 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5f453-1455-4ca5-a4d6-f3214c6754ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:54.317187 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5f453-1455-4ca5-a4d6-f3214c6754ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:54.317938 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e5f453-1455-4ca5-a4d6-f3214c6754ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:30:54.318277 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e5f453-1455-4ca5-a4d6-f3214c6754ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:30:54.320150 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e5f453-1455-4ca5-a4d6-f3214c6754ad admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:30:54.333095 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1386/2777] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:30:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:30:54.338216 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b3daf-8a75-4638-9d70-621a7a97b389 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:30:54.348363 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b3daf-8a75-4638-9d70-621a7a97b389 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:30:54.354891 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eac713-4ff7-4505-8115-3f95b9945ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:30:54.355567 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eac713-4ff7-4505-8115-3f95b9945ade admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:54.355852 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eac713-4ff7-4505-8115-3f95b9945ade admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:54.356178 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eac713-4ff7-4505-8115-3f95b9945ade admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:54.356830 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eac713-4ff7-4505-8115-3f95b9945ade admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:30:54.358786 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eac713-4ff7-4505-8115-3f95b9945ade admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:30:54.389345 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1392/2778] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:30:54 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:30:54.392382 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e5f453-1455-4ca5-a4d6-f3214c6754ad admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:30:54.403905 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e5f453-1455-4ca5-a4d6-f3214c6754ad admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:30:54.471175 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1906ef-b3e8-4df2-a8d0-ecf82736e2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:30:54.471884 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1906ef-b3e8-4df2-a8d0-ecf82736e2f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:54.472200 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1906ef-b3e8-4df2-a8d0-ecf82736e2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:54.472490 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1906ef-b3e8-4df2-a8d0-ecf82736e2f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:54.473199 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1906ef-b3e8-4df2-a8d0-ecf82736e2f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:30:54.475177 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1906ef-b3e8-4df2-a8d0-ecf82736e2f8 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:30:54.499538 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1387/2779] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:30:54 2022] POST /identity/v3/users => generated 289 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:30:54.503817 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eac713-4ff7-4505-8115-3f95b9945ade admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:30:54.515316 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eac713-4ff7-4505-8115-3f95b9945ade admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:30:54.520485 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6406ed08-4974-4883-bd36-aeb6db090b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:30:54.521143 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6406ed08-4974-4883-bd36-aeb6db090b74 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:54.521450 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6406ed08-4974-4883-bd36-aeb6db090b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:54.521830 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6406ed08-4974-4883-bd36-aeb6db090b74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:54.522678 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6406ed08-4974-4883-bd36-aeb6db090b74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:30:54.524984 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6406ed08-4974-4883-bd36-aeb6db090b74 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:30:54.536025 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1393/2780] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:30:54.540844 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1906ef-b3e8-4df2-a8d0-ecf82736e2f8 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:30:54.554045 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1906ef-b3e8-4df2-a8d0-ecf82736e2f8 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:30:54.561920 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b5dd0a-6c08-4367-8bcc-e9e424971548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:30:54.562939 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5dd0a-6c08-4367-8bcc-e9e424971548 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:54.563386 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5dd0a-6c08-4367-8bcc-e9e424971548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:54.563820 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5dd0a-6c08-4367-8bcc-e9e424971548 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:54.565102 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b5dd0a-6c08-4367-8bcc-e9e424971548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:30:54.567734 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b5dd0a-6c08-4367-8bcc-e9e424971548 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:30:54.579767 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1388/2781] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:30:54.586347 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6406ed08-4974-4883-bd36-aeb6db090b74 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:30:54.602332 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6406ed08-4974-4883-bd36-aeb6db090b74 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:30:54.608165 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3fcaf-9a61-4fc9-820e-e79dfc2a9147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:30:54.609044 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3fcaf-9a61-4fc9-820e-e79dfc2a9147 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:54.609316 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3fcaf-9a61-4fc9-820e-e79dfc2a9147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:54.609595 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3fcaf-9a61-4fc9-820e-e79dfc2a9147 admin admin] PATH_INFO: `/v3/projects/2294c0582f7b4bc29108354266cc5157/users/d2276f5115ee49228ef51044b1d9709c/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:54.626361 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d3fcaf-9a61-4fc9-820e-e79dfc2a9147 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2294c0582f7b4bc29108354266cc5157, user_id=d2276f5115ee49228ef51044b1d9709c, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:30:54.629031 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d3fcaf-9a61-4fc9-820e-e79dfc2a9147 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:30:54.643983 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1394/2782] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:30:54 2022] PUT /identity/v3/projects/2294c0582f7b4bc29108354266cc5157/users/d2276f5115ee49228ef51044b1d9709c/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:30:54.655758 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a276b6-ddb9-4abe-bafb-9a426d4718dd None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:54.656108 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a276b6-ddb9-4abe-bafb-9a426d4718dd None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:54.656492 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a276b6-ddb9-4abe-bafb-9a426d4718dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:54.694897 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-b7a276b6-ddb9-4abe-bafb-9a426d4718dd None None] MFA Rules not processed for user `d2276f5115ee49228ef51044b1d9709c`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:30:54.696164 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-b7a276b6-ddb9-4abe-bafb-9a426d4718dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:30:54.714158 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:30:54.772939 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1389/2783] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:30:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:30:54.777865 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3fcaf-9a61-4fc9-820e-e79dfc2a9147 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:30:54.852012 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3fcaf-9a61-4fc9-820e-e79dfc2a9147 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:30:54.857056 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebea840-3c5f-4379-b815-7b1ce87ea5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:30:54.857727 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebea840-3c5f-4379-b815-7b1ce87ea5a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:54.858027 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebea840-3c5f-4379-b815-7b1ce87ea5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:54.858365 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebea840-3c5f-4379-b815-7b1ce87ea5a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:54.858988 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebea840-3c5f-4379-b815-7b1ce87ea5a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:30:54.860886 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebea840-3c5f-4379-b815-7b1ce87ea5a9 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:30:54.888022 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1395/2784] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:30:54 2022] POST /identity/v3/projects => generated 377 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:30:54.892310 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a276b6-ddb9-4abe-bafb-9a426d4718dd None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:30:54.905352 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a276b6-ddb9-4abe-bafb-9a426d4718dd None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:30:54.967329 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb633dc5-569a-43a7-a342-7e0f87924607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:30:54.967979 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb633dc5-569a-43a7-a342-7e0f87924607 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:54.968260 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb633dc5-569a-43a7-a342-7e0f87924607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:54.968532 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb633dc5-569a-43a7-a342-7e0f87924607 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:54.969231 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb633dc5-569a-43a7-a342-7e0f87924607 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:30:54.971213 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb633dc5-569a-43a7-a342-7e0f87924607 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:30:54.994108 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1390/2785] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:30:54 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:30:54.998544 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebea840-3c5f-4379-b815-7b1ce87ea5a9 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:30:55.011877 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebea840-3c5f-4379-b815-7b1ce87ea5a9 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:30:55.017616 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a30de76-15cf-4720-b94d-06677dc9fe48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:30:55.018315 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30de76-15cf-4720-b94d-06677dc9fe48 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:55.018614 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30de76-15cf-4720-b94d-06677dc9fe48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:55.018867 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30de76-15cf-4720-b94d-06677dc9fe48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:55.019623 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a30de76-15cf-4720-b94d-06677dc9fe48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:30:55.021374 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a30de76-15cf-4720-b94d-06677dc9fe48 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:30:55.033480 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1396/2786] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:30:55.037486 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb633dc5-569a-43a7-a342-7e0f87924607 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:30:55.049819 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb633dc5-569a-43a7-a342-7e0f87924607 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:30:55.056046 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a755d9-332d-4eef-be09-0e36190b98ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:30:55.057049 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a755d9-332d-4eef-be09-0e36190b98ef admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:55.057437 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a755d9-332d-4eef-be09-0e36190b98ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:55.057717 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a755d9-332d-4eef-be09-0e36190b98ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:55.058789 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a755d9-332d-4eef-be09-0e36190b98ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:30:55.061243 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a755d9-332d-4eef-be09-0e36190b98ef admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:30:55.075348 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1391/2787] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:30:55.079934 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a30de76-15cf-4720-b94d-06677dc9fe48 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:30:55.091683 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a30de76-15cf-4720-b94d-06677dc9fe48 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:30:55.097227 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f05b6b1-a4ea-483f-b687-7475f1208a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:30:55.098155 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05b6b1-a4ea-483f-b687-7475f1208a9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:55.098437 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05b6b1-a4ea-483f-b687-7475f1208a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:55.098707 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05b6b1-a4ea-483f-b687-7475f1208a9b admin admin] PATH_INFO: `/v3/projects/e9dec44241534b99b144455f4dc48d2d/users/fda05a70d5aa46669299e41b44e27934/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:55.117833 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f05b6b1-a4ea-483f-b687-7475f1208a9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9dec44241534b99b144455f4dc48d2d, user_id=fda05a70d5aa46669299e41b44e27934, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:30:55.120443 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f05b6b1-a4ea-483f-b687-7475f1208a9b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:30:55.134809 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1397/2788] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:30:55 2022] PUT /identity/v3/projects/e9dec44241534b99b144455f4dc48d2d/users/fda05a70d5aa46669299e41b44e27934/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:30:55.145812 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21132047-65fb-4a75-b895-b55e50e381a6 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:55.146095 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21132047-65fb-4a75-b895-b55e50e381a6 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:55.146365 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21132047-65fb-4a75-b895-b55e50e381a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:55.175383 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-21132047-65fb-4a75-b895-b55e50e381a6 None None] MFA Rules not processed for user `fda05a70d5aa46669299e41b44e27934`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:30:55.176603 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-21132047-65fb-4a75-b895-b55e50e381a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:30:55.264466 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1392/2789] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:30:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:30:55.270577 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f05b6b1-a4ea-483f-b687-7475f1208a9b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:30:55.285100 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:30:55.349326 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f05b6b1-a4ea-483f-b687-7475f1208a9b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:30:55.355223 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e58ff-f9de-441e-9bed-9fd35df7853a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:30:55.356200 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e58ff-f9de-441e-9bed-9fd35df7853a admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:55.356482 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e58ff-f9de-441e-9bed-9fd35df7853a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:55.356756 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e58ff-f9de-441e-9bed-9fd35df7853a admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:55.357481 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e58ff-f9de-441e-9bed-9fd35df7853a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:30:55.359496 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e58ff-f9de-441e-9bed-9fd35df7853a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:30:55.392525 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1398/2790] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:30:55 2022] POST /identity/v3/projects => generated 379 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:30:55.398570 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21132047-65fb-4a75-b895-b55e50e381a6 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:30:55.412704 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21132047-65fb-4a75-b895-b55e50e381a6 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:30:55.443525 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:30:55.481999 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f87c60-ed7b-418c-8cc4-6ceb953c60da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:30:55.482740 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f87c60-ed7b-418c-8cc4-6ceb953c60da admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:55.483019 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f87c60-ed7b-418c-8cc4-6ceb953c60da admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:55.483321 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f87c60-ed7b-418c-8cc4-6ceb953c60da admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:55.484045 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f87c60-ed7b-418c-8cc4-6ceb953c60da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:30:55.486005 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f87c60-ed7b-418c-8cc4-6ceb953c60da admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:30:55.508751 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1393/2791] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:30:55 2022] POST /identity/v3/users => generated 296 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:30:55.513183 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e58ff-f9de-441e-9bed-9fd35df7853a admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:30:55.526345 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e58ff-f9de-441e-9bed-9fd35df7853a admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:30:55.532710 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c14e8-0c8e-44c2-967a-42d78c838ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:30:55.533415 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c14e8-0c8e-44c2-967a-42d78c838ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:55.533848 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c14e8-0c8e-44c2-967a-42d78c838ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:55.534029 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c14e8-0c8e-44c2-967a-42d78c838ba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:55.534904 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7c14e8-0c8e-44c2-967a-42d78c838ba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:30:55.536595 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7c14e8-0c8e-44c2-967a-42d78c838ba1 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:30:55.548999 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1399/2792] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:30:55.553625 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f87c60-ed7b-418c-8cc4-6ceb953c60da admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:30:55.574350 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f87c60-ed7b-418c-8cc4-6ceb953c60da admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:30:55.580373 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c923f-a84c-4382-9e6a-389e62e2cf28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:30:55.581360 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c923f-a84c-4382-9e6a-389e62e2cf28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:55.581638 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c923f-a84c-4382-9e6a-389e62e2cf28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:55.582012 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c923f-a84c-4382-9e6a-389e62e2cf28 admin admin] PATH_INFO: `/v3/projects/ef17ec1f73334dc887ea8d7fdf15513f/users/a403c2d726f843da8ffc212f4db4cd28/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:55.600416 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c923f-a84c-4382-9e6a-389e62e2cf28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef17ec1f73334dc887ea8d7fdf15513f, user_id=a403c2d726f843da8ffc212f4db4cd28, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:30:55.603321 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c923f-a84c-4382-9e6a-389e62e2cf28 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:30:55.619695 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1394/2793] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:30:55 2022] PUT /identity/v3/projects/ef17ec1f73334dc887ea8d7fdf15513f/users/a403c2d726f843da8ffc212f4db4cd28/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:30:55.624085 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c14e8-0c8e-44c2-967a-42d78c838ba1 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:30:55.638551 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c14e8-0c8e-44c2-967a-42d78c838ba1 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:30:55.712309 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32076c-c666-40f5-b636-b45e984542b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:30:55.713061 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32076c-c666-40f5-b636-b45e984542b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:55.713416 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32076c-c666-40f5-b636-b45e984542b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:55.713820 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32076c-c666-40f5-b636-b45e984542b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:55.714737 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f32076c-c666-40f5-b636-b45e984542b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:30:55.716698 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f32076c-c666-40f5-b636-b45e984542b8 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:30:55.729078 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1400/2794] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:30:55.733727 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c923f-a84c-4382-9e6a-389e62e2cf28 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:30:55.744855 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c923f-a84c-4382-9e6a-389e62e2cf28 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:30:55.749995 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f11329-3b8d-4191-8b00-326b4427468c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:30:55.750933 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f11329-3b8d-4191-8b00-326b4427468c admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:55.751217 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f11329-3b8d-4191-8b00-326b4427468c admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:55.751511 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f11329-3b8d-4191-8b00-326b4427468c admin admin] PATH_INFO: `/v3/projects/ef17ec1f73334dc887ea8d7fdf15513f/users/a403c2d726f843da8ffc212f4db4cd28/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:55.753765 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f11329-3b8d-4191-8b00-326b4427468c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef17ec1f73334dc887ea8d7fdf15513f, user_id=a403c2d726f843da8ffc212f4db4cd28, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:30:55.756623 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f11329-3b8d-4191-8b00-326b4427468c admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:30:55.767988 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1395/2795] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:30:55 2022] PUT /identity/v3/projects/ef17ec1f73334dc887ea8d7fdf15513f/users/a403c2d726f843da8ffc212f4db4cd28/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:30:55.780390 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61666aa7-957a-4030-a654-3c0e123692a4 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:55.780679 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61666aa7-957a-4030-a654-3c0e123692a4 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:55.781095 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61666aa7-957a-4030-a654-3c0e123692a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:55.820312 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-61666aa7-957a-4030-a654-3c0e123692a4 None None] MFA Rules not processed for user `a403c2d726f843da8ffc212f4db4cd28`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:30:55.821547 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-61666aa7-957a-4030-a654-3c0e123692a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:30:55.914034 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1401/2796] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:30:55 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:30:55.927546 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f11329-3b8d-4191-8b00-326b4427468c admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:30:55.929318 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-15f11329-3b8d-4191-8b00-326b4427468c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:30:55.996290 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f11329-3b8d-4191-8b00-326b4427468c admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:30:56.000504 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd94777c-ae99-427b-9837-9eadc069bf17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:30:56.001169 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94777c-ae99-427b-9837-9eadc069bf17 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:56.001467 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94777c-ae99-427b-9837-9eadc069bf17 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:56.001773 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94777c-ae99-427b-9837-9eadc069bf17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:56.013411 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd94777c-ae99-427b-9837-9eadc069bf17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:30:56.014918 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd94777c-ae99-427b-9837-9eadc069bf17 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:30:56.025247 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1396/2797] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:30:55 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:30:56.074915 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61666aa7-957a-4030-a654-3c0e123692a4 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:30:56.076381 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-61666aa7-957a-4030-a654-3c0e123692a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:30:56.086726 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:30:56.091076 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61666aa7-957a-4030-a654-3c0e123692a4 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:30:56.096136 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38707f-26ab-4c05-9cc9-ba2e46ba9dfd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:30:56.096810 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38707f-26ab-4c05-9cc9-ba2e46ba9dfd service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:56.097095 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38707f-26ab-4c05-9cc9-ba2e46ba9dfd service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:56.097470 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38707f-26ab-4c05-9cc9-ba2e46ba9dfd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:56.158135 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe38707f-26ab-4c05-9cc9-ba2e46ba9dfd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:30:56.159599 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe38707f-26ab-4c05-9cc9-ba2e46ba9dfd service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:30:56.168928 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1402/2798] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:30:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:30:59.113473 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd94777c-ae99-427b-9837-9eadc069bf17 service cinder] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:30:59.186333 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd94777c-ae99-427b-9837-9eadc069bf17 service cinder] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:30:59.191575 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7d9a1-0d87-480d-a3c6-4cf30a759392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:30:59.192469 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7d9a1-0d87-480d-a3c6-4cf30a759392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:59.192773 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7d9a1-0d87-480d-a3c6-4cf30a759392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:59.193051 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7d9a1-0d87-480d-a3c6-4cf30a759392 admin admin] PATH_INFO: `/v3/users/d2276f5115ee49228ef51044b1d9709c` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:59.194371 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b7d9a1-0d87-480d-a3c6-4cf30a759392 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2276f5115ee49228ef51044b1d9709c)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:30:59.196319 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b7d9a1-0d87-480d-a3c6-4cf30a759392 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:30:59.221552 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:30:59.248158 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-c9b7d9a1-0d87-480d-a3c6-4cf30a759392 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2276f5115ee49228ef51044b1d9709c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:30:59.263895 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-c9b7d9a1-0d87-480d-a3c6-4cf30a759392 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2276f5115ee49228ef51044b1d9709c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:30:59.272096 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-c9b7d9a1-0d87-480d-a3c6-4cf30a759392 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2276f5115ee49228ef51044b1d9709c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:30:59.273038 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-c9b7d9a1-0d87-480d-a3c6-4cf30a759392 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2276f5115ee49228ef51044b1d9709c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:30:59.282460 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-c9b7d9a1-0d87-480d-a3c6-4cf30a759392 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2276f5115ee49228ef51044b1d9709c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:30:59.289781 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1397/2799] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:30:59 2022] DELETE /identity/v3/users/d2276f5115ee49228ef51044b1d9709c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:30:59.295011 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a4a2a-832e-4cb0-ae2d-0ef22bdb62b6 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:59.295544 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a4a2a-832e-4cb0-ae2d-0ef22bdb62b6 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:59.295658 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a4a2a-832e-4cb0-ae2d-0ef22bdb62b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:59.314470 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f67a4a2a-832e-4cb0-ae2d-0ef22bdb62b6 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:30:59.315744 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f67a4a2a-832e-4cb0-ae2d-0ef22bdb62b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:30:59.386941 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1403/2800] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:30:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:30:59.398672 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7d9a1-0d87-480d-a3c6-4cf30a759392 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:30:59.400282 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-c9b7d9a1-0d87-480d-a3c6-4cf30a759392 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:30:59.470472 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7d9a1-0d87-480d-a3c6-4cf30a759392 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:30:59.475503 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b787199-489c-4e55-9466-fcc514ab0a60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:30:59.476175 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b787199-489c-4e55-9466-fcc514ab0a60 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:59.476454 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b787199-489c-4e55-9466-fcc514ab0a60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:59.476724 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b787199-489c-4e55-9466-fcc514ab0a60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:59.488174 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b787199-489c-4e55-9466-fcc514ab0a60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:30:59.489712 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b787199-489c-4e55-9466-fcc514ab0a60 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:30:59.500180 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1398/2801] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:30:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:30:59.817905 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67a4a2a-832e-4cb0-ae2d-0ef22bdb62b6 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:30:59.819823 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f67a4a2a-832e-4cb0-ae2d-0ef22bdb62b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:30:59.833838 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67a4a2a-832e-4cb0-ae2d-0ef22bdb62b6 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:30:59.839978 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8bcb36-f840-4d38-b376-0316a6dd9a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:30:59.840903 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8bcb36-f840-4d38-b376-0316a6dd9a8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:30:59.841183 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8bcb36-f840-4d38-b376-0316a6dd9a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:30:59.841453 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8bcb36-f840-4d38-b376-0316a6dd9a8b admin admin] PATH_INFO: `/v3/projects/2294c0582f7b4bc29108354266cc5157` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:30:59.842956 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8bcb36-f840-4d38-b376-0316a6dd9a8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2294c0582f7b4bc29108354266cc5157)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:30:59.844959 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8bcb36-f840-4d38-b376-0316a6dd9a8b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:30:59.898923 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7c8bcb36-f840-4d38-b376-0316a6dd9a8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2294c0582f7b4bc29108354266cc5157', 'request_id': 'req-7c8bcb36-f840-4d38-b376-0316a6dd9a8b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:30:59.905221 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7c8bcb36-f840-4d38-b376-0316a6dd9a8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2294c0582f7b4bc29108354266cc5157', 'request_id': 'req-7c8bcb36-f840-4d38-b376-0316a6dd9a8b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:30:59.915089 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7c8bcb36-f840-4d38-b376-0316a6dd9a8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2294c0582f7b4bc29108354266cc5157', 'request_id': 'req-7c8bcb36-f840-4d38-b376-0316a6dd9a8b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:30:59.929663 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7c8bcb36-f840-4d38-b376-0316a6dd9a8b admin admin] The token cache is being invalidate because project 2294c0582f7b4bc29108354266cc5157 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:30:59.929981 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7c8bcb36-f840-4d38-b376-0316a6dd9a8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:30:59.930728 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7c8bcb36-f840-4d38-b376-0316a6dd9a8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:30:59.932840 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1404/2802] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:30:59 2022] DELETE /identity/v3/projects/2294c0582f7b4bc29108354266cc5157 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:30:59.937590 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b787199-489c-4e55-9466-fcc514ab0a60 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:30:59.948289 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b787199-489c-4e55-9466-fcc514ab0a60 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:00.011483 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4791411-ce69-4310-b1f3-66c1b28a9e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:00.012286 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4791411-ce69-4310-b1f3-66c1b28a9e35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:00.012566 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4791411-ce69-4310-b1f3-66c1b28a9e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:00.012840 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4791411-ce69-4310-b1f3-66c1b28a9e35 admin admin] PATH_INFO: `/v3/users/fda05a70d5aa46669299e41b44e27934` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:00.014265 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4791411-ce69-4310-b1f3-66c1b28a9e35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fda05a70d5aa46669299e41b44e27934)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:00.016342 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4791411-ce69-4310-b1f3-66c1b28a9e35 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:00.073473 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:31:00.075494 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f4791411-ce69-4310-b1f3-66c1b28a9e35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fda05a70d5aa46669299e41b44e27934'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:00.095998 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f4791411-ce69-4310-b1f3-66c1b28a9e35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fda05a70d5aa46669299e41b44e27934'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:00.103630 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f4791411-ce69-4310-b1f3-66c1b28a9e35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fda05a70d5aa46669299e41b44e27934'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:00.104464 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f4791411-ce69-4310-b1f3-66c1b28a9e35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fda05a70d5aa46669299e41b44e27934'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:00.114940 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f4791411-ce69-4310-b1f3-66c1b28a9e35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fda05a70d5aa46669299e41b44e27934'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:00.121711 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1399/2803] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:30:59 2022] DELETE /identity/v3/users/fda05a70d5aa46669299e41b44e27934 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:31:00.694810 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8bcb36-f840-4d38-b376-0316a6dd9a8b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:00.696672 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7c8bcb36-f840-4d38-b376-0316a6dd9a8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:31:00.712042 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8bcb36-f840-4d38-b376-0316a6dd9a8b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:00.744838 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:31:00.781265 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4235b3f-ccd4-444a-8189-ba4097f33951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:00.782171 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4235b3f-ccd4-444a-8189-ba4097f33951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:00.782452 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4235b3f-ccd4-444a-8189-ba4097f33951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:00.782725 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4235b3f-ccd4-444a-8189-ba4097f33951 admin admin] PATH_INFO: `/v3/projects/e9dec44241534b99b144455f4dc48d2d` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:00.784001 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4235b3f-ccd4-444a-8189-ba4097f33951 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9dec44241534b99b144455f4dc48d2d)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:00.785968 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4235b3f-ccd4-444a-8189-ba4097f33951 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:00.847289 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a4235b3f-ccd4-444a-8189-ba4097f33951 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9dec44241534b99b144455f4dc48d2d', 'request_id': 'req-a4235b3f-ccd4-444a-8189-ba4097f33951'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:00.854096 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a4235b3f-ccd4-444a-8189-ba4097f33951 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9dec44241534b99b144455f4dc48d2d', 'request_id': 'req-a4235b3f-ccd4-444a-8189-ba4097f33951'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:00.863309 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a4235b3f-ccd4-444a-8189-ba4097f33951 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9dec44241534b99b144455f4dc48d2d', 'request_id': 'req-a4235b3f-ccd4-444a-8189-ba4097f33951'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:00.875742 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a4235b3f-ccd4-444a-8189-ba4097f33951 admin admin] The token cache is being invalidate because project e9dec44241534b99b144455f4dc48d2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:31:00.876008 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a4235b3f-ccd4-444a-8189-ba4097f33951 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:00.876884 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a4235b3f-ccd4-444a-8189-ba4097f33951 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:00.878703 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1405/2804] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:31:00 2022] DELETE /identity/v3/projects/e9dec44241534b99b144455f4dc48d2d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:31:00.883985 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4791411-ce69-4310-b1f3-66c1b28a9e35 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:00.885625 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-f4791411-ce69-4310-b1f3-66c1b28a9e35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:31:00.899804 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4791411-ce69-4310-b1f3-66c1b28a9e35 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:00.964339 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7073426-e923-49a0-81b1-b75d56803574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:00.965229 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7073426-e923-49a0-81b1-b75d56803574 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:00.965521 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7073426-e923-49a0-81b1-b75d56803574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:00.965819 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7073426-e923-49a0-81b1-b75d56803574 admin admin] PATH_INFO: `/v3/users/a403c2d726f843da8ffc212f4db4cd28` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:00.967163 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7073426-e923-49a0-81b1-b75d56803574 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a403c2d726f843da8ffc212f4db4cd28)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:00.969158 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7073426-e923-49a0-81b1-b75d56803574 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:01.021765 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b7073426-e923-49a0-81b1-b75d56803574 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a403c2d726f843da8ffc212f4db4cd28'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:01.034954 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b7073426-e923-49a0-81b1-b75d56803574 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a403c2d726f843da8ffc212f4db4cd28'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:01.043732 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b7073426-e923-49a0-81b1-b75d56803574 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a403c2d726f843da8ffc212f4db4cd28'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:01.044576 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b7073426-e923-49a0-81b1-b75d56803574 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a403c2d726f843da8ffc212f4db4cd28'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:01.059331 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b7073426-e923-49a0-81b1-b75d56803574 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a403c2d726f843da8ffc212f4db4cd28'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:01.067685 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1400/2805] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:31:00 2022] DELETE /identity/v3/users/a403c2d726f843da8ffc212f4db4cd28 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:31:01.401985 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4235b3f-ccd4-444a-8189-ba4097f33951 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:01.403967 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a4235b3f-ccd4-444a-8189-ba4097f33951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:31:01.418898 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4235b3f-ccd4-444a-8189-ba4097f33951 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:01.493264 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9cf3c3-56c0-4053-883c-02d2e6f91586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:01.494394 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9cf3c3-56c0-4053-883c-02d2e6f91586 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:01.494946 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9cf3c3-56c0-4053-883c-02d2e6f91586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:01.495134 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9cf3c3-56c0-4053-883c-02d2e6f91586 admin admin] PATH_INFO: `/v3/projects/ef17ec1f73334dc887ea8d7fdf15513f` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:01.496457 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9cf3c3-56c0-4053-883c-02d2e6f91586 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef17ec1f73334dc887ea8d7fdf15513f)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:01.498811 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9cf3c3-56c0-4053-883c-02d2e6f91586 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:01.596162 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7a9cf3c3-56c0-4053-883c-02d2e6f91586 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef17ec1f73334dc887ea8d7fdf15513f', 'request_id': 'req-7a9cf3c3-56c0-4053-883c-02d2e6f91586'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:01.603924 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7a9cf3c3-56c0-4053-883c-02d2e6f91586 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef17ec1f73334dc887ea8d7fdf15513f', 'request_id': 'req-7a9cf3c3-56c0-4053-883c-02d2e6f91586'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:01.606114 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:31:01.615910 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7a9cf3c3-56c0-4053-883c-02d2e6f91586 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef17ec1f73334dc887ea8d7fdf15513f', 'request_id': 'req-7a9cf3c3-56c0-4053-883c-02d2e6f91586'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:01.633891 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7a9cf3c3-56c0-4053-883c-02d2e6f91586 admin admin] The token cache is being invalidate because project ef17ec1f73334dc887ea8d7fdf15513f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:31:01.634360 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7a9cf3c3-56c0-4053-883c-02d2e6f91586 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:01.635273 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7a9cf3c3-56c0-4053-883c-02d2e6f91586 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:01.645170 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd757a9e-abeb-4b66-9a80-3afab013c5fe None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:01.645646 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd757a9e-abeb-4b66-9a80-3afab013c5fe None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:01.646025 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd757a9e-abeb-4b66-9a80-3afab013c5fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:01.647803 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1406/2806] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:31:01 2022] DELETE /identity/v3/projects/ef17ec1f73334dc887ea8d7fdf15513f => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:31:01.670138 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-bd757a9e-abeb-4b66-9a80-3afab013c5fe None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:31:01.671981 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-bd757a9e-abeb-4b66-9a80-3afab013c5fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:31:01.723812 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:31:01.754151 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1401/2807] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:31:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:31:01.761004 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10cfce-c259-4447-90ef-9bfbdfd2b29d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:01.761610 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10cfce-c259-4447-90ef-9bfbdfd2b29d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:01.761610 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10cfce-c259-4447-90ef-9bfbdfd2b29d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:01.793018 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-fe10cfce-c259-4447-90ef-9bfbdfd2b29d None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:31:01.794401 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-fe10cfce-c259-4447-90ef-9bfbdfd2b29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:31:01.809563 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1407/2808] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:31:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:31:01.811036 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd757a9e-abeb-4b66-9a80-3afab013c5fe None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:01.822048 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd757a9e-abeb-4b66-9a80-3afab013c5fe None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:01.828829 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c8dd7e-3d81-498a-8d7c-4500598f6f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:01.830305 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c8dd7e-3d81-498a-8d7c-4500598f6f74 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:01.830640 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c8dd7e-3d81-498a-8d7c-4500598f6f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:01.830919 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c8dd7e-3d81-498a-8d7c-4500598f6f74 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:01.831629 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c8dd7e-3d81-498a-8d7c-4500598f6f74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:31:01.831940 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c8dd7e-3d81-498a-8d7c-4500598f6f74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:01.833782 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c8dd7e-3d81-498a-8d7c-4500598f6f74 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:01.847575 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1402/2809] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:31:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 12:31:01.852509 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10cfce-c259-4447-90ef-9bfbdfd2b29d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:01.863268 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10cfce-c259-4447-90ef-9bfbdfd2b29d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:01.870010 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe7a80-d692-467c-8a76-6932e5bf6a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:01.871322 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe7a80-d692-467c-8a76-6932e5bf6a92 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:01.871788 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe7a80-d692-467c-8a76-6932e5bf6a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:01.872219 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe7a80-d692-467c-8a76-6932e5bf6a92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:01.873118 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fe7a80-d692-467c-8a76-6932e5bf6a92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:01.875864 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fe7a80-d692-467c-8a76-6932e5bf6a92 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:01.914537 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1408/2810] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:31:01 2022] POST /identity/v3/projects => generated 365 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:31:01.916084 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c8dd7e-3d81-498a-8d7c-4500598f6f74 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:01.929410 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c8dd7e-3d81-498a-8d7c-4500598f6f74 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:01.998227 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e14c3d4-4a9c-4d2a-8eab-65f4a9479d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:01.999164 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e14c3d4-4a9c-4d2a-8eab-65f4a9479d1b admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:01.999476 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e14c3d4-4a9c-4d2a-8eab-65f4a9479d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:01.999720 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e14c3d4-4a9c-4d2a-8eab-65f4a9479d1b admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:02.000422 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e14c3d4-4a9c-4d2a-8eab-65f4a9479d1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:02.002370 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e14c3d4-4a9c-4d2a-8eab-65f4a9479d1b admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:02.024211 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1403/2811] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:31:01 2022] POST /identity/v3/users => generated 283 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:31:02.028501 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe7a80-d692-467c-8a76-6932e5bf6a92 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:02.040170 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe7a80-d692-467c-8a76-6932e5bf6a92 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:02.047608 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead0f83-787a-467b-90b4-70933136a93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:02.048317 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead0f83-787a-467b-90b4-70933136a93b admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:02.048605 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead0f83-787a-467b-90b4-70933136a93b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:02.048888 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead0f83-787a-467b-90b4-70933136a93b admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:02.049622 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead0f83-787a-467b-90b4-70933136a93b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:02.051300 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead0f83-787a-467b-90b4-70933136a93b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:02.064053 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1409/2812] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:31:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:31:02.068240 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e14c3d4-4a9c-4d2a-8eab-65f4a9479d1b admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:02.078858 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e14c3d4-4a9c-4d2a-8eab-65f4a9479d1b admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:02.084413 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9285284c-4eea-43be-a0cb-df20da25f709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:02.085082 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285284c-4eea-43be-a0cb-df20da25f709 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:02.085368 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285284c-4eea-43be-a0cb-df20da25f709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:02.085827 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285284c-4eea-43be-a0cb-df20da25f709 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:02.086582 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9285284c-4eea-43be-a0cb-df20da25f709 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:02.088238 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9285284c-4eea-43be-a0cb-df20da25f709 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:02.099554 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1404/2813] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:31:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:31:02.103998 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead0f83-787a-467b-90b4-70933136a93b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:02.115432 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead0f83-787a-467b-90b4-70933136a93b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:02.121268 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ec578-2555-4ecd-821b-f10aa78519dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:02.122348 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ec578-2555-4ecd-821b-f10aa78519dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:02.122728 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ec578-2555-4ecd-821b-f10aa78519dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:02.123104 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ec578-2555-4ecd-821b-f10aa78519dd admin admin] PATH_INFO: `/v3/projects/01bd830324fc4013993d787e993c731f/users/841c51f91d2a45c8b4dc4367f5ec81e9/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:02.140066 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ec578-2555-4ecd-821b-f10aa78519dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=01bd830324fc4013993d787e993c731f, user_id=841c51f91d2a45c8b4dc4367f5ec81e9, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:02.143170 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ec578-2555-4ecd-821b-f10aa78519dd admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:02.157892 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1410/2814] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:31:02 2022] PUT /identity/v3/projects/01bd830324fc4013993d787e993c731f/users/841c51f91d2a45c8b4dc4367f5ec81e9/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:31:02.171508 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25a15a-e50d-47fb-91b8-2212410b99e4 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:02.171799 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25a15a-e50d-47fb-91b8-2212410b99e4 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:02.172102 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25a15a-e50d-47fb-91b8-2212410b99e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:02.203114 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-ac25a15a-e50d-47fb-91b8-2212410b99e4 None None] MFA Rules not processed for user `841c51f91d2a45c8b4dc4367f5ec81e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:31:02.204597 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ac25a15a-e50d-47fb-91b8-2212410b99e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:31:02.291464 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1405/2815] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:31:02 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:31:02.300267 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ec578-2555-4ecd-821b-f10aa78519dd admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:02.398434 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ec578-2555-4ecd-821b-f10aa78519dd admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:02.407151 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4e0822-625e-4271-a41f-b1f3245a8948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:02.407881 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e0822-625e-4271-a41f-b1f3245a8948 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:02.408167 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e0822-625e-4271-a41f-b1f3245a8948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:02.409247 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e0822-625e-4271-a41f-b1f3245a8948 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:02.410136 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4e0822-625e-4271-a41f-b1f3245a8948 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:02.412983 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4e0822-625e-4271-a41f-b1f3245a8948 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:02.446697 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1411/2816] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:31:02 2022] POST /identity/v3/projects => generated 367 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:31:02.450886 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25a15a-e50d-47fb-91b8-2212410b99e4 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:02.463825 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25a15a-e50d-47fb-91b8-2212410b99e4 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:02.521564 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:31:02.556768 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a118b3-6505-4a6e-adc4-4095bdbfc8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:02.557667 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a118b3-6505-4a6e-adc4-4095bdbfc8bc admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:02.558135 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a118b3-6505-4a6e-adc4-4095bdbfc8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:02.558480 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a118b3-6505-4a6e-adc4-4095bdbfc8bc admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:02.559315 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a118b3-6505-4a6e-adc4-4095bdbfc8bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:02.561617 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a118b3-6505-4a6e-adc4-4095bdbfc8bc admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:02.585106 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1406/2817] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:31:02 2022] POST /identity/v3/users => generated 290 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:31:02.588723 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4e0822-625e-4271-a41f-b1f3245a8948 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:02.600690 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4e0822-625e-4271-a41f-b1f3245a8948 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:02.605822 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3cc8cc-c571-4beb-a041-7fcc812a21c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:02.606631 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3cc8cc-c571-4beb-a041-7fcc812a21c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:02.606918 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3cc8cc-c571-4beb-a041-7fcc812a21c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:02.607230 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3cc8cc-c571-4beb-a041-7fcc812a21c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:02.608054 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3cc8cc-c571-4beb-a041-7fcc812a21c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:02.610069 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3cc8cc-c571-4beb-a041-7fcc812a21c3 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:02.622484 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1412/2818] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:31:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:31:02.627668 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a118b3-6505-4a6e-adc4-4095bdbfc8bc admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:02.638709 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a118b3-6505-4a6e-adc4-4095bdbfc8bc admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:02.643795 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9363d3-8204-408e-80d0-d7a79d01cee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:02.644859 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9363d3-8204-408e-80d0-d7a79d01cee3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:02.644985 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9363d3-8204-408e-80d0-d7a79d01cee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:02.645240 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9363d3-8204-408e-80d0-d7a79d01cee3 admin admin] PATH_INFO: `/v3/projects/949bcee69bee48e2abd0b1c0c060fb4a/users/9c4a39e16ebb4735b809ceab2245e3cd/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:02.661105 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9363d3-8204-408e-80d0-d7a79d01cee3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=949bcee69bee48e2abd0b1c0c060fb4a, user_id=9c4a39e16ebb4735b809ceab2245e3cd, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:02.663817 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9363d3-8204-408e-80d0-d7a79d01cee3 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:02.679106 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1407/2819] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:31:02 2022] PUT /identity/v3/projects/949bcee69bee48e2abd0b1c0c060fb4a/users/9c4a39e16ebb4735b809ceab2245e3cd/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:31:02.683965 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3cc8cc-c571-4beb-a041-7fcc812a21c3 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:02.695666 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3cc8cc-c571-4beb-a041-7fcc812a21c3 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:02.752921 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:31:02.761359 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f7b3ce-73cf-4eeb-b679-1968e844c949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:02.762083 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7b3ce-73cf-4eeb-b679-1968e844c949 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:02.762378 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7b3ce-73cf-4eeb-b679-1968e844c949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:02.762655 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7b3ce-73cf-4eeb-b679-1968e844c949 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:02.763390 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f7b3ce-73cf-4eeb-b679-1968e844c949 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:02.766137 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f7b3ce-73cf-4eeb-b679-1968e844c949 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:02.777295 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1413/2820] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:31:02 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:31:02.782218 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9363d3-8204-408e-80d0-d7a79d01cee3 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:02.795532 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9363d3-8204-408e-80d0-d7a79d01cee3 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:02.800991 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b74de-65e0-4dc3-be7a-95cca50a8069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:02.801976 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b74de-65e0-4dc3-be7a-95cca50a8069 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:02.802258 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b74de-65e0-4dc3-be7a-95cca50a8069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:02.802538 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b74de-65e0-4dc3-be7a-95cca50a8069 admin admin] PATH_INFO: `/v3/projects/949bcee69bee48e2abd0b1c0c060fb4a/users/9c4a39e16ebb4735b809ceab2245e3cd/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:02.804791 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b74de-65e0-4dc3-be7a-95cca50a8069 admin admin] RBAC: Authorizing `identity:create_grant(project_id=949bcee69bee48e2abd0b1c0c060fb4a, user_id=9c4a39e16ebb4735b809ceab2245e3cd, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:02.807489 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b74de-65e0-4dc3-be7a-95cca50a8069 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:02.819252 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1408/2821] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:31:02 2022] PUT /identity/v3/projects/949bcee69bee48e2abd0b1c0c060fb4a/users/9c4a39e16ebb4735b809ceab2245e3cd/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:31:02.887628 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761686d-07e2-4922-b7f0-40fb05caf779 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:02.887936 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761686d-07e2-4922-b7f0-40fb05caf779 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:02.888209 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761686d-07e2-4922-b7f0-40fb05caf779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:02.917580 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-3761686d-07e2-4922-b7f0-40fb05caf779 None None] MFA Rules not processed for user `9c4a39e16ebb4735b809ceab2245e3cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:31:02.918831 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3761686d-07e2-4922-b7f0-40fb05caf779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:31:02.996790 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1414/2822] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:31:02 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:31:03.008591 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b74de-65e0-4dc3-be7a-95cca50a8069 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:03.010370 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-cc4b74de-65e0-4dc3-be7a-95cca50a8069 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:31:03.082634 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b74de-65e0-4dc3-be7a-95cca50a8069 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:03.086644 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010c570-2c1a-4da7-9514-7ae83e531e2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:03.087301 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010c570-2c1a-4da7-9514-7ae83e531e2a service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:03.087586 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010c570-2c1a-4da7-9514-7ae83e531e2a service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:03.087861 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010c570-2c1a-4da7-9514-7ae83e531e2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:03.097551 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9010c570-2c1a-4da7-9514-7ae83e531e2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:03.099041 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9010c570-2c1a-4da7-9514-7ae83e531e2a service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:03.109991 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1409/2823] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:31:03 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:31:03.203793 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3761686d-07e2-4922-b7f0-40fb05caf779 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:03.215456 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3761686d-07e2-4922-b7f0-40fb05caf779 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:03.219637 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c8bf7-b99f-4731-bd9e-3e32f2143b82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:03.220375 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c8bf7-b99f-4731-bd9e-3e32f2143b82 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:03.221178 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c8bf7-b99f-4731-bd9e-3e32f2143b82 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:03.221178 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c8bf7-b99f-4731-bd9e-3e32f2143b82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:03.293429 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4c8bf7-b99f-4731-bd9e-3e32f2143b82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:03.295007 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4c8bf7-b99f-4731-bd9e-3e32f2143b82 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:03.306882 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1415/2824] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:31:03 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:31:05.985541 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010c570-2c1a-4da7-9514-7ae83e531e2a service cinder] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:05.987589 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-9010c570-2c1a-4da7-9514-7ae83e531e2a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:31:06.066932 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010c570-2c1a-4da7-9514-7ae83e531e2a service cinder] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:06.071417 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba583de0-a0e9-4e45-bcfb-f2914d0f2f1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:06.072080 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba583de0-a0e9-4e45-bcfb-f2914d0f2f1e service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:06.072365 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba583de0-a0e9-4e45-bcfb-f2914d0f2f1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:06.072640 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba583de0-a0e9-4e45-bcfb-f2914d0f2f1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:06.074866 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ba583de0-a0e9-4e45-bcfb-f2914d0f2f1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:31:06.135496 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:31:06.165310 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba583de0-a0e9-4e45-bcfb-f2914d0f2f1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:06.166604 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba583de0-a0e9-4e45-bcfb-f2914d0f2f1e service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:06.180986 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1410/2825] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:31:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:31:08.267638 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c8bf7-b99f-4731-bd9e-3e32f2143b82 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:08.333232 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c8bf7-b99f-4731-bd9e-3e32f2143b82 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:08.338141 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae03d8d-f973-4cd0-9b11-46a848263952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:08.339050 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae03d8d-f973-4cd0-9b11-46a848263952 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:08.339330 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae03d8d-f973-4cd0-9b11-46a848263952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:08.339600 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae03d8d-f973-4cd0-9b11-46a848263952 admin admin] PATH_INFO: `/v3/users/841c51f91d2a45c8b4dc4367f5ec81e9` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:08.340912 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae03d8d-f973-4cd0-9b11-46a848263952 admin admin] RBAC: Authorizing `identity:delete_user(user_id=841c51f91d2a45c8b4dc4367f5ec81e9)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:08.342875 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae03d8d-f973-4cd0-9b11-46a848263952 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:08.366905 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:31:08.397598 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-cae03d8d-f973-4cd0-9b11-46a848263952 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '841c51f91d2a45c8b4dc4367f5ec81e9'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:08.398343 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-cae03d8d-f973-4cd0-9b11-46a848263952 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '841c51f91d2a45c8b4dc4367f5ec81e9'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:08.399108 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-cae03d8d-f973-4cd0-9b11-46a848263952 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '841c51f91d2a45c8b4dc4367f5ec81e9'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:08.421380 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-cae03d8d-f973-4cd0-9b11-46a848263952 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '841c51f91d2a45c8b4dc4367f5ec81e9'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:08.431624 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-cae03d8d-f973-4cd0-9b11-46a848263952 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '841c51f91d2a45c8b4dc4367f5ec81e9'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:08.448677 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1416/2826] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:31:08 2022] DELETE /identity/v3/users/841c51f91d2a45c8b4dc4367f5ec81e9 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:31:08.453249 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce48b9e-3095-45b5-a86c-d389e82034dd None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:08.454264 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce48b9e-3095-45b5-a86c-d389e82034dd None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:08.454555 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce48b9e-3095-45b5-a86c-d389e82034dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:08.476515 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-bce48b9e-3095-45b5-a86c-d389e82034dd None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:31:08.477942 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-bce48b9e-3095-45b5-a86c-d389e82034dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:31:08.568093 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1411/2827] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:31:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:31:08.578153 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae03d8d-f973-4cd0-9b11-46a848263952 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:08.581554 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-cae03d8d-f973-4cd0-9b11-46a848263952 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:31:08.659612 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae03d8d-f973-4cd0-9b11-46a848263952 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:08.663637 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f55b8cd-da7f-43af-8dd3-3a243e63b741 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:08.664343 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55b8cd-da7f-43af-8dd3-3a243e63b741 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:08.664638 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55b8cd-da7f-43af-8dd3-3a243e63b741 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:08.664911 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55b8cd-da7f-43af-8dd3-3a243e63b741 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:08.675814 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f55b8cd-da7f-43af-8dd3-3a243e63b741 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:08.677254 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f55b8cd-da7f-43af-8dd3-3a243e63b741 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:08.688309 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1417/2828] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:31:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:31:08.971133 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce48b9e-3095-45b5-a86c-d389e82034dd None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:08.972797 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-bce48b9e-3095-45b5-a86c-d389e82034dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:31:08.987958 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce48b9e-3095-45b5-a86c-d389e82034dd None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:08.994883 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4708c9-4169-4fa6-a2c0-b9350c8f3de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:08.996105 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4708c9-4169-4fa6-a2c0-b9350c8f3de5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:08.996391 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4708c9-4169-4fa6-a2c0-b9350c8f3de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:08.996662 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4708c9-4169-4fa6-a2c0-b9350c8f3de5 admin admin] PATH_INFO: `/v3/projects/01bd830324fc4013993d787e993c731f` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:08.998137 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4708c9-4169-4fa6-a2c0-b9350c8f3de5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01bd830324fc4013993d787e993c731f)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:09.000129 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4708c9-4169-4fa6-a2c0-b9350c8f3de5 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:09.056871 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7a4708c9-4169-4fa6-a2c0-b9350c8f3de5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01bd830324fc4013993d787e993c731f', 'request_id': 'req-7a4708c9-4169-4fa6-a2c0-b9350c8f3de5'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:09.064183 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7a4708c9-4169-4fa6-a2c0-b9350c8f3de5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01bd830324fc4013993d787e993c731f', 'request_id': 'req-7a4708c9-4169-4fa6-a2c0-b9350c8f3de5'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:09.074071 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7a4708c9-4169-4fa6-a2c0-b9350c8f3de5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01bd830324fc4013993d787e993c731f', 'request_id': 'req-7a4708c9-4169-4fa6-a2c0-b9350c8f3de5'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:09.087002 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7a4708c9-4169-4fa6-a2c0-b9350c8f3de5 admin admin] The token cache is being invalidate because project 01bd830324fc4013993d787e993c731f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:31:09.087214 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7a4708c9-4169-4fa6-a2c0-b9350c8f3de5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:09.087841 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7a4708c9-4169-4fa6-a2c0-b9350c8f3de5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:09.089406 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1412/2829] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:31:08 2022] DELETE /identity/v3/projects/01bd830324fc4013993d787e993c731f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:31:09.094152 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f55b8cd-da7f-43af-8dd3-3a243e63b741 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:09.104761 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f55b8cd-da7f-43af-8dd3-3a243e63b741 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:09.176698 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e6a8ad-90ca-4a07-a5aa-c6689c5fa4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:09.177596 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6a8ad-90ca-4a07-a5aa-c6689c5fa4ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:09.177910 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6a8ad-90ca-4a07-a5aa-c6689c5fa4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:09.178198 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6a8ad-90ca-4a07-a5aa-c6689c5fa4ba admin admin] PATH_INFO: `/v3/users/9c4a39e16ebb4735b809ceab2245e3cd` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:09.179434 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e6a8ad-90ca-4a07-a5aa-c6689c5fa4ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c4a39e16ebb4735b809ceab2245e3cd)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:09.181376 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e6a8ad-90ca-4a07-a5aa-c6689c5fa4ba admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:09.230133 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:31:09.237593 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f3e6a8ad-90ca-4a07-a5aa-c6689c5fa4ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c4a39e16ebb4735b809ceab2245e3cd'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:09.238555 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f3e6a8ad-90ca-4a07-a5aa-c6689c5fa4ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c4a39e16ebb4735b809ceab2245e3cd'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:09.239312 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f3e6a8ad-90ca-4a07-a5aa-c6689c5fa4ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c4a39e16ebb4735b809ceab2245e3cd'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:09.254189 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f3e6a8ad-90ca-4a07-a5aa-c6689c5fa4ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c4a39e16ebb4735b809ceab2245e3cd'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:09.264838 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f3e6a8ad-90ca-4a07-a5aa-c6689c5fa4ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c4a39e16ebb4735b809ceab2245e3cd'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:09.278706 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1418/2830] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:31:09 2022] DELETE /identity/v3/users/9c4a39e16ebb4735b809ceab2245e3cd => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:31:09.573141 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4708c9-4169-4fa6-a2c0-b9350c8f3de5 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:09.575455 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-7a4708c9-4169-4fa6-a2c0-b9350c8f3de5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:31:09.590533 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4708c9-4169-4fa6-a2c0-b9350c8f3de5 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:09.646020 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:31:09.654158 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c81d091-0665-49af-b1ae-d97fea80b187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:09.655288 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81d091-0665-49af-b1ae-d97fea80b187 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:09.655669 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81d091-0665-49af-b1ae-d97fea80b187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:09.656075 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81d091-0665-49af-b1ae-d97fea80b187 admin admin] PATH_INFO: `/v3/projects/949bcee69bee48e2abd0b1c0c060fb4a` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:09.658040 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c81d091-0665-49af-b1ae-d97fea80b187 admin admin] RBAC: Authorizing `identity:delete_project(project_id=949bcee69bee48e2abd0b1c0c060fb4a)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:09.660496 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c81d091-0665-49af-b1ae-d97fea80b187 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:09.730258 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-5c81d091-0665-49af-b1ae-d97fea80b187 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '949bcee69bee48e2abd0b1c0c060fb4a', 'request_id': 'req-5c81d091-0665-49af-b1ae-d97fea80b187'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:09.737440 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-5c81d091-0665-49af-b1ae-d97fea80b187 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '949bcee69bee48e2abd0b1c0c060fb4a', 'request_id': 'req-5c81d091-0665-49af-b1ae-d97fea80b187'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:09.746021 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-5c81d091-0665-49af-b1ae-d97fea80b187 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '949bcee69bee48e2abd0b1c0c060fb4a', 'request_id': 'req-5c81d091-0665-49af-b1ae-d97fea80b187'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:09.758830 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-5c81d091-0665-49af-b1ae-d97fea80b187 admin admin] The token cache is being invalidate because project 949bcee69bee48e2abd0b1c0c060fb4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:31:09.759126 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-5c81d091-0665-49af-b1ae-d97fea80b187 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:09.759854 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-5c81d091-0665-49af-b1ae-d97fea80b187 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:09.760735 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ea1c3-9e47-4030-9e42-459e83dc88eb None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:09.761023 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ea1c3-9e47-4030-9e42-459e83dc88eb None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:09.761318 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ea1c3-9e47-4030-9e42-459e83dc88eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:09.761428 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1413/2831] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:31:09 2022] DELETE /identity/v3/projects/949bcee69bee48e2abd0b1c0c060fb4a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:31:09.768595 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3678fc1e-9194-4bb6-96f3-1c2be2ad1043 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:09.769006 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3678fc1e-9194-4bb6-96f3-1c2be2ad1043 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:09.769377 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3678fc1e-9194-4bb6-96f3-1c2be2ad1043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:09.784917 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-be8ea1c3-9e47-4030-9e42-459e83dc88eb None None] MFA Rules not processed for user `cad33601754a462c828566fb54c6e100`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:31:09.786184 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-be8ea1c3-9e47-4030-9e42-459e83dc88eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:31:09.791001 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-3678fc1e-9194-4bb6-96f3-1c2be2ad1043 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:31:09.792174 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-3678fc1e-9194-4bb6-96f3-1c2be2ad1043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:31:09.847579 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1419/2832] 10.222.0.27 () {58 vars in 967 bytes} [Wed Jun 29 12:31:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:31:09.869716 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1414/2833] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:31:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:31:09.878079 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cae899-8f53-4054-9e2f-1fb8b6ed488b None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:09.878370 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cae899-8f53-4054-9e2f-1fb8b6ed488b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:09.878644 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cae899-8f53-4054-9e2f-1fb8b6ed488b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:09.899686 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3678fc1e-9194-4bb6-96f3-1c2be2ad1043 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:09.901389 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-3678fc1e-9194-4bb6-96f3-1c2be2ad1043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:31:09.901631 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-08cae899-8f53-4054-9e2f-1fb8b6ed488b None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:31:09.902865 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-08cae899-8f53-4054-9e2f-1fb8b6ed488b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:31:09.911919 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1420/2834] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:31:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:31:09.916316 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cae899-8f53-4054-9e2f-1fb8b6ed488b None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:09.927498 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cae899-8f53-4054-9e2f-1fb8b6ed488b None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:09.932240 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef35e5-78b0-4d9a-9f07-9d627c437ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:09.933122 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef35e5-78b0-4d9a-9f07-9d627c437ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:09.933403 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef35e5-78b0-4d9a-9f07-9d627c437ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:09.933673 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef35e5-78b0-4d9a-9f07-9d627c437ee9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:09.934426 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cef35e5-78b0-4d9a-9f07-9d627c437ee9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:31:09.934729 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cef35e5-78b0-4d9a-9f07-9d627c437ee9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:09.936757 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cef35e5-78b0-4d9a-9f07-9d627c437ee9 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:09.949815 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1421/2835] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:31:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:31:09.955153 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef35e5-78b0-4d9a-9f07-9d627c437ee9 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:09.967582 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef35e5-78b0-4d9a-9f07-9d627c437ee9 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:09.975696 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b90f087-7394-4975-9bb8-887e3ec2eab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:09.976361 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b90f087-7394-4975-9bb8-887e3ec2eab7 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:09.976639 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b90f087-7394-4975-9bb8-887e3ec2eab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:09.976907 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b90f087-7394-4975-9bb8-887e3ec2eab7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:09.977600 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b90f087-7394-4975-9bb8-887e3ec2eab7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:09.979622 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b90f087-7394-4975-9bb8-887e3ec2eab7 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:10.002853 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3678fc1e-9194-4bb6-96f3-1c2be2ad1043 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:10.011226 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293143c6-c0d6-4d8b-af09-fde675c2f529 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc92f8232bda407c84365eb10ede737f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:10.012173 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293143c6-c0d6-4d8b-af09-fde675c2f529 service swift] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:10.012173 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293143c6-c0d6-4d8b-af09-fde675c2f529 service swift] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:10.012410 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293143c6-c0d6-4d8b-af09-fde675c2f529 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:10.021277 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1422/2836] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:31:09 2022] POST /identity/v3/projects => generated 383 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:31:10.022598 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293143c6-c0d6-4d8b-af09-fde675c2f529 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:10.024447 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293143c6-c0d6-4d8b-af09-fde675c2f529 service swift] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:10.025387 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b90f087-7394-4975-9bb8-887e3ec2eab7 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:10.038950 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1415/2837] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Jun 29 12:31:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 29 12:31:10.112732 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b90f087-7394-4975-9bb8-887e3ec2eab7 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:10.118284 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d1646-c50f-4792-8b44-07946310158e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:10.118965 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d1646-c50f-4792-8b44-07946310158e admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:10.119249 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d1646-c50f-4792-8b44-07946310158e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:10.119525 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d1646-c50f-4792-8b44-07946310158e admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:10.120224 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d1646-c50f-4792-8b44-07946310158e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:10.122194 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d1646-c50f-4792-8b44-07946310158e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:10.145734 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1423/2838] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:31:10 2022] POST /identity/v3/users => generated 292 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:31:10.149301 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293143c6-c0d6-4d8b-af09-fde675c2f529 service swift] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:10.161387 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293143c6-c0d6-4d8b-af09-fde675c2f529 service swift] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:10.166620 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce049a2-2bf0-465a-8afc-c92d2619fe8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:10.167296 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce049a2-2bf0-465a-8afc-c92d2619fe8e admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:10.167594 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce049a2-2bf0-465a-8afc-c92d2619fe8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:10.167937 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce049a2-2bf0-465a-8afc-c92d2619fe8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:10.168750 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce049a2-2bf0-465a-8afc-c92d2619fe8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:10.170419 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce049a2-2bf0-465a-8afc-c92d2619fe8e admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:10.182662 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1416/2839] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:31:10.187086 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d1646-c50f-4792-8b44-07946310158e admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:10.198236 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d1646-c50f-4792-8b44-07946310158e admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:10.203155 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d0d5f-7f08-4563-b6da-b7fdbbfc42bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:10.203970 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d0d5f-7f08-4563-b6da-b7fdbbfc42bf admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:10.204251 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d0d5f-7f08-4563-b6da-b7fdbbfc42bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:10.204524 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d0d5f-7f08-4563-b6da-b7fdbbfc42bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:10.205257 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0d0d5f-7f08-4563-b6da-b7fdbbfc42bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:10.206899 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0d0d5f-7f08-4563-b6da-b7fdbbfc42bf admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:10.214989 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:31:10.224245 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1424/2840] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:31:10.226794 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce049a2-2bf0-465a-8afc-c92d2619fe8e admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:10.239519 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce049a2-2bf0-465a-8afc-c92d2619fe8e admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:10.246380 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd1f569-fc44-424b-843c-07cb0913a0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:10.247377 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd1f569-fc44-424b-843c-07cb0913a0a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:10.247704 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd1f569-fc44-424b-843c-07cb0913a0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:10.247983 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd1f569-fc44-424b-843c-07cb0913a0a0 admin admin] PATH_INFO: `/v3/projects/df2d2881bfa946aa98c1b0d24124c3e0/users/e07b47910ff146129f5c67d67136e623/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:10.251057 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:31:10.272517 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd1f569-fc44-424b-843c-07cb0913a0a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df2d2881bfa946aa98c1b0d24124c3e0, user_id=e07b47910ff146129f5c67d67136e623, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:10.278227 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd1f569-fc44-424b-843c-07cb0913a0a0 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:10.302931 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1417/2841] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:31:10 2022] PUT /identity/v3/projects/df2d2881bfa946aa98c1b0d24124c3e0/users/e07b47910ff146129f5c67d67136e623/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:31:10.315218 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019219a9-56f6-458b-a818-5ba307c5ad00 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:10.319083 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019219a9-56f6-458b-a818-5ba307c5ad00 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:10.319083 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019219a9-56f6-458b-a818-5ba307c5ad00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:10.346068 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-019219a9-56f6-458b-a818-5ba307c5ad00 None None] MFA Rules not processed for user `e07b47910ff146129f5c67d67136e623`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:31:10.347306 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-019219a9-56f6-458b-a818-5ba307c5ad00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:31:10.422887 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1425/2842] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:31:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:31:10.427648 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd1f569-fc44-424b-843c-07cb0913a0a0 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:10.498397 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd1f569-fc44-424b-843c-07cb0913a0a0 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:10.504094 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e554dbaa-5753-4942-8b41-0735d4c09291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:10.504882 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554dbaa-5753-4942-8b41-0735d4c09291 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:10.505165 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554dbaa-5753-4942-8b41-0735d4c09291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:10.505461 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554dbaa-5753-4942-8b41-0735d4c09291 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:10.506203 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e554dbaa-5753-4942-8b41-0735d4c09291 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:10.508125 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e554dbaa-5753-4942-8b41-0735d4c09291 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:10.541891 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1418/2843] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:31:10 2022] POST /identity/v3/projects => generated 381 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:31:10.543324 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019219a9-56f6-458b-a818-5ba307c5ad00 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:10.555661 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019219a9-56f6-458b-a818-5ba307c5ad00 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:10.619524 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df6d453-dba6-4b6d-b550-b456d9eea6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:10.620417 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6d453-dba6-4b6d-b550-b456d9eea6ad admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:10.620837 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6d453-dba6-4b6d-b550-b456d9eea6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:10.621114 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6d453-dba6-4b6d-b550-b456d9eea6ad admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:10.621971 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df6d453-dba6-4b6d-b550-b456d9eea6ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:10.624062 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df6d453-dba6-4b6d-b550-b456d9eea6ad admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:10.649255 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1426/2844] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:31:10 2022] POST /identity/v3/users => generated 297 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:31:10.650592 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e554dbaa-5753-4942-8b41-0735d4c09291 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:10.662867 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e554dbaa-5753-4942-8b41-0735d4c09291 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:10.668345 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e25e9c-5bcc-412c-95d2-1e8f65d8b0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:10.669261 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e25e9c-5bcc-412c-95d2-1e8f65d8b0a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:10.669541 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e25e9c-5bcc-412c-95d2-1e8f65d8b0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:10.669848 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e25e9c-5bcc-412c-95d2-1e8f65d8b0a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:10.670996 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e25e9c-5bcc-412c-95d2-1e8f65d8b0a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:10.672903 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e25e9c-5bcc-412c-95d2-1e8f65d8b0a2 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:10.684706 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1419/2845] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:31:10.690760 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df6d453-dba6-4b6d-b550-b456d9eea6ad admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:10.704883 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df6d453-dba6-4b6d-b550-b456d9eea6ad admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:10.710216 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752a8d83-4bb7-4aa8-9a97-ce01d064acd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:10.711123 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a8d83-4bb7-4aa8-9a97-ce01d064acd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:10.711379 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a8d83-4bb7-4aa8-9a97-ce01d064acd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:10.711675 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a8d83-4bb7-4aa8-9a97-ce01d064acd4 admin admin] PATH_INFO: `/v3/projects/83a9956fd50b427981cfce0bc61c4fea/users/42c5242985454892ae2854e4e1212cad/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:10.728896 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752a8d83-4bb7-4aa8-9a97-ce01d064acd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83a9956fd50b427981cfce0bc61c4fea, user_id=42c5242985454892ae2854e4e1212cad, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:10.731605 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752a8d83-4bb7-4aa8-9a97-ce01d064acd4 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:10.748322 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1427/2846] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:31:10 2022] PUT /identity/v3/projects/83a9956fd50b427981cfce0bc61c4fea/users/42c5242985454892ae2854e4e1212cad/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:31:10.752321 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e25e9c-5bcc-412c-95d2-1e8f65d8b0a2 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:10.767322 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e25e9c-5bcc-412c-95d2-1e8f65d8b0a2 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:10.845308 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa04e43e-74b4-467e-86c6-4ae33ba65eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:10.846268 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04e43e-74b4-467e-86c6-4ae33ba65eb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:10.846672 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04e43e-74b4-467e-86c6-4ae33ba65eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:10.847080 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04e43e-74b4-467e-86c6-4ae33ba65eb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:10.848012 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa04e43e-74b4-467e-86c6-4ae33ba65eb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:10.850093 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa04e43e-74b4-467e-86c6-4ae33ba65eb0 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:10.865854 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1420/2847] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:31:10.867062 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752a8d83-4bb7-4aa8-9a97-ce01d064acd4 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:10.878111 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752a8d83-4bb7-4aa8-9a97-ce01d064acd4 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:10.882965 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec05fbf-f7d3-45b3-a593-02d7615620ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:10.883876 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec05fbf-f7d3-45b3-a593-02d7615620ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:10.884159 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec05fbf-f7d3-45b3-a593-02d7615620ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:10.884600 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec05fbf-f7d3-45b3-a593-02d7615620ea admin admin] PATH_INFO: `/v3/projects/83a9956fd50b427981cfce0bc61c4fea/users/42c5242985454892ae2854e4e1212cad/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:10.886654 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec05fbf-f7d3-45b3-a593-02d7615620ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=83a9956fd50b427981cfce0bc61c4fea, user_id=42c5242985454892ae2854e4e1212cad, role_id=e0e69ac8a8bf4cc4baa6aa18f2fc9919)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:10.889306 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec05fbf-f7d3-45b3-a593-02d7615620ea admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:10.900726 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1428/2848] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:31:10 2022] PUT /identity/v3/projects/83a9956fd50b427981cfce0bc61c4fea/users/42c5242985454892ae2854e4e1212cad/roles/e0e69ac8a8bf4cc4baa6aa18f2fc9919 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:31:10.911409 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70c0bf-5977-47cd-8ca1-8896559a796a None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:10.911716 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70c0bf-5977-47cd-8ca1-8896559a796a None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:10.911975 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70c0bf-5977-47cd-8ca1-8896559a796a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:10.940710 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-de70c0bf-5977-47cd-8ca1-8896559a796a None None] MFA Rules not processed for user `42c5242985454892ae2854e4e1212cad`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:31:10.941926 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-de70c0bf-5977-47cd-8ca1-8896559a796a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:31:10.987061 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:31:11.025041 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1421/2849] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:31:10 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:31:11.037628 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec05fbf-f7d3-45b3-a593-02d7615620ea admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:11.039694 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6ec05fbf-f7d3-45b3-a593-02d7615620ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:31:11.091733 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:31:11.107742 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec05fbf-f7d3-45b3-a593-02d7615620ea admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:11.112277 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3f34a-5dfc-4b58-b21a-2059819fa360 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:11.113024 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3f34a-5dfc-4b58-b21a-2059819fa360 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:11.113364 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3f34a-5dfc-4b58-b21a-2059819fa360 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:11.113642 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3f34a-5dfc-4b58-b21a-2059819fa360 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:11.123957 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b3f34a-5dfc-4b58-b21a-2059819fa360 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:11.125497 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b3f34a-5dfc-4b58-b21a-2059819fa360 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:11.135895 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1429/2850] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:31:11 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:31:11.210830 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de70c0bf-5977-47cd-8ca1-8896559a796a None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:11.222559 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de70c0bf-5977-47cd-8ca1-8896559a796a None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:11.227029 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d08be15-a45c-4475-8714-abb5297154de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:11.227725 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08be15-a45c-4475-8714-abb5297154de service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:11.228025 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08be15-a45c-4475-8714-abb5297154de service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:11.228302 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08be15-a45c-4475-8714-abb5297154de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:11.298426 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d08be15-a45c-4475-8714-abb5297154de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:11.299931 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d08be15-a45c-4475-8714-abb5297154de service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:11.310641 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1422/2851] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:31:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:31:11.636847 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3f34a-5dfc-4b58-b21a-2059819fa360 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:11.710490 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3f34a-5dfc-4b58-b21a-2059819fa360 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:11.715331 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ab90d5-23ef-44b5-b50a-89bc4279695f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:11.716235 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab90d5-23ef-44b5-b50a-89bc4279695f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:11.716512 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab90d5-23ef-44b5-b50a-89bc4279695f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:11.716774 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab90d5-23ef-44b5-b50a-89bc4279695f admin admin] PATH_INFO: `/v3/users/e07b47910ff146129f5c67d67136e623` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:11.718079 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ab90d5-23ef-44b5-b50a-89bc4279695f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e07b47910ff146129f5c67d67136e623)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:11.720156 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ab90d5-23ef-44b5-b50a-89bc4279695f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:11.794182 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-99ab90d5-23ef-44b5-b50a-89bc4279695f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e07b47910ff146129f5c67d67136e623'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:11.794886 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-99ab90d5-23ef-44b5-b50a-89bc4279695f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e07b47910ff146129f5c67d67136e623'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:11.795543 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-99ab90d5-23ef-44b5-b50a-89bc4279695f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e07b47910ff146129f5c67d67136e623'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:11.811204 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-99ab90d5-23ef-44b5-b50a-89bc4279695f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e07b47910ff146129f5c67d67136e623'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:11.820191 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-99ab90d5-23ef-44b5-b50a-89bc4279695f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e07b47910ff146129f5c67d67136e623'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:11.836748 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1430/2852] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:31:11 2022] DELETE /identity/v3/users/e07b47910ff146129f5c67d67136e623 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:31:11.842368 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3286b-8443-4eaf-901d-00891174ac68 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:11.842868 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3286b-8443-4eaf-901d-00891174ac68 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:11.842994 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3286b-8443-4eaf-901d-00891174ac68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:11.863872 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-41e3286b-8443-4eaf-901d-00891174ac68 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:31:11.865150 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-41e3286b-8443-4eaf-901d-00891174ac68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:31:11.937236 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1423/2853] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:31:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:31:11.948130 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ab90d5-23ef-44b5-b50a-89bc4279695f admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:11.950900 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-99ab90d5-23ef-44b5-b50a-89bc4279695f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:31:12.019951 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ab90d5-23ef-44b5-b50a-89bc4279695f admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:12.024043 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d01674-6bf5-4240-bbea-4ad03fa6691a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:12.024716 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d01674-6bf5-4240-bbea-4ad03fa6691a service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:12.025007 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d01674-6bf5-4240-bbea-4ad03fa6691a service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:12.025323 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d01674-6bf5-4240-bbea-4ad03fa6691a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:12.037036 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d01674-6bf5-4240-bbea-4ad03fa6691a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:12.038616 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d01674-6bf5-4240-bbea-4ad03fa6691a service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:12.054224 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1431/2854] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:31:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:31:12.383878 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3286b-8443-4eaf-901d-00891174ac68 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:12.386019 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-41e3286b-8443-4eaf-901d-00891174ac68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:31:12.416997 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3286b-8443-4eaf-901d-00891174ac68 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:12.424421 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce6afb-fed6-4eb0-94c4-31b52ed7010c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:12.425863 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce6afb-fed6-4eb0-94c4-31b52ed7010c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:12.426148 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce6afb-fed6-4eb0-94c4-31b52ed7010c admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:12.426364 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce6afb-fed6-4eb0-94c4-31b52ed7010c admin admin] PATH_INFO: `/v3/projects/df2d2881bfa946aa98c1b0d24124c3e0` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:12.427998 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ce6afb-fed6-4eb0-94c4-31b52ed7010c admin admin] RBAC: Authorizing `identity:delete_project(project_id=df2d2881bfa946aa98c1b0d24124c3e0)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:12.430071 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ce6afb-fed6-4eb0-94c4-31b52ed7010c admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:12.495443 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a5ce6afb-fed6-4eb0-94c4-31b52ed7010c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df2d2881bfa946aa98c1b0d24124c3e0', 'request_id': 'req-a5ce6afb-fed6-4eb0-94c4-31b52ed7010c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:12.505894 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a5ce6afb-fed6-4eb0-94c4-31b52ed7010c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df2d2881bfa946aa98c1b0d24124c3e0', 'request_id': 'req-a5ce6afb-fed6-4eb0-94c4-31b52ed7010c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:12.519694 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a5ce6afb-fed6-4eb0-94c4-31b52ed7010c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df2d2881bfa946aa98c1b0d24124c3e0', 'request_id': 'req-a5ce6afb-fed6-4eb0-94c4-31b52ed7010c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:12.540424 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:31:12.545943 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a5ce6afb-fed6-4eb0-94c4-31b52ed7010c admin admin] The token cache is being invalidate because project df2d2881bfa946aa98c1b0d24124c3e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:31:12.546688 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a5ce6afb-fed6-4eb0-94c4-31b52ed7010c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:12.549394 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a5ce6afb-fed6-4eb0-94c4-31b52ed7010c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:12.551694 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1424/2855] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:31:12 2022] DELETE /identity/v3/projects/df2d2881bfa946aa98c1b0d24124c3e0 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:31:12.556633 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d01674-6bf5-4240-bbea-4ad03fa6691a service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:12.570877 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d01674-6bf5-4240-bbea-4ad03fa6691a service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:12.576614 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:31:12.658884 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415964a3-83e8-460c-b050-5fe18a313dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:12.659791 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415964a3-83e8-460c-b050-5fe18a313dfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:12.660070 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415964a3-83e8-460c-b050-5fe18a313dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:12.660347 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415964a3-83e8-460c-b050-5fe18a313dfe admin admin] PATH_INFO: `/v3/users/42c5242985454892ae2854e4e1212cad` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:12.661587 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415964a3-83e8-460c-b050-5fe18a313dfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=42c5242985454892ae2854e4e1212cad)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:12.663597 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415964a3-83e8-460c-b050-5fe18a313dfe admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:12.847286 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-415964a3-83e8-460c-b050-5fe18a313dfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42c5242985454892ae2854e4e1212cad'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:12.847945 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-415964a3-83e8-460c-b050-5fe18a313dfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42c5242985454892ae2854e4e1212cad'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:12.848557 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-415964a3-83e8-460c-b050-5fe18a313dfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42c5242985454892ae2854e4e1212cad'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:12.861885 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-415964a3-83e8-460c-b050-5fe18a313dfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42c5242985454892ae2854e4e1212cad'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:12.874125 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-415964a3-83e8-460c-b050-5fe18a313dfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42c5242985454892ae2854e4e1212cad'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:12.886943 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1432/2856] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:31:12 2022] DELETE /identity/v3/users/42c5242985454892ae2854e4e1212cad => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:31:13.220677 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce6afb-fed6-4eb0-94c4-31b52ed7010c admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:13.222787 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a5ce6afb-fed6-4eb0-94c4-31b52ed7010c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:31:13.236876 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce6afb-fed6-4eb0-94c4-31b52ed7010c admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:13.304394 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81053114-8dbb-413c-91d8-fbfb938e4bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:13.305178 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81053114-8dbb-413c-91d8-fbfb938e4bf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:13.305443 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81053114-8dbb-413c-91d8-fbfb938e4bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:13.305726 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81053114-8dbb-413c-91d8-fbfb938e4bf8 admin admin] PATH_INFO: `/v3/projects/83a9956fd50b427981cfce0bc61c4fea` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:13.306974 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81053114-8dbb-413c-91d8-fbfb938e4bf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83a9956fd50b427981cfce0bc61c4fea)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:13.308906 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81053114-8dbb-413c-91d8-fbfb938e4bf8 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:13.359082 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-81053114-8dbb-413c-91d8-fbfb938e4bf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83a9956fd50b427981cfce0bc61c4fea', 'request_id': 'req-81053114-8dbb-413c-91d8-fbfb938e4bf8'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:13.364531 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-81053114-8dbb-413c-91d8-fbfb938e4bf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83a9956fd50b427981cfce0bc61c4fea', 'request_id': 'req-81053114-8dbb-413c-91d8-fbfb938e4bf8'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:13.374888 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-81053114-8dbb-413c-91d8-fbfb938e4bf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83a9956fd50b427981cfce0bc61c4fea', 'request_id': 'req-81053114-8dbb-413c-91d8-fbfb938e4bf8'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:13.387801 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-81053114-8dbb-413c-91d8-fbfb938e4bf8 admin admin] The token cache is being invalidate because project 83a9956fd50b427981cfce0bc61c4fea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:31:13.388121 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-81053114-8dbb-413c-91d8-fbfb938e4bf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:13.388753 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-81053114-8dbb-413c-91d8-fbfb938e4bf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:13.390556 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1425/2857] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:31:13 2022] DELETE /identity/v3/projects/83a9956fd50b427981cfce0bc61c4fea => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:31:13.395647 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244fed4a-7eba-4f57-8217-9409e0fe5406 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:13.396129 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244fed4a-7eba-4f57-8217-9409e0fe5406 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:13.396542 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244fed4a-7eba-4f57-8217-9409e0fe5406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:13.425547 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-244fed4a-7eba-4f57-8217-9409e0fe5406 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:31:13.427176 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-244fed4a-7eba-4f57-8217-9409e0fe5406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:31:13.510847 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1433/2858] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:31:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:31:13.519335 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354670f6-a668-49b0-9d68-89b12631ec94 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:13.519622 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354670f6-a668-49b0-9d68-89b12631ec94 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:13.519898 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354670f6-a668-49b0-9d68-89b12631ec94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:13.539955 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-354670f6-a668-49b0-9d68-89b12631ec94 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:31:13.541163 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-354670f6-a668-49b0-9d68-89b12631ec94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:31:13.552572 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1426/2859] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:31:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:31:13.556893 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244fed4a-7eba-4f57-8217-9409e0fe5406 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:13.557364 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354670f6-a668-49b0-9d68-89b12631ec94 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:13.558997 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-244fed4a-7eba-4f57-8217-9409e0fe5406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:31:13.569671 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354670f6-a668-49b0-9d68-89b12631ec94 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:13.575277 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c2843-e8d2-47a3-bd24-e69a5363bd1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:13.576153 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c2843-e8d2-47a3-bd24-e69a5363bd1f admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:13.576718 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c2843-e8d2-47a3-bd24-e69a5363bd1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:13.576997 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c2843-e8d2-47a3-bd24-e69a5363bd1f admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:13.577862 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c2843-e8d2-47a3-bd24-e69a5363bd1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:31:13.578302 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c2843-e8d2-47a3-bd24-e69a5363bd1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:13.579924 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c2843-e8d2-47a3-bd24-e69a5363bd1f admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:13.596359 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1427/2860] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:31:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:31:13.597997 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c2843-e8d2-47a3-bd24-e69a5363bd1f admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:13.602717 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:31:13.622653 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c2843-e8d2-47a3-bd24-e69a5363bd1f admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:13.630451 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff62fb-c13b-4b80-9136-9ab4160a02b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:13.631171 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff62fb-c13b-4b80-9136-9ab4160a02b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:13.631525 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff62fb-c13b-4b80-9136-9ab4160a02b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:13.631868 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff62fb-c13b-4b80-9136-9ab4160a02b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:13.633939 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfff62fb-c13b-4b80-9136-9ab4160a02b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:13.646590 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfff62fb-c13b-4b80-9136-9ab4160a02b6 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:13.659011 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244fed4a-7eba-4f57-8217-9409e0fe5406 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:13.666128 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f15337-449e-4759-b8bb-cc3a62505982 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '286a99b42d9246db909040bf8ab18ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:13.667056 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f15337-449e-4759-b8bb-cc3a62505982 service placement] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:13.667559 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f15337-449e-4759-b8bb-cc3a62505982 service placement] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:13.668026 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f15337-449e-4759-b8bb-cc3a62505982 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:13.669995 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-41f15337-449e-4759-b8bb-cc3a62505982 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:31:13.680243 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1428/2861] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:31:13 2022] POST /identity/v3/projects => generated 373 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:31:13.683856 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff62fb-c13b-4b80-9136-9ab4160a02b6 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:13.686415 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f15337-449e-4759-b8bb-cc3a62505982 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:13.688165 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f15337-449e-4759-b8bb-cc3a62505982 service placement] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:13.700997 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1434/2862] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:31:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:31:13.748900 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:31:13.769229 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff62fb-c13b-4b80-9136-9ab4160a02b6 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:13.774974 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31616e-dfae-4f57-a6c6-9e4c7361e604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:13.775659 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31616e-dfae-4f57-a6c6-9e4c7361e604 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:13.775989 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31616e-dfae-4f57-a6c6-9e4c7361e604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:13.776265 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31616e-dfae-4f57-a6c6-9e4c7361e604 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:13.776970 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c31616e-dfae-4f57-a6c6-9e4c7361e604 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:13.780334 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c31616e-dfae-4f57-a6c6-9e4c7361e604 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:13.807823 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1429/2863] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:31:13 2022] POST /identity/v3/users => generated 287 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:31:13.812282 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f15337-449e-4759-b8bb-cc3a62505982 service placement] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:13.823480 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f15337-449e-4759-b8bb-cc3a62505982 service placement] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:13.828390 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d6f41-c2ff-4536-9d34-67f3148123c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:13.829488 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d6f41-c2ff-4536-9d34-67f3148123c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:13.829839 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d6f41-c2ff-4536-9d34-67f3148123c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:13.830137 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d6f41-c2ff-4536-9d34-67f3148123c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:13.830864 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586d6f41-c2ff-4536-9d34-67f3148123c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:13.832616 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586d6f41-c2ff-4536-9d34-67f3148123c1 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:13.847201 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1435/2864] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:31:13.848003 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31616e-dfae-4f57-a6c6-9e4c7361e604 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:13.858678 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31616e-dfae-4f57-a6c6-9e4c7361e604 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:13.864009 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f609566-cbd9-48f5-9236-fe24e6f14e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:13.864691 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f609566-cbd9-48f5-9236-fe24e6f14e3c admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:13.864972 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f609566-cbd9-48f5-9236-fe24e6f14e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:13.865279 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f609566-cbd9-48f5-9236-fe24e6f14e3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:13.866297 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f609566-cbd9-48f5-9236-fe24e6f14e3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:13.867680 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f609566-cbd9-48f5-9236-fe24e6f14e3c admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:13.880318 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1430/2865] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:31:13.882791 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d6f41-c2ff-4536-9d34-67f3148123c1 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:13.893125 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d6f41-c2ff-4536-9d34-67f3148123c1 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:13.897926 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d4f58e-72bb-48be-af2e-438c5200a4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:13.898686 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4f58e-72bb-48be-af2e-438c5200a4ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:13.898959 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4f58e-72bb-48be-af2e-438c5200a4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:13.899223 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4f58e-72bb-48be-af2e-438c5200a4ae admin admin] PATH_INFO: `/v3/projects/973f6afbcde54545bde44fc1038af87d/users/e7d28fe81253417580237462ad5a4ba9/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:13.916669 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d4f58e-72bb-48be-af2e-438c5200a4ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=973f6afbcde54545bde44fc1038af87d, user_id=e7d28fe81253417580237462ad5a4ba9, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:13.919534 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d4f58e-72bb-48be-af2e-438c5200a4ae admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:13.934898 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1436/2866] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:31:13 2022] PUT /identity/v3/projects/973f6afbcde54545bde44fc1038af87d/users/e7d28fe81253417580237462ad5a4ba9/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:31:13.946905 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3416aa-2232-49a8-874f-87c55923425e None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:13.947263 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3416aa-2232-49a8-874f-87c55923425e None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:13.947535 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3416aa-2232-49a8-874f-87c55923425e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:13.979411 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-4f3416aa-2232-49a8-874f-87c55923425e None None] MFA Rules not processed for user `e7d28fe81253417580237462ad5a4ba9`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:31:13.980926 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-4f3416aa-2232-49a8-874f-87c55923425e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:31:14.054088 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1431/2867] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:31:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:31:14.066126 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d4f58e-72bb-48be-af2e-438c5200a4ae admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:14.067960 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-66d4f58e-72bb-48be-af2e-438c5200a4ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:31:14.134775 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d4f58e-72bb-48be-af2e-438c5200a4ae admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:14.138741 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f305fd-9a92-4152-8ab2-caaeead7183f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:14.139394 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f305fd-9a92-4152-8ab2-caaeead7183f service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:14.139672 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f305fd-9a92-4152-8ab2-caaeead7183f service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:14.139938 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f305fd-9a92-4152-8ab2-caaeead7183f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:14.149122 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f305fd-9a92-4152-8ab2-caaeead7183f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:14.150602 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f305fd-9a92-4152-8ab2-caaeead7183f service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:14.160070 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1437/2868] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:31:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:31:14.180009 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3416aa-2232-49a8-874f-87c55923425e None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:14.251538 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3416aa-2232-49a8-874f-87c55923425e None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:14.257331 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a708c0-378c-4d8d-b10f-c38fb63183ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:14.258338 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a708c0-378c-4d8d-b10f-c38fb63183ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:14.258618 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a708c0-378c-4d8d-b10f-c38fb63183ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:14.259038 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a708c0-378c-4d8d-b10f-c38fb63183ad admin admin] PATH_INFO: `/v3/users/e7d28fe81253417580237462ad5a4ba9` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:14.260555 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a708c0-378c-4d8d-b10f-c38fb63183ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7d28fe81253417580237462ad5a4ba9)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:14.262592 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a708c0-378c-4d8d-b10f-c38fb63183ad admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:14.320508 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-61a708c0-378c-4d8d-b10f-c38fb63183ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7d28fe81253417580237462ad5a4ba9'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:14.333060 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:31:14.341651 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-61a708c0-378c-4d8d-b10f-c38fb63183ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7d28fe81253417580237462ad5a4ba9'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:14.349713 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-61a708c0-378c-4d8d-b10f-c38fb63183ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7d28fe81253417580237462ad5a4ba9'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:14.350467 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-61a708c0-378c-4d8d-b10f-c38fb63183ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7d28fe81253417580237462ad5a4ba9'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:14.358608 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-61a708c0-378c-4d8d-b10f-c38fb63183ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7d28fe81253417580237462ad5a4ba9'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:14.364821 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1432/2869] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:31:14 2022] DELETE /identity/v3/users/e7d28fe81253417580237462ad5a4ba9 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:31:14.369386 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e4190-e2c7-491a-bbd2-3b017ea7ff0b None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:14.369763 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e4190-e2c7-491a-bbd2-3b017ea7ff0b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:14.370045 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e4190-e2c7-491a-bbd2-3b017ea7ff0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:14.388627 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-697e4190-e2c7-491a-bbd2-3b017ea7ff0b None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:31:14.389878 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-697e4190-e2c7-491a-bbd2-3b017ea7ff0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:31:14.453079 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1438/2870] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:31:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:31:14.464948 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a708c0-378c-4d8d-b10f-c38fb63183ad admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:14.466431 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-61a708c0-378c-4d8d-b10f-c38fb63183ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:31:14.549644 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a708c0-378c-4d8d-b10f-c38fb63183ad admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:14.553599 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e98ee-b0e4-4b4d-a81c-00b423fe8d60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:14.554294 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e98ee-b0e4-4b4d-a81c-00b423fe8d60 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:14.554595 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e98ee-b0e4-4b4d-a81c-00b423fe8d60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:14.555108 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e98ee-b0e4-4b4d-a81c-00b423fe8d60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:14.564902 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6e98ee-b0e4-4b4d-a81c-00b423fe8d60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:14.566382 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6e98ee-b0e4-4b4d-a81c-00b423fe8d60 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:14.582807 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1433/2871] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:31:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:31:15.083933 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697e4190-e2c7-491a-bbd2-3b017ea7ff0b None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:15.086317 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-697e4190-e2c7-491a-bbd2-3b017ea7ff0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:31:15.099949 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697e4190-e2c7-491a-bbd2-3b017ea7ff0b None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:15.104913 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d3bdb-6fb4-49f4-be8a-0d8fa3f04d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:15.106119 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d3bdb-6fb4-49f4-be8a-0d8fa3f04d8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:15.106470 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d3bdb-6fb4-49f4-be8a-0d8fa3f04d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:15.106836 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d3bdb-6fb4-49f4-be8a-0d8fa3f04d8c admin admin] PATH_INFO: `/v3/projects/973f6afbcde54545bde44fc1038af87d` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:15.108141 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20d3bdb-6fb4-49f4-be8a-0d8fa3f04d8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=973f6afbcde54545bde44fc1038af87d)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:15.110340 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20d3bdb-6fb4-49f4-be8a-0d8fa3f04d8c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:15.136952 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:31:15.164821 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c20d3bdb-6fb4-49f4-be8a-0d8fa3f04d8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '973f6afbcde54545bde44fc1038af87d', 'request_id': 'req-c20d3bdb-6fb4-49f4-be8a-0d8fa3f04d8c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:15.172417 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c20d3bdb-6fb4-49f4-be8a-0d8fa3f04d8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '973f6afbcde54545bde44fc1038af87d', 'request_id': 'req-c20d3bdb-6fb4-49f4-be8a-0d8fa3f04d8c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:15.181460 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c20d3bdb-6fb4-49f4-be8a-0d8fa3f04d8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '973f6afbcde54545bde44fc1038af87d', 'request_id': 'req-c20d3bdb-6fb4-49f4-be8a-0d8fa3f04d8c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:15.194845 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c20d3bdb-6fb4-49f4-be8a-0d8fa3f04d8c admin admin] The token cache is being invalidate because project 973f6afbcde54545bde44fc1038af87d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:31:15.195382 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c20d3bdb-6fb4-49f4-be8a-0d8fa3f04d8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:15.196365 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c20d3bdb-6fb4-49f4-be8a-0d8fa3f04d8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:15.198177 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1439/2872] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:31:15 2022] DELETE /identity/v3/projects/973f6afbcde54545bde44fc1038af87d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:31:15.206435 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db18260-cbae-4fce-8d8e-6e99d01e2361 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:15.206734 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db18260-cbae-4fce-8d8e-6e99d01e2361 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:15.207039 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db18260-cbae-4fce-8d8e-6e99d01e2361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:15.228472 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-8db18260-cbae-4fce-8d8e-6e99d01e2361 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:31:15.229726 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-8db18260-cbae-4fce-8d8e-6e99d01e2361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:31:15.301869 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1434/2873] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:31:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:31:15.309576 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348d136-2fcf-4a46-bd4a-3799b510887e None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:15.309909 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348d136-2fcf-4a46-bd4a-3799b510887e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:15.310191 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348d136-2fcf-4a46-bd4a-3799b510887e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:15.329280 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-5348d136-2fcf-4a46-bd4a-3799b510887e None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:31:15.330484 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5348d136-2fcf-4a46-bd4a-3799b510887e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:31:15.338877 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1440/2874] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:31:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:31:15.343418 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db18260-cbae-4fce-8d8e-6e99d01e2361 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:15.354573 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db18260-cbae-4fce-8d8e-6e99d01e2361 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:15.361147 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ca9e8-b501-482a-8e92-9698239e8779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:15.361896 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ca9e8-b501-482a-8e92-9698239e8779 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:15.362330 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ca9e8-b501-482a-8e92-9698239e8779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:15.362620 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ca9e8-b501-482a-8e92-9698239e8779 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:15.363378 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295ca9e8-b501-482a-8e92-9698239e8779 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:31:15.363691 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295ca9e8-b501-482a-8e92-9698239e8779 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:15.365352 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295ca9e8-b501-482a-8e92-9698239e8779 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:15.379450 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1435/2875] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:31:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:31:15.383994 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348d136-2fcf-4a46-bd4a-3799b510887e None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:15.394862 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348d136-2fcf-4a46-bd4a-3799b510887e None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:15.399937 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7837e-143a-48a5-930b-050c41f3c756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:15.400628 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7837e-143a-48a5-930b-050c41f3c756 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:15.400911 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7837e-143a-48a5-930b-050c41f3c756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:15.401189 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7837e-143a-48a5-930b-050c41f3c756 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:15.401957 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b7837e-143a-48a5-930b-050c41f3c756 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:15.404117 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b7837e-143a-48a5-930b-050c41f3c756 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:15.436192 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1441/2876] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:31:15 2022] POST /identity/v3/projects => generated 359 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:31:15.441245 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ca9e8-b501-482a-8e92-9698239e8779 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:15.454020 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ca9e8-b501-482a-8e92-9698239e8779 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:15.524411 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4e3cb-7d9e-440d-814b-13f5ee7bb1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:15.525304 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4e3cb-7d9e-440d-814b-13f5ee7bb1e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:15.525682 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4e3cb-7d9e-440d-814b-13f5ee7bb1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:15.526079 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4e3cb-7d9e-440d-814b-13f5ee7bb1e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:15.527017 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c4e3cb-7d9e-440d-814b-13f5ee7bb1e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:15.529134 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c4e3cb-7d9e-440d-814b-13f5ee7bb1e8 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:15.541336 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:31:15.559814 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1436/2877] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:31:15 2022] POST /identity/v3/users => generated 280 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 12:31:15.561960 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7837e-143a-48a5-930b-050c41f3c756 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:15.573539 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7837e-143a-48a5-930b-050c41f3c756 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:15.578592 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60b54b-4d55-4b09-95f8-960774fffeb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:15.579272 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60b54b-4d55-4b09-95f8-960774fffeb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:15.579607 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60b54b-4d55-4b09-95f8-960774fffeb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:15.579832 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60b54b-4d55-4b09-95f8-960774fffeb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:15.580602 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec60b54b-4d55-4b09-95f8-960774fffeb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:15.582346 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec60b54b-4d55-4b09-95f8-960774fffeb5 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:15.594449 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1442/2878] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:31:15.599276 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4e3cb-7d9e-440d-814b-13f5ee7bb1e8 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:15.612984 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4e3cb-7d9e-440d-814b-13f5ee7bb1e8 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:15.618551 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9e47ea-81f5-47d9-81b5-af06e95dbc4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:15.619383 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e47ea-81f5-47d9-81b5-af06e95dbc4f admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:15.619761 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e47ea-81f5-47d9-81b5-af06e95dbc4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:15.620130 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e47ea-81f5-47d9-81b5-af06e95dbc4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:15.621100 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9e47ea-81f5-47d9-81b5-af06e95dbc4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:15.623013 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9e47ea-81f5-47d9-81b5-af06e95dbc4f admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:15.643067 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1437/2879] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 12:31:15.645243 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60b54b-4d55-4b09-95f8-960774fffeb5 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:15.659764 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60b54b-4d55-4b09-95f8-960774fffeb5 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:15.664745 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ed437-aa57-49fd-8d4e-e43a977579b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:15.665847 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ed437-aa57-49fd-8d4e-e43a977579b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:15.666125 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ed437-aa57-49fd-8d4e-e43a977579b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:15.666403 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ed437-aa57-49fd-8d4e-e43a977579b8 admin admin] PATH_INFO: `/v3/projects/e09080a916ce456da8b4e3ad05eb33a7/users/0e3fad70a84543fd89c9d3b1a329bcb2/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:15.685155 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1ed437-aa57-49fd-8d4e-e43a977579b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e09080a916ce456da8b4e3ad05eb33a7, user_id=0e3fad70a84543fd89c9d3b1a329bcb2, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:15.688281 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1ed437-aa57-49fd-8d4e-e43a977579b8 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:15.716151 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1443/2880] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:31:15 2022] PUT /identity/v3/projects/e09080a916ce456da8b4e3ad05eb33a7/users/0e3fad70a84543fd89c9d3b1a329bcb2/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:31:15.718036 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb92e61-c2e3-42b4-9e74-713e0c8b4e59 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:15.718625 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb92e61-c2e3-42b4-9e74-713e0c8b4e59 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:15.718971 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb92e61-c2e3-42b4-9e74-713e0c8b4e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:15.751830 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-9bb92e61-c2e3-42b4-9e74-713e0c8b4e59 None None] MFA Rules not processed for user `0e3fad70a84543fd89c9d3b1a329bcb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:31:15.753122 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-9bb92e61-c2e3-42b4-9e74-713e0c8b4e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:31:15.824528 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1438/2881] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:31:15 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:31:15.861135 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ed437-aa57-49fd-8d4e-e43a977579b8 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:15.864354 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-cd1ed437-aa57-49fd-8d4e-e43a977579b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:31:15.936946 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ed437-aa57-49fd-8d4e-e43a977579b8 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:15.941021 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec6eac4-04f2-4a7d-b08b-ecbfcc4becf7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72f0602e17f4ab4a48e3aaa7022d28d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:15.941869 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6eac4-04f2-4a7d-b08b-ecbfcc4becf7 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:15.942356 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6eac4-04f2-4a7d-b08b-ecbfcc4becf7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:15.942569 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6eac4-04f2-4a7d-b08b-ecbfcc4becf7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:15.952362 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec6eac4-04f2-4a7d-b08b-ecbfcc4becf7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:15.954023 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec6eac4-04f2-4a7d-b08b-ecbfcc4becf7 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:15.964003 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1444/2882] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:31:15 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:31:15.979822 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb92e61-c2e3-42b4-9e74-713e0c8b4e59 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:16.058325 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb92e61-c2e3-42b4-9e74-713e0c8b4e59 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:16.065620 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e6003-75b6-4791-9c60-3c0c9b72812f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:16.066551 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e6003-75b6-4791-9c60-3c0c9b72812f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:16.066860 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e6003-75b6-4791-9c60-3c0c9b72812f admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:16.067133 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e6003-75b6-4791-9c60-3c0c9b72812f admin admin] PATH_INFO: `/v3/users/0e3fad70a84543fd89c9d3b1a329bcb2` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:16.068441 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0e6003-75b6-4791-9c60-3c0c9b72812f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e3fad70a84543fd89c9d3b1a329bcb2)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:16.070425 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0e6003-75b6-4791-9c60-3c0c9b72812f admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:16.120505 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-4d0e6003-75b6-4791-9c60-3c0c9b72812f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e3fad70a84543fd89c9d3b1a329bcb2'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:16.134427 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-4d0e6003-75b6-4791-9c60-3c0c9b72812f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e3fad70a84543fd89c9d3b1a329bcb2'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:16.141976 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-4d0e6003-75b6-4791-9c60-3c0c9b72812f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e3fad70a84543fd89c9d3b1a329bcb2'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:16.142732 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-4d0e6003-75b6-4791-9c60-3c0c9b72812f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e3fad70a84543fd89c9d3b1a329bcb2'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:16.145771 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:31:16.151955 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-4d0e6003-75b6-4791-9c60-3c0c9b72812f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e3fad70a84543fd89c9d3b1a329bcb2'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:16.163006 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1439/2883] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:31:15 2022] DELETE /identity/v3/users/0e3fad70a84543fd89c9d3b1a329bcb2 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:31:16.165365 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6ab13-830c-4a6a-be8f-78ce4f05d460 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:16.165901 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6ab13-830c-4a6a-be8f-78ce4f05d460 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:16.166002 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6ab13-830c-4a6a-be8f-78ce4f05d460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:16.184083 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-8aa6ab13-830c-4a6a-be8f-78ce4f05d460 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:31:16.185217 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8aa6ab13-830c-4a6a-be8f-78ce4f05d460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:31:16.231225 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:31:16.254658 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1445/2884] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:31:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:31:16.264330 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e6003-75b6-4791-9c60-3c0c9b72812f admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:16.266325 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-4d0e6003-75b6-4791-9c60-3c0c9b72812f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:31:16.349486 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e6003-75b6-4791-9c60-3c0c9b72812f admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:16.353941 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9538b066-08fb-4ce8-8b81-3b9ac7abdf4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:16.354616 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538b066-08fb-4ce8-8b81-3b9ac7abdf4e service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:16.354899 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538b066-08fb-4ce8-8b81-3b9ac7abdf4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:16.355179 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538b066-08fb-4ce8-8b81-3b9ac7abdf4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:16.366172 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9538b066-08fb-4ce8-8b81-3b9ac7abdf4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:16.368232 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9538b066-08fb-4ce8-8b81-3b9ac7abdf4e service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:16.386017 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1440/2885] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:31:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:31:16.767047 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa6ab13-830c-4a6a-be8f-78ce4f05d460 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:16.768792 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8aa6ab13-830c-4a6a-be8f-78ce4f05d460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:31:16.786223 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa6ab13-830c-4a6a-be8f-78ce4f05d460 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:16.791781 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87ce21d-997c-440f-b322-39819945bfa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:16.792824 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ce21d-997c-440f-b322-39819945bfa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:16.793158 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ce21d-997c-440f-b322-39819945bfa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:16.793435 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ce21d-997c-440f-b322-39819945bfa0 admin admin] PATH_INFO: `/v3/projects/e09080a916ce456da8b4e3ad05eb33a7` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:16.794801 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87ce21d-997c-440f-b322-39819945bfa0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e09080a916ce456da8b4e3ad05eb33a7)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:16.797330 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87ce21d-997c-440f-b322-39819945bfa0 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:16.859022 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e87ce21d-997c-440f-b322-39819945bfa0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e09080a916ce456da8b4e3ad05eb33a7', 'request_id': 'req-e87ce21d-997c-440f-b322-39819945bfa0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:16.867350 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e87ce21d-997c-440f-b322-39819945bfa0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e09080a916ce456da8b4e3ad05eb33a7', 'request_id': 'req-e87ce21d-997c-440f-b322-39819945bfa0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:16.877033 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e87ce21d-997c-440f-b322-39819945bfa0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e09080a916ce456da8b4e3ad05eb33a7', 'request_id': 'req-e87ce21d-997c-440f-b322-39819945bfa0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:16.890220 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e87ce21d-997c-440f-b322-39819945bfa0 admin admin] The token cache is being invalidate because project e09080a916ce456da8b4e3ad05eb33a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:31:16.890676 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e87ce21d-997c-440f-b322-39819945bfa0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:16.891538 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e87ce21d-997c-440f-b322-39819945bfa0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:16.893507 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1446/2886] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:31:16 2022] DELETE /identity/v3/projects/e09080a916ce456da8b4e3ad05eb33a7 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:31:16.898803 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cce610-5579-474a-90fe-174cca7b8a19 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:16.899202 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cce610-5579-474a-90fe-174cca7b8a19 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:16.899760 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cce610-5579-474a-90fe-174cca7b8a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:16.922576 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-c4cce610-5579-474a-90fe-174cca7b8a19 None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:31:16.923818 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-c4cce610-5579-474a-90fe-174cca7b8a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:31:16.990988 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1441/2887] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:31:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:31:16.998860 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81df2fa-d667-448b-b069-5dddfc9d9adb None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:16.999131 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81df2fa-d667-448b-b069-5dddfc9d9adb None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:16.999476 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81df2fa-d667-448b-b069-5dddfc9d9adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:17.018070 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c81df2fa-d667-448b-b069-5dddfc9d9adb None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:31:17.019227 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c81df2fa-d667-448b-b069-5dddfc9d9adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:31:17.032665 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1447/2888] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:31:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:31:17.033023 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cce610-5579-474a-90fe-174cca7b8a19 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:17.042541 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cce610-5579-474a-90fe-174cca7b8a19 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:17.048232 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c658e9-426d-44d6-b1cf-248dd53d3d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:17.048921 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c658e9-426d-44d6-b1cf-248dd53d3d63 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:17.049204 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c658e9-426d-44d6-b1cf-248dd53d3d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:17.049537 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c658e9-426d-44d6-b1cf-248dd53d3d63 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:17.050320 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c658e9-426d-44d6-b1cf-248dd53d3d63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 12:31:17.050628 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c658e9-426d-44d6-b1cf-248dd53d3d63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:17.052285 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c658e9-426d-44d6-b1cf-248dd53d3d63 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:17.071100 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81df2fa-d667-448b-b069-5dddfc9d9adb None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:17.075885 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1442/2889] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jun 29 12:31:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 12:31:17.093270 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81df2fa-d667-448b-b069-5dddfc9d9adb None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:17.100966 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1164a7af-f9b1-413b-97d8-cd94ac80b7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:17.101652 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1164a7af-f9b1-413b-97d8-cd94ac80b7f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:17.102137 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1164a7af-f9b1-413b-97d8-cd94ac80b7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:17.102420 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1164a7af-f9b1-413b-97d8-cd94ac80b7f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:17.103136 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1164a7af-f9b1-413b-97d8-cd94ac80b7f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:17.105058 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1164a7af-f9b1-413b-97d8-cd94ac80b7f1 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:17.143099 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1448/2890] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jun 29 12:31:17 2022] POST /identity/v3/projects => generated 367 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:31:17.147227 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c658e9-426d-44d6-b1cf-248dd53d3d63 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:17.159142 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c658e9-426d-44d6-b1cf-248dd53d3d63 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:17.213457 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1164a7af-f9b1-413b-97d8-cd94ac80b7f1 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:17.216089 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1164a7af-f9b1-413b-97d8-cd94ac80b7f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:31:17.230174 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb239a-433f-423a-9d92-23f598dbe22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:17.230871 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb239a-433f-423a-9d92-23f598dbe22c admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:17.231158 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb239a-433f-423a-9d92-23f598dbe22c admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:17.231519 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb239a-433f-423a-9d92-23f598dbe22c admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:17.232302 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb239a-433f-423a-9d92-23f598dbe22c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:17.234368 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb239a-433f-423a-9d92-23f598dbe22c admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:17.261742 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1443/2891] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jun 29 12:31:17 2022] POST /identity/v3/users => generated 284 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 12:31:17.263435 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb239a-433f-423a-9d92-23f598dbe22c admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:17.273594 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb239a-433f-423a-9d92-23f598dbe22c admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:17.278409 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e538ff-f673-4847-bd50-d75f61286e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:17.279078 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e538ff-f673-4847-bd50-d75f61286e29 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:17.279364 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e538ff-f673-4847-bd50-d75f61286e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:17.279643 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e538ff-f673-4847-bd50-d75f61286e29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:17.280381 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e538ff-f673-4847-bd50-d75f61286e29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:17.282208 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e538ff-f673-4847-bd50-d75f61286e29 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:17.288120 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1164a7af-f9b1-413b-97d8-cd94ac80b7f1 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:17.293741 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1444/2892] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:31:17.293912 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da18a2-71fe-49a8-9741-0b0fd64005bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:17.293912 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da18a2-71fe-49a8-9741-0b0fd64005bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:17.294182 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da18a2-71fe-49a8-9741-0b0fd64005bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:17.294453 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da18a2-71fe-49a8-9741-0b0fd64005bc admin admin] PATH_INFO: `/v3/users/2310114acbaa46e0b93827dd3dde92f6` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:17.296028 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74da18a2-71fe-49a8-9741-0b0fd64005bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2310114acbaa46e0b93827dd3dde92f6)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:17.297585 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e538ff-f673-4847-bd50-d75f61286e29 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:17.298918 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74da18a2-71fe-49a8-9741-0b0fd64005bc admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:17.302908 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:31:17.309315 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e538ff-f673-4847-bd50-d75f61286e29 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:17.315360 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f9bb4-3406-425e-a619-89cdfcc74572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:17.316029 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f9bb4-3406-425e-a619-89cdfcc74572 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:17.316314 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f9bb4-3406-425e-a619-89cdfcc74572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:17.316591 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f9bb4-3406-425e-a619-89cdfcc74572 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:17.317313 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123f9bb4-3406-425e-a619-89cdfcc74572 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:17.319035 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123f9bb4-3406-425e-a619-89cdfcc74572 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:17.331113 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1445/2893] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jun 29 12:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 12:31:17.335772 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f9bb4-3406-425e-a619-89cdfcc74572 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:17.350692 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f9bb4-3406-425e-a619-89cdfcc74572 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:17.356385 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:31:17.356763 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a1b6a-4e20-422e-9de9-8c7cd516e271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:17.366339 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a1b6a-4e20-422e-9de9-8c7cd516e271 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:17.366339 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a1b6a-4e20-422e-9de9-8c7cd516e271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:17.366339 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a1b6a-4e20-422e-9de9-8c7cd516e271 admin admin] PATH_INFO: `/v3/projects/03b76fa8c0984b0ab7ffc3c149f2cd9c/users/f8181a23b3f546a2ba9c153e9b8de419/roles/c49accbc6f81447cb221ef720db04ced` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:17.368183 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-74da18a2-71fe-49a8-9741-0b0fd64005bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2310114acbaa46e0b93827dd3dde92f6'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:17.368992 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-74da18a2-71fe-49a8-9741-0b0fd64005bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2310114acbaa46e0b93827dd3dde92f6'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:17.369654 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-74da18a2-71fe-49a8-9741-0b0fd64005bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2310114acbaa46e0b93827dd3dde92f6'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:17.375160 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a1b6a-4e20-422e-9de9-8c7cd516e271 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03b76fa8c0984b0ab7ffc3c149f2cd9c, user_id=f8181a23b3f546a2ba9c153e9b8de419, role_id=c49accbc6f81447cb221ef720db04ced)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:17.377889 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a1b6a-4e20-422e-9de9-8c7cd516e271 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:17.383150 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-74da18a2-71fe-49a8-9741-0b0fd64005bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2310114acbaa46e0b93827dd3dde92f6'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:17.391218 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-74da18a2-71fe-49a8-9741-0b0fd64005bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2310114acbaa46e0b93827dd3dde92f6'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:17.392962 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1446/2894] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jun 29 12:31:17 2022] PUT /identity/v3/projects/03b76fa8c0984b0ab7ffc3c149f2cd9c/users/f8181a23b3f546a2ba9c153e9b8de419/roles/c49accbc6f81447cb221ef720db04ced => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 12:31:17.403166 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25a8d9-f130-4e4c-b445-13d0f881874f None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:17.403454 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25a8d9-f130-4e4c-b445-13d0f881874f None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:17.403779 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25a8d9-f130-4e4c-b445-13d0f881874f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:17.405047 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1449/2895] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:31:17 2022] DELETE /identity/v3/users/2310114acbaa46e0b93827dd3dde92f6 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:31:17.432417 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-6b25a8d9-f130-4e4c-b445-13d0f881874f None None] MFA Rules not processed for user `f8181a23b3f546a2ba9c153e9b8de419`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:31:17.433686 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-6b25a8d9-f130-4e4c-b445-13d0f881874f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:31:17.505032 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1447/2896] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:31:17 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 12:31:17.514023 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da18a2-71fe-49a8-9741-0b0fd64005bc admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:17.515622 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-74da18a2-71fe-49a8-9741-0b0fd64005bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:31:17.584643 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b25a8d9-f130-4e4c-b445-13d0f881874f None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:17.586304 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-6b25a8d9-f130-4e4c-b445-13d0f881874f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:31:17.591719 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da18a2-71fe-49a8-9741-0b0fd64005bc admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:17.596683 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bfe5cb-6730-4742-83e9-c7c701fdbe67 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd865d1b935a54ca2b44beda5b0277336', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:17.597416 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bfe5cb-6730-4742-83e9-c7c701fdbe67 service glance] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:17.597736 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bfe5cb-6730-4742-83e9-c7c701fdbe67 service glance] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:17.598009 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bfe5cb-6730-4742-83e9-c7c701fdbe67 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:17.611918 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bfe5cb-6730-4742-83e9-c7c701fdbe67 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:17.613991 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bfe5cb-6730-4742-83e9-c7c701fdbe67 service glance] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:17.623626 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1450/2897] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:31:17 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:31:17.665218 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b25a8d9-f130-4e4c-b445-13d0f881874f None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:17.669816 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8f7f7-ddfe-4428-a50f-1fb54053a458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:17.671146 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8f7f7-ddfe-4428-a50f-1fb54053a458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:17.671350 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8f7f7-ddfe-4428-a50f-1fb54053a458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:17.671619 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8f7f7-ddfe-4428-a50f-1fb54053a458 admin admin] PATH_INFO: `/v3/projects/7e4bc047d3c941d2b6e23b6ca56e995f` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:17.672800 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b8f7f7-ddfe-4428-a50f-1fb54053a458 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e4bc047d3c941d2b6e23b6ca56e995f)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:17.674739 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b8f7f7-ddfe-4428-a50f-1fb54053a458 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:17.724826 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-52b8f7f7-ddfe-4428-a50f-1fb54053a458 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e4bc047d3c941d2b6e23b6ca56e995f', 'request_id': 'req-52b8f7f7-ddfe-4428-a50f-1fb54053a458'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:17.730985 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-52b8f7f7-ddfe-4428-a50f-1fb54053a458 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e4bc047d3c941d2b6e23b6ca56e995f', 'request_id': 'req-52b8f7f7-ddfe-4428-a50f-1fb54053a458'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:17.732968 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:31:17.741384 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-52b8f7f7-ddfe-4428-a50f-1fb54053a458 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e4bc047d3c941d2b6e23b6ca56e995f', 'request_id': 'req-52b8f7f7-ddfe-4428-a50f-1fb54053a458'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:17.757297 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-52b8f7f7-ddfe-4428-a50f-1fb54053a458 admin admin] The token cache is being invalidate because project 7e4bc047d3c941d2b6e23b6ca56e995f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:31:17.757571 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-52b8f7f7-ddfe-4428-a50f-1fb54053a458 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:17.758264 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-52b8f7f7-ddfe-4428-a50f-1fb54053a458 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:17.759872 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1448/2898] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:31:17 2022] DELETE /identity/v3/projects/7e4bc047d3c941d2b6e23b6ca56e995f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:31:17.763959 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bfe5cb-6730-4742-83e9-c7c701fdbe67 service glance] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:17.776272 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bfe5cb-6730-4742-83e9-c7c701fdbe67 service glance] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:17.835982 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed82c338-cf1c-4086-8cb1-a3886bc64916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:17.837021 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82c338-cf1c-4086-8cb1-a3886bc64916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:17.837379 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82c338-cf1c-4086-8cb1-a3886bc64916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:17.837733 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82c338-cf1c-4086-8cb1-a3886bc64916 admin admin] PATH_INFO: `/v3/users/01ecbdef89384d76bfdca85b71d24527` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:17.838987 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed82c338-cf1c-4086-8cb1-a3886bc64916 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01ecbdef89384d76bfdca85b71d24527)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:17.840919 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed82c338-cf1c-4086-8cb1-a3886bc64916 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:17.889183 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ed82c338-cf1c-4086-8cb1-a3886bc64916 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01ecbdef89384d76bfdca85b71d24527'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:17.890004 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ed82c338-cf1c-4086-8cb1-a3886bc64916 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01ecbdef89384d76bfdca85b71d24527'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:17.890720 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ed82c338-cf1c-4086-8cb1-a3886bc64916 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01ecbdef89384d76bfdca85b71d24527'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:17.903466 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ed82c338-cf1c-4086-8cb1-a3886bc64916 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01ecbdef89384d76bfdca85b71d24527'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:17.905238 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:31:17.911886 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ed82c338-cf1c-4086-8cb1-a3886bc64916 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01ecbdef89384d76bfdca85b71d24527'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:17.926200 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1451/2899] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:31:17 2022] DELETE /identity/v3/users/01ecbdef89384d76bfdca85b71d24527 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:31:18.407367 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8f7f7-ddfe-4428-a50f-1fb54053a458 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:18.409136 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-52b8f7f7-ddfe-4428-a50f-1fb54053a458 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:31:18.423755 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8f7f7-ddfe-4428-a50f-1fb54053a458 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:18.508043 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c11b3-1e9d-44da-b02f-09cebb588a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:18.508959 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c11b3-1e9d-44da-b02f-09cebb588a69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:18.509236 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c11b3-1e9d-44da-b02f-09cebb588a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:18.509535 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c11b3-1e9d-44da-b02f-09cebb588a69 admin admin] PATH_INFO: `/v3/projects/17c15317ea8a46529f8c839886968a34` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:18.510811 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c11b3-1e9d-44da-b02f-09cebb588a69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17c15317ea8a46529f8c839886968a34)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:18.512726 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c11b3-1e9d-44da-b02f-09cebb588a69 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:18.568950 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-d82c11b3-1e9d-44da-b02f-09cebb588a69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17c15317ea8a46529f8c839886968a34', 'request_id': 'req-d82c11b3-1e9d-44da-b02f-09cebb588a69'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:18.575101 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-d82c11b3-1e9d-44da-b02f-09cebb588a69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17c15317ea8a46529f8c839886968a34', 'request_id': 'req-d82c11b3-1e9d-44da-b02f-09cebb588a69'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:18.583817 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-d82c11b3-1e9d-44da-b02f-09cebb588a69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17c15317ea8a46529f8c839886968a34', 'request_id': 'req-d82c11b3-1e9d-44da-b02f-09cebb588a69'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:18.598649 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-d82c11b3-1e9d-44da-b02f-09cebb588a69 admin admin] The token cache is being invalidate because project 17c15317ea8a46529f8c839886968a34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:31:18.598940 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-d82c11b3-1e9d-44da-b02f-09cebb588a69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:18.599679 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-d82c11b3-1e9d-44da-b02f-09cebb588a69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:18.601338 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1449/2900] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:31:18 2022] DELETE /identity/v3/projects/17c15317ea8a46529f8c839886968a34 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:31:27.922379 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=6 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:31:28.595022 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=55 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:31:38.504433 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed82c338-cf1c-4086-8cb1-a3886bc64916 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:38.506298 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ed82c338-cf1c-4086-8cb1-a3886bc64916 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:31:38.520280 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed82c338-cf1c-4086-8cb1-a3886bc64916 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:38.591139 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeaf0c5-cb4c-4543-9fc7-bfe54a993086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:38.592033 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeaf0c5-cb4c-4543-9fc7-bfe54a993086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:38.592302 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeaf0c5-cb4c-4543-9fc7-bfe54a993086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:38.592580 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeaf0c5-cb4c-4543-9fc7-bfe54a993086 admin admin] PATH_INFO: `/v3/users/f8181a23b3f546a2ba9c153e9b8de419` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:38.593955 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeaf0c5-cb4c-4543-9fc7-bfe54a993086 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8181a23b3f546a2ba9c153e9b8de419)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:38.595918 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeaf0c5-cb4c-4543-9fc7-bfe54a993086 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:38.651661 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-dbeaf0c5-cb4c-4543-9fc7-bfe54a993086 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8181a23b3f546a2ba9c153e9b8de419'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:38.652313 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-dbeaf0c5-cb4c-4543-9fc7-bfe54a993086 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8181a23b3f546a2ba9c153e9b8de419'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:38.652946 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-dbeaf0c5-cb4c-4543-9fc7-bfe54a993086 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8181a23b3f546a2ba9c153e9b8de419'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:38.666508 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-dbeaf0c5-cb4c-4543-9fc7-bfe54a993086 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8181a23b3f546a2ba9c153e9b8de419'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:38.676009 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-dbeaf0c5-cb4c-4543-9fc7-bfe54a993086 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8181a23b3f546a2ba9c153e9b8de419'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:38.693851 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1452/2901] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jun 29 12:31:38 2022] DELETE /identity/v3/users/f8181a23b3f546a2ba9c153e9b8de419 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:31:38.698558 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c4fed-1109-4c61-9890-6800c983979c None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:38.699075 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c4fed-1109-4c61-9890-6800c983979c None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:38.699075 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c4fed-1109-4c61-9890-6800c983979c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:38.717931 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-274c4fed-1109-4c61-9890-6800c983979c None None] MFA Rules not processed for user `06533d70196747b697431af8a9794673`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 12:31:38.719143 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-274c4fed-1109-4c61-9890-6800c983979c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:31:38.788252 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1450/2902] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jun 29 12:31:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 12:31:38.801260 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeaf0c5-cb4c-4543-9fc7-bfe54a993086 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:38.803503 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-dbeaf0c5-cb4c-4543-9fc7-bfe54a993086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:31:38.865290 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeaf0c5-cb4c-4543-9fc7-bfe54a993086 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:38.869298 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b66c21-c922-45f0-abad-41c3815fb7cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94618bb382d46f7aaa2ef8f5d690bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:38.869982 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b66c21-c922-45f0-abad-41c3815fb7cb service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:38.870262 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b66c21-c922-45f0-abad-41c3815fb7cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:38.870534 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b66c21-c922-45f0-abad-41c3815fb7cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:38.879745 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b66c21-c922-45f0-abad-41c3815fb7cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:38.881175 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b66c21-c922-45f0-abad-41c3815fb7cb service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:38.890965 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1453/2903] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:31:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 12:31:39.170688 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c4fed-1109-4c61-9890-6800c983979c None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:31:39.172321 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-274c4fed-1109-4c61-9890-6800c983979c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:31:39.187084 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c4fed-1109-4c61-9890-6800c983979c None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:31:39.193936 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ff87a-1792-4900-b819-db2d3d5529dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06533d70196747b697431af8a9794673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06b39178fa6444fba25717312ec5afa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:31:39.194841 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ff87a-1792-4900-b819-db2d3d5529dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:31:39.195120 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ff87a-1792-4900-b819-db2d3d5529dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:31:39.195390 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ff87a-1792-4900-b819-db2d3d5529dc admin admin] PATH_INFO: `/v3/projects/03b76fa8c0984b0ab7ffc3c149f2cd9c` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:31:39.196695 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130ff87a-1792-4900-b819-db2d3d5529dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=03b76fa8c0984b0ab7ffc3c149f2cd9c)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:31:39.198904 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130ff87a-1792-4900-b819-db2d3d5529dc admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:31:39.249436 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-130ff87a-1792-4900-b819-db2d3d5529dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03b76fa8c0984b0ab7ffc3c149f2cd9c', 'request_id': 'req-130ff87a-1792-4900-b819-db2d3d5529dc'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:39.255358 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-130ff87a-1792-4900-b819-db2d3d5529dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03b76fa8c0984b0ab7ffc3c149f2cd9c', 'request_id': 'req-130ff87a-1792-4900-b819-db2d3d5529dc'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:39.264055 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-130ff87a-1792-4900-b819-db2d3d5529dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03b76fa8c0984b0ab7ffc3c149f2cd9c', 'request_id': 'req-130ff87a-1792-4900-b819-db2d3d5529dc'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:39.275611 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-130ff87a-1792-4900-b819-db2d3d5529dc admin admin] The token cache is being invalidate because project 03b76fa8c0984b0ab7ffc3c149f2cd9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 12:31:39.275899 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-130ff87a-1792-4900-b819-db2d3d5529dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:39.276574 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-130ff87a-1792-4900-b819-db2d3d5529dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 12:31:39.278217 dv-cinder-797608-38-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1451/2904] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jun 29 12:31:39 2022] DELETE /identity/v3/projects/03b76fa8c0984b0ab7ffc3c149f2cd9c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 12:31:48.886561 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:31:49.272648 dv-cinder-797608-38-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:34:19.088978 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b66c21-c922-45f0-abad-41c3815fb7cb service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 12:34:19.090541 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-77b66c21-c922-45f0-abad-41c3815fb7cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:34:19.247287 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b66c21-c922-45f0-abad-41c3815fb7cb service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 12:34:19.312538 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d7fcee-2c1e-46e4-a937-d82a03a85b47 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '286a99b42d9246db909040bf8ab18ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '996db30845f84e57865fa40b9a730a05', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 12:34:19.313185 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d7fcee-2c1e-46e4-a937-d82a03a85b47 service placement] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 12:34:19.313465 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d7fcee-2c1e-46e4-a937-d82a03a85b47 service placement] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 12:34:19.313749 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d7fcee-2c1e-46e4-a937-d82a03a85b47 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 12:34:19.315780 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-77d7fcee-2c1e-46e4-a937-d82a03a85b47 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 12:34:19.327609 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d7fcee-2c1e-46e4-a937-d82a03a85b47 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 12:34:19.329193 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d7fcee-2c1e-46e4-a937-d82a03a85b47 service placement] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 12:34:19.339548 dv-cinder-797608-38-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1454/2905] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jun 29 12:34:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 12:34:29.335440 dv-cinder-797608-38-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}